-- Logs begin at Tue 2021-10-12 16:05:52 UTC, end at Tue 2021-10-12 17:34:47 UTC. -- Oct 12 16:36:22.605660 dv-cinder-813222-2-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Oct 12 16:36:22.614406 dv-cinder-813222-2-iscsi devstack@keystone.service[85189]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Oct 12 16:36:22.616397 dv-cinder-813222-2-iscsi devstack@keystone.service[85189]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Oct 12 16:36:22 2021] *** Oct 12 16:36:22.616397 dv-cinder-813222-2-iscsi devstack@keystone.service[85189]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 12 16:36:22.616397 dv-cinder-813222-2-iscsi devstack@keystone.service[85189]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 12 16:36:22.616397 dv-cinder-813222-2-iscsi devstack@keystone.service[85189]: nodename: dv-cinder-813222-2-iscsi Oct 12 16:36:22.616397 dv-cinder-813222-2-iscsi devstack@keystone.service[85189]: machine: x86_64 Oct 12 16:36:22.616397 dv-cinder-813222-2-iscsi devstack@keystone.service[85189]: clock source: unix Oct 12 16:36:22.616397 dv-cinder-813222-2-iscsi devstack@keystone.service[85189]: pcre jit disabled Oct 12 16:36:22.616397 dv-cinder-813222-2-iscsi devstack@keystone.service[85189]: detected number of CPU cores: 4 Oct 12 16:36:22.616397 dv-cinder-813222-2-iscsi devstack@keystone.service[85189]: current working directory: / Oct 12 16:36:22.616397 dv-cinder-813222-2-iscsi devstack@keystone.service[85189]: detected binary path: /usr/bin/uwsgi-core Oct 12 16:36:22.616971 dv-cinder-813222-2-iscsi devstack@keystone.service[85189]: your processes number limit is 47680 Oct 12 16:36:22.616971 dv-cinder-813222-2-iscsi devstack@keystone.service[85189]: your memory page size is 4096 bytes Oct 12 16:36:22.616971 dv-cinder-813222-2-iscsi devstack@keystone.service[85189]: detected max file descriptor number: 2048 Oct 12 16:36:22.616971 dv-cinder-813222-2-iscsi devstack@keystone.service[85189]: lock engine: pthread robust mutexes Oct 12 16:36:22.616971 dv-cinder-813222-2-iscsi devstack@keystone.service[85189]: thunder lock: enabled Oct 12 16:36:22.616971 dv-cinder-813222-2-iscsi devstack@keystone.service[85189]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Oct 12 16:36:22.616971 dv-cinder-813222-2-iscsi devstack@keystone.service[85189]: Python version: 3.8.10 (default, Sep 28 2021, 16:10:42) [GCC 9.3.0] Oct 12 16:36:22.661370 dv-cinder-813222-2-iscsi devstack@keystone.service[85189]: Python main interpreter initialized at 0x560fd36fa9c0 Oct 12 16:36:22.661370 dv-cinder-813222-2-iscsi devstack@keystone.service[85189]: python threads support enabled Oct 12 16:36:22.661370 dv-cinder-813222-2-iscsi devstack@keystone.service[85189]: your server socket listen backlog is limited to 100 connections Oct 12 16:36:22.661370 dv-cinder-813222-2-iscsi devstack@keystone.service[85189]: your mercy for graceful operations on workers is 90 seconds Oct 12 16:36:22.661707 dv-cinder-813222-2-iscsi devstack@keystone.service[85189]: mapped 403077 bytes (393 KB) for 2 cores Oct 12 16:36:22.661802 dv-cinder-813222-2-iscsi devstack@keystone.service[85189]: *** Operational MODE: preforking *** Oct 12 16:36:22.662105 dv-cinder-813222-2-iscsi devstack@keystone.service[85189]: *** uWSGI is running in multiple interpreter mode *** Oct 12 16:36:22.662105 dv-cinder-813222-2-iscsi devstack@keystone.service[85189]: spawned uWSGI master process (pid: 85189) Oct 12 16:36:22.662304 dv-cinder-813222-2-iscsi systemd[1]: Started Devstack devstack@keystone.service. Oct 12 16:36:22.665704 dv-cinder-813222-2-iscsi devstack@keystone.service[85189]: spawned uWSGI worker 1 (pid: 85204, cores: 1) Oct 12 16:36:22.665704 dv-cinder-813222-2-iscsi devstack@keystone.service[85189]: spawned uWSGI worker 2 (pid: 85205, cores: 1) Oct 12 16:36:22.665704 dv-cinder-813222-2-iscsi devstack@keystone.service[85189]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 12 16:36:27.763626 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 12 16:36:27.763626 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: from cryptography.utils import int_from_bytes Oct 12 16:36:27.764409 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 12 16:36:27.764409 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: from cryptography.utils import int_from_bytes Oct 12 16:36:27.765077 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 12 16:36:27.765077 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: from cryptography.utils import int_from_bytes Oct 12 16:36:27.765540 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 12 16:36:27.765540 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: from cryptography.utils import int_from_bytes Oct 12 16:36:27.813693 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 12 16:36:27.813951 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 12 16:36:27.814195 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] command line args: [] {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 12 16:36:27.814655 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 12 16:36:27.814742 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 12 16:36:27.814868 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] ================================================================================ {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 12 16:36:27.814950 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 12 16:36:27.815114 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] command line args: [] {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 12 16:36:27.815198 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] admin_token = **** {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 16:36:27.815382 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] config_dir = [] {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 16:36:27.815459 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 12 16:36:27.815563 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] ================================================================================ {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 12 16:36:27.815639 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 16:36:27.815745 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] config_source = [] {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 16:36:27.815829 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] admin_token = **** {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 16:36:27.815928 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] debug = True {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 16:36:27.816074 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] config_dir = [] {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 16:36:27.816157 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 16:36:27.816359 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 16:36:27.816424 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] config_source = [] {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 16:36:27.817421 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 16:36:27.817500 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] debug = True {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 16:36:27.817561 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] insecure_debug = False {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 16:36:27.817624 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 16:36:27.817719 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 16:36:27.817786 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 16:36:27.817849 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 16:36:27.817935 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] insecure_debug = False {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 16:36:27.817995 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] list_limit = None {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 16:36:27.818067 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 16:36:27.818132 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] log_config_append = None {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 16:36:27.818132 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 16:36:27.818245 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 16:36:27.818304 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] log_dir = None {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 16:36:27.818360 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] list_limit = None {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 16:36:27.818423 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] log_file = None {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 16:36:27.818487 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] log_config_append = None {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 16:36:27.818545 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 16:36:27.818601 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 16:36:27.818601 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] log_dir = None {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 16:36:27.818712 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 16:36:27.818777 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] log_file = None {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 16:36:27.818840 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 16:36:27.818898 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 16:36:27.818991 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 16:36:27.819127 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 16:36:27.819204 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 16:36:27.819334 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 16:36:27.819436 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 16:36:27.819582 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 16:36:27.819722 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 16:36:27.819808 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 16:36:27.819933 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 16:36:27.820017 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 16:36:27.820089 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 16:36:27.820205 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 16:36:27.820295 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 16:36:27.820411 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 16:36:27.820498 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 16:36:27.820651 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 16:36:27.820772 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 16:36:27.820890 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 16:36:27.820974 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 16:36:27.821130 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 16:36:27.821259 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] notification_format = cadf {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 16:36:27.821370 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 16:36:27.821455 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 16:36:27.821623 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 16:36:27.821899 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] notification_format = cadf {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 16:36:27.822023 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.58/identity {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 16:36:27.822162 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] publish_errors = False {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 16:36:27.822243 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 16:36:27.822314 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 16:36:27.822542 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 16:36:27.822664 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.58/identity {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 16:36:27.822749 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 16:36:27.822851 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] publish_errors = False {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 16:36:27.822953 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 16:36:27.823089 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 16:36:27.823188 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 16:36:27.823324 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 16:36:27.823459 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] standard_threads = False {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 16:36:27.823532 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 16:36:27.823641 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] strict_password_check = False {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 16:36:27.823747 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 16:36:27.823883 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 16:36:27.823987 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 16:36:27.824070 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] use_eventlog = False {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 16:36:27.824222 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] use_journal = False {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 16:36:27.824310 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] standard_threads = False {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 16:36:27.824386 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] use_json = False {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 16:36:27.824457 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] strict_password_check = False {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 16:36:27.824556 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] use_stderr = False {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 16:36:27.824692 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 16:36:27.824770 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] use_syslog = False {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 16:36:27.824872 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] use_eventlog = False {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 16:36:27.824949 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] watch_log_file = False {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 16:36:27.825051 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] use_journal = False {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 16:36:27.825189 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.825267 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] use_json = False {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 16:36:27.825396 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] use_stderr = False {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 16:36:27.825473 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.825574 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] use_syslog = False {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 16:36:27.825671 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.825809 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] watch_log_file = False {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 16:36:27.825935 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.826105 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.826189 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.826350 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.826428 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.826616 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.826699 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.826860 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.826940 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.827109 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.827191 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.827349 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.827426 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.827596 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.827673 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.827829 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.827906 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.828075 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.828152 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.828311 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.828395 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.828556 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.828633 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.828792 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.828868 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.829024 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.829102 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.829271 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.829348 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.829512 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.829594 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.829746 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.829824 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.830013 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.830102 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.830273 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.830357 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.830526 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.830610 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.830767 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.830845 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.830998 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.831074 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.831230 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.831308 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.831461 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.831538 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.831699 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.831777 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.831948 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.832026 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.832194 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.832278 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.832423 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.832500 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.832645 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.832723 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.832884 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.832962 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.833129 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.833218 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.833365 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.833441 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.833602 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.833678 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.833851 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.833991 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.834106 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.834184 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.834335 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.834419 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.834569 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.834655 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.834798 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.834875 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.835025 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.835103 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.835253 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.835342 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.835487 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.835570 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.835734 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.835818 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.835965 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.836051 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.836336 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.836462 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.836559 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.836660 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.836755 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.836859 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.836956 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.837050 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.837144 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.837265 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.837346 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.837425 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.837551 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.837660 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.837786 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.837865 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.838047 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.838141 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.838286 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.838409 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.838523 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.838603 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.838753 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.838840 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.839003 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.839087 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.839239 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.839317 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.839478 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.839605 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.839711 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.839797 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.839964 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.840049 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.840198 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.840276 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.840429 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.840511 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.840665 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.840751 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.840901 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.840984 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.841161 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.841252 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.841398 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.841476 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.841656 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.841735 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.841891 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.841996 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.842142 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] cache.enabled = True {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.842233 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.842383 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.842461 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.842620 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.842712 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.842857 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.842937 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.843094 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.843173 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] cache.enabled = True {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.843332 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.843411 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.843568 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.843645 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.843807 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.843884 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.844048 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.844129 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.844290 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.844368 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.844520 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.844608 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.844750 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.844830 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.844980 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.845059 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.845216 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.845294 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.845446 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.845525 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.845686 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.845763 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.845942 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.846025 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.846187 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.846267 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.846420 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.846498 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.846665 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.846751 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.846908 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.846987 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.847157 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.847236 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.847390 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] auth.external = None {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.847469 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.847621 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] auth.mapped = None {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.847700 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.847899 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.847978 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.848138 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.848219 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.848370 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] auth.password = None {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.848456 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] auth.external = None {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.848599 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] auth.token = None {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.848678 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] auth.mapped = None {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.848837 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.848916 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.849073 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] catalog.caching = True {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.849162 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.849319 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.849940 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] auth.password = None {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.850115 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.850204 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] auth.token = None {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.850351 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.850449 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.850606 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] catalog.caching = True {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.850693 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.850837 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.850916 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.851074 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] credential.caching = True {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.851161 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.851324 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] credential.driver = sql {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.851402 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.851574 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.851679 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.851808 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.851888 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.852049 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.852134 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] credential.caching = True {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.852296 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.852382 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] credential.driver = sql {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.852533 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.852612 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.852782 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.852872 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.853025 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.853109 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.853262 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.853340 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.853501 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.853587 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.853753 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.853832 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.854049 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.854128 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.854315 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.854406 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.854560 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.854640 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.854815 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.854894 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.855050 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] federation.caching = True {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.855138 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.855288 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.855372 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.855549 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] federation.driver = sql {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.855628 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.855797 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.855925 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.856013 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.856086 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] federation.caching = True {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.856261 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.856342 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.856499 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.856585 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] federation.driver = sql {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.856754 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.856835 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.856993 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.857071 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.857250 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.857337 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.857487 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.857565 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.857736 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.857822 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.858040 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] identity.caching = True {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.858131 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.858230 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.858310 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.858477 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.858561 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.858712 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.858869 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.858946 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.859017 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] identity.caching = True {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.859183 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] identity.driver = sql {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.859263 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.859414 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.859501 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.859651 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.859729 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.859891 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.859977 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.860138 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.860217 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] identity.driver = sql {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.860370 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.860448 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.860598 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.860676 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.860827 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.860908 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.861071 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.861151 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.861316 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.861394 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.861549 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.861629 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.861786 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.861865 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.862069 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.862148 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.862321 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.862402 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.862572 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.862649 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.862808 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.862886 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.863039 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.863126 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.863275 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.863354 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.863505 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.863583 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.863737 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.863817 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.863977 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.864061 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.864215 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.864294 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.864461 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.864542 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.864691 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.864770 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.864935 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.865013 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.865753 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.865842 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.866016 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.866098 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.866264 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.866344 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.866511 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.866592 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.866756 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.866879 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.866986 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.867083 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.867218 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] ldap.password = **** {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.867301 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.867456 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.867537 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.867694 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.867780 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.867935 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.868017 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.868173 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.868253 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] ldap.password = **** {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.868409 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.868489 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.868649 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.868728 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.868894 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.868972 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.869121 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.869200 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.869350 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.869432 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.869597 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.869676 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.869842 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.869943 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.870097 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.870179 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.870330 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.870408 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.870562 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.870639 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.870792 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] ldap.user = None {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.870873 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.871032 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.871111 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.871273 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.871351 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.871508 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.871587 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.871739 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] ldap.user = None {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.871816 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.871984 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.872062 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.872227 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.872306 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.872470 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.872548 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.872697 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.872788 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.872930 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.873010 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.873165 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.873243 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.873399 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.873486 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.873628 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.873708 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.873916 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.873999 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.874137 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.874228 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.874378 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.874456 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.874610 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.874687 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.874852 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.874938 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.875082 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.875162 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.875325 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.875405 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.875559 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.875646 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.875792 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.875872 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.876027 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.876107 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.876258 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.876345 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.876502 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.876579 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.876741 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.876819 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.876980 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.877066 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.877216 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.877294 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] policy.driver = sql {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.877451 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.877529 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.877696 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.877783 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.877955 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.878039 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.878192 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] receipt.caching = True {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.878271 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] policy.driver = sql {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.878429 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.878524 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.878677 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.878756 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.878917 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.878998 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.879148 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.879236 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] receipt.caching = True {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.879382 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.879460 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.879619 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] resource.caching = True {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.879697 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.880118 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.880209 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.880355 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.880435 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] resource.driver = sql {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.880587 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.880665 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.880854 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] resource.caching = True {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.880947 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.881100 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.881178 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.881334 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] revoke.caching = True {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.881413 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] resource.driver = sql {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.881573 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.881659 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.881807 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.881901 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.882075 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] role.cache_time = None {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.882159 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.882309 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] role.caching = True {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.882471 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] revoke.caching = True {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.882548 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] role.driver = sql {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.882619 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.882770 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] role.list_limit = None {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.882850 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.883017 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.883105 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] role.cache_time = None {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.883254 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] role.caching = True {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.883332 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.883498 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.883575 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] role.driver = sql {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.883730 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] role.list_limit = None {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.883823 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.883976 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.884056 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.884222 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.884301 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.884466 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.884554 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.884712 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.884792 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.884942 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.885021 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.885187 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.885268 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.885431 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.885510 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.885676 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.885778 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.885942 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.886114 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.886333 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.886413 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.886573 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.886652 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.886828 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.886909 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.887075 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.887154 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.887321 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.887471 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.887559 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.887715 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.887795 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.887970 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.888049 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.888225 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.888313 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.888479 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.888558 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.888719 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.888796 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.888949 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.889036 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.889181 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.889261 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.889451 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.889529 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.889695 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.889782 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.889961 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.890045 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.890202 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.890281 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.890441 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.890531 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.890691 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] token.cache_time = None {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.890769 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.890925 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] token.caching = True {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.891004 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.891163 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.891243 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.891411 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] token.provider = fernet {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.891490 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.891647 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.891726 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.891882 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] token.cache_time = None {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.891961 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.892124 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] token.caching = True {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.892203 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.892363 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.892441 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.892607 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.892688 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] token.provider = fernet {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.892850 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.892929 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.893096 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] trust.driver = sql {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.893174 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.893332 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.893412 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.893571 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.893650 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.893805 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.893909 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.894073 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.894155 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.894323 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.894402 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] trust.driver = sql {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.894555 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.894634 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.894795 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.894874 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.895035 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.895114 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.895285 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.895364 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] database.connection = **** {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.895531 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.895677 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.895760 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.895832 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.896001 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.896079 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.896240 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.896364 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.896511 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.896590 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] database.connection = **** {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.896754 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.896833 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.896992 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.897074 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.897229 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.897307 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.897473 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.897551 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.897734 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.897813 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.897998 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.898090 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.898234 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.898314 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.898472 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.898549 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.898705 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.898785 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.898949 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.899028 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.899180 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.899258 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.899418 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.899510 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.899652 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.899731 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.899824 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=85204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 12 16:36:27.899903 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.900141 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.900377 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.900622 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.900863 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:36:27.901036 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=85205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 12 16:36:27.929642 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=85204) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 16:36:27.929840 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=85205) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 16:36:27.929966 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=85204) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 16:36:27.930111 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=85205) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 16:36:27.930196 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=85204) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 16:36:27.930344 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=85205) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 16:36:27.939870 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=85204) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 16:36:27.940113 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=85205) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 16:36:27.968030 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=85204) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 16:36:27.968261 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=85204) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 16:36:27.968599 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=85205) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 16:36:27.968841 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=85205) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 16:36:28.022153 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=85205) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 16:36:28.022564 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=85204) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 16:36:28.161286 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=85204) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 16:36:28.161489 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=85205) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 16:36:28.161563 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=85204) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 16:36:28.161659 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=85205) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 16:36:28.226353 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=85204) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 16:36:28.226517 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=85205) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 16:36:28.226605 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=85204) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 16:36:28.226756 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=85205) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 16:36:28.226857 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=85204) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 16:36:28.226987 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=85205) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 16:36:28.227070 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=85204) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 16:36:28.227201 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=85204) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 16:36:28.227282 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=85205) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 16:36:28.227416 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=85204) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 16:36:28.227507 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=85205) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 16:36:28.227635 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=85205) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 16:36:28.251038 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=85204) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 16:36:28.251257 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=85205) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 16:36:28.251348 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=85204) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 16:36:28.251491 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=85204) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 16:36:28.251576 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=85205) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 16:36:28.251721 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=85204) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 16:36:28.251805 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=85205) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 16:36:28.251946 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=85204) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 16:36:28.252038 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=85205) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 16:36:28.252166 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=85204) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 16:36:28.252250 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=85205) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 16:36:28.252384 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=85205) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 16:36:28.252464 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=85204) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 16:36:28.252605 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=85205) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 16:36:28.264187 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=85204) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 16:36:28.264499 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=85205) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 16:36:28.277209 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=85204) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 16:36:28.277391 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=85204) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 16:36:28.277620 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=85204) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 16:36:28.277714 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=85205) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 16:36:28.277847 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=85204) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 16:36:28.277962 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=85205) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 16:36:28.278097 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=85204) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 16:36:28.278180 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=85205) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 16:36:28.278314 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=85204) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 16:36:28.278398 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=85205) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 16:36:28.278528 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=85204) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 16:36:28.278612 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=85205) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 16:36:28.278787 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=85205) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 16:36:28.279007 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=85205) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 16:36:28.295997 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=85204) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:36:28.296207 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=85204) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 12 16:36:28.296362 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=85205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:36:28.296544 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=85204) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:36:28.296627 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=85205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 12 16:36:28.296747 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=85204) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 12 16:36:28.296906 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=85205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:36:28.297015 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=85204) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:36:28.297098 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=85205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 12 16:36:28.297278 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=85204) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:36:28.297379 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=85205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:36:28.297536 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=85204) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:36:28.297644 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=85205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:36:28.297794 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=85204) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:36:28.297931 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=85205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:36:28.298194 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=85205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:36:28.308280 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=85204) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:36:28.308555 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=85204) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:36:28.308749 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=85205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:36:28.308834 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=85204) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:36:28.309031 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=85205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:36:28.309115 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=85204) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:36:28.309308 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=85205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:36:28.309593 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=85205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:36:28.319336 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=85204) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 16:36:28.319935 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=85205) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 16:36:28.322557 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=85204) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 16:36:28.322838 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=85204) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:36:28.323120 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=85204) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:36:28.323203 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=85205) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 16:36:28.323402 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=85204) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:36:28.323486 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=85205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:36:28.323681 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=85204) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:36:28.323763 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=85205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:36:28.323937 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=85204) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:36:28.324021 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=85205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:36:28.324201 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=85204) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:36:28.324293 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=85205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:36:28.324469 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=85204) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:36:28.324550 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=85205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:36:28.324735 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=85204) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:36:28.324816 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=85205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:36:28.325003 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=85204) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:36:28.325093 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=85205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:36:28.325265 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=85204) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:36:28.325347 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=85205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:36:28.325570 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=85205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:36:28.325840 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=85205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:36:28.351580 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=85204) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:36:28.352257 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=85205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:36:28.353136 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=85204) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 16:36:28.353413 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=85204) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:36:28.353840 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=85205) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 16:36:28.354149 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=85205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:36:28.358563 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=85204) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 16:36:28.358841 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=85204) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:36:28.359122 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=85204) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:36:28.359452 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=85205) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 16:36:28.359734 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=85205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:36:28.360019 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=85205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:36:28.366363 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=85204) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 16:36:28.366647 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=85204) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:36:28.367185 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=85205) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 16:36:28.367471 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=85205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:36:28.370990 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=85204) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 16:36:28.371274 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=85204) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:36:28.371555 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=85204) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:36:28.371834 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=85204) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:36:28.371917 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=85205) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 16:36:28.372105 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=85204) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:36:28.372189 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=85205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:36:28.372374 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=85204) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:36:28.372458 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=85205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:36:28.372643 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=85204) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:36:28.372727 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=85205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:36:28.372907 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=85204) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:36:28.372989 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=85205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:36:28.373212 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=85205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:36:28.373487 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=85205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:36:28.373759 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=85205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:36:28.391910 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=85204) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:36:28.392183 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=85204) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:36:28.393136 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=85205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:36:28.393417 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=85205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:36:28.397265 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=85204) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 16:36:28.398607 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=85205) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 16:36:28.400827 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=85204) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:36:28.401118 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=85204) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:36:28.402333 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=85205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:36:28.402632 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=85205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:36:28.406194 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=85204) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 16:36:28.407563 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=85205) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 16:36:28.409686 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=85204) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 16:36:28.411135 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=85205) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 16:36:28.413249 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=85204) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:36:28.413544 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=85204) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:36:28.413827 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=85204) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:36:28.414140 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=85204) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:36:28.414418 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=85204) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:36:28.414704 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=85204) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:36:28.414801 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=85205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:36:28.415035 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=85205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:36:28.415327 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=85205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:36:28.415613 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=85205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:36:28.415894 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=85205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:36:28.416191 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=85205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:36:28.433328 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=85204) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 16:36:28.433609 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=85204) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:36:28.433892 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=85204) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:36:28.434226 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=85204) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:36:28.435009 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=85205) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 16:36:28.435299 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=85205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:36:28.435569 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=85205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:36:28.435836 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=85205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:36:28.441865 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=85204) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:36:28.444047 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=85204) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:36:28.444221 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=85205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:36:28.444329 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=85204) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:36:28.445977 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=85205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:36:28.446261 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=85205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:36:28.447457 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=85204) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 16:36:28.447739 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=85204) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:36:28.448026 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=85204) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:36:28.448314 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=85204) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:36:28.448592 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=85204) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:36:28.449375 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=85205) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 16:36:28.449660 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=85205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:36:28.449982 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=85205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:36:28.450288 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=85205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:36:28.450568 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=85205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:36:28.462120 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=85204) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 16:36:28.462401 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=85204) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:36:28.462681 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=85204) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:36:28.462960 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=85204) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:36:28.463239 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=85204) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:36:28.463514 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=85204) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:36:28.463789 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=85204) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:36:28.464092 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=85205) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 16:36:28.464376 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=85205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:36:28.464659 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=85205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:36:28.465046 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=85205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:36:28.465340 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=85205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:36:28.465623 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=85205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:36:28.465931 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=85205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:36:28.481168 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=85204) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 16:36:28.483402 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=85205) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 16:36:28.484354 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=85204) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 16:36:28.486609 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=85205) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 16:36:28.487567 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=85204) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:36:28.489124 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=85204) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:36:28.489850 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=85205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:36:28.490889 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=85204) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 16:36:28.491235 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=85204) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:36:28.491470 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=85204) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:36:28.491647 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=85205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:36:28.493232 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=85205) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 16:36:28.493636 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=85205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:36:28.494000 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=85205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:36:28.498827 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=85204) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:36:28.500392 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=85204) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 16:36:28.501117 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=85205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:36:28.502717 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=85205) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 16:36:28.503548 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=85204) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:36:28.503837 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=85204) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:36:28.504116 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=85204) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:36:28.504396 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=85204) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:36:28.506799 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=85205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:36:28.507104 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=85205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:36:28.507393 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=85205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:36:28.507684 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=85205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:36:28.514167 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=85204) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 16:36:28.514460 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=85204) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:36:28.514740 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=85204) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:36:28.516647 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=85205) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 16:36:28.516938 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=85205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:36:28.517221 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=85205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:36:28.522889 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=85204) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 16:36:28.523167 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=85204) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:36:28.523452 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=85204) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:36:28.523728 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=85204) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:36:28.524013 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=85204) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:36:28.524290 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=85204) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:36:28.524560 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=85204) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:36:28.524837 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=85204) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:36:28.525203 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=85204) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:36:28.525442 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=85205) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 16:36:28.525568 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=85204) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:36:28.525724 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=85205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:36:28.525849 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=85204) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:36:28.526034 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=85204) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:36:28.526136 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=85205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:36:28.526299 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=85204) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:36:28.526416 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=85205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:36:28.526567 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=85204) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:36:28.526702 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=85205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:36:28.526989 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=85205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:36:28.527308 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=85205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:36:28.527553 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=85205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:36:28.527829 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=85205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:36:28.528100 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=85205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:36:28.528389 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=85205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:36:28.528651 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=85205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:36:28.528916 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=85205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:36:28.529186 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=85205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:36:28.563541 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x560fd36fa9c0 pid: 85204 (default app) Oct 12 16:36:28.566261 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x560fd36fa9c0 pid: 85205 (default app) Oct 12 16:36:28.567735 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a253c28a-2d4e-4d34-9fa3-77f4c27274f2 None None] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:28.568020 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a253c28a-2d4e-4d34-9fa3-77f4c27274f2 None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:28.568817 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a253c28a-2d4e-4d34-9fa3-77f4c27274f2 None None] PATH_INFO: `/v3` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:28.573053 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1/1] 10.222.0.58 () {50 vars in 791 bytes} [Tue Oct 12 16:36:28 2021] GET /identity/v3/ => generated 255 bytes in 9 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:36:36.181964 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3412be36-15fd-4594-9e66-d8e8d4ee4321 None None] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:36.182503 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3412be36-15fd-4594-9e66-d8e8d4ee4321 None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:36.182503 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3412be36-15fd-4594-9e66-d8e8d4ee4321 None None] PATH_INFO: `/` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:36.187558 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1/2] 10.222.0.58 () {54 vars in 926 bytes} [Tue Oct 12 16:36:36 2021] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 12 16:36:36.193549 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152398f1-1795-4caa-830d-6286544883dd None None] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:36.193991 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152398f1-1795-4caa-830d-6286544883dd None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:36.194144 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152398f1-1795-4caa-830d-6286544883dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:36.224090 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG oslo_db.sqlalchemy.engines [None req-152398f1-1795-4caa-830d-6286544883dd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85204) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 12 16:36:36.413435 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG passlib.handlers.bcrypt [None req-152398f1-1795-4caa-830d-6286544883dd None None] detected 'bcrypt' backend, version '3.2.0' {{(pid=85204) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Oct 12 16:36:36.413849 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG passlib.handlers.bcrypt [None req-152398f1-1795-4caa-830d-6286544883dd None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=85204) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Oct 12 16:36:36.468785 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.auth.core [None req-152398f1-1795-4caa-830d-6286544883dd None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:36:36.470362 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-152398f1-1795-4caa-830d-6286544883dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:36:36.600170 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 2/3] 10.222.0.58 () {58 vars in 1023 bytes} [Tue Oct 12 16:36:36 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 408 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:36:36.724131 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3412be36-15fd-4594-9e66-d8e8d4ee4321 None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:36.758679 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG oslo_db.sqlalchemy.engines [None req-3412be36-15fd-4594-9e66-d8e8d4ee4321 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85205) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 12 16:36:36.884024 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3412be36-15fd-4594-9e66-d8e8d4ee4321 None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:36.888268 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff936459-c065-4391-a458-61965d296b36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:36.888923 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff936459-c065-4391-a458-61965d296b36 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:36.889208 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff936459-c065-4391-a458-61965d296b36 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:36.889485 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff936459-c065-4391-a458-61965d296b36 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:36.897322 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff936459-c065-4391-a458-61965d296b36 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:36.948211 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: WARNING keystone.common.rbac_enforcer.enforcer [None req-ff936459-c065-4391-a458-61965d296b36 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Oct 12 16:36:36.948552 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff936459-c065-4391-a458-61965d296b36 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:36.957565 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 2/4] 10.222.0.58 () {58 vars in 1324 bytes} [Tue Oct 12 16:36:36 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:36:36.966167 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152398f1-1795-4caa-830d-6286544883dd None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:36.980699 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152398f1-1795-4caa-830d-6286544883dd None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:36.985237 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee999dfb-0baa-4b87-a6d2-376b5be2f89c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:36.986371 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee999dfb-0baa-4b87-a6d2-376b5be2f89c admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:36.986655 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee999dfb-0baa-4b87-a6d2-376b5be2f89c admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:36.986931 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee999dfb-0baa-4b87-a6d2-376b5be2f89c admin admin] PATH_INFO: `/v3/projects/7ce3537317ae47bda54936a55a7d765e` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:36.988423 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee999dfb-0baa-4b87-a6d2-376b5be2f89c admin admin] RBAC: Authorizing `identity:get_project(project_id=7ce3537317ae47bda54936a55a7d765e)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:37.037414 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: WARNING keystone.common.rbac_enforcer.enforcer [None req-ee999dfb-0baa-4b87-a6d2-376b5be2f89c admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Oct 12 16:36:37.037759 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee999dfb-0baa-4b87-a6d2-376b5be2f89c admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:37.043233 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 3/5] 10.222.0.58 () {56 vars in 1207 bytes} [Tue Oct 12 16:36:36 2021] GET /identity/v3/projects/7ce3537317ae47bda54936a55a7d765e => generated 344 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 16:36:39.250483 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d27e23-50f9-4f55-a407-c512938c2cc2 None None] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:39.251089 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d27e23-50f9-4f55-a407-c512938c2cc2 None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:39.251089 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d27e23-50f9-4f55-a407-c512938c2cc2 None None] PATH_INFO: `/` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:39.255603 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 3/6] 10.222.0.58 () {54 vars in 926 bytes} [Tue Oct 12 16:36:39 2021] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:36:39.262435 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfa2259-63d6-4c62-86cf-c0048d896607 None None] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:39.262822 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfa2259-63d6-4c62-86cf-c0048d896607 None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:39.262997 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfa2259-63d6-4c62-86cf-c0048d896607 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:39.283014 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.auth.core [None req-3bfa2259-63d6-4c62-86cf-c0048d896607 None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:36:39.284566 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-3bfa2259-63d6-4c62-86cf-c0048d896607 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:36:39.292386 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 4/7] 10.222.0.58 () {58 vars in 1023 bytes} [Tue Oct 12 16:36:39 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:36:39.315454 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d27e23-50f9-4f55-a407-c512938c2cc2 None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:39.328004 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d27e23-50f9-4f55-a407-c512938c2cc2 None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:39.332260 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef54ed0-0aba-4abf-908c-8f2a6fd7f11b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:39.332881 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef54ed0-0aba-4abf-908c-8f2a6fd7f11b admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:39.333167 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef54ed0-0aba-4abf-908c-8f2a6fd7f11b admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:39.333448 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef54ed0-0aba-4abf-908c-8f2a6fd7f11b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:39.340947 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef54ed0-0aba-4abf-908c-8f2a6fd7f11b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:39.342730 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef54ed0-0aba-4abf-908c-8f2a6fd7f11b admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:39.351213 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 4/8] 10.222.0.58 () {58 vars in 1324 bytes} [Tue Oct 12 16:36:39 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:36:39.356751 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfa2259-63d6-4c62-86cf-c0048d896607 None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:39.365705 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfa2259-63d6-4c62-86cf-c0048d896607 None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:39.370598 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7d511b-ecc7-4fed-a6c7-31f0e8b26d21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:39.371445 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7d511b-ecc7-4fed-a6c7-31f0e8b26d21 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:39.371737 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7d511b-ecc7-4fed-a6c7-31f0e8b26d21 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:39.372015 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7d511b-ecc7-4fed-a6c7-31f0e8b26d21 admin admin] PATH_INFO: `/v3/users/296f95d6453b448dad63081ef9a200d3` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:39.373415 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7d511b-ecc7-4fed-a6c7-31f0e8b26d21 admin admin] RBAC: Authorizing `identity:get_user(user_id=296f95d6453b448dad63081ef9a200d3)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:39.375267 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7d511b-ecc7-4fed-a6c7-31f0e8b26d21 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:39.377090 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 5/9] 10.222.0.58 () {56 vars in 1198 bytes} [Tue Oct 12 16:36:39 2021] GET /identity/v3/users/296f95d6453b448dad63081ef9a200d3 => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:36:41.678463 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4149e91-bb8e-4d1d-80f1-1fbc6eed00c2 None None] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:41.678975 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4149e91-bb8e-4d1d-80f1-1fbc6eed00c2 None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:41.679073 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4149e91-bb8e-4d1d-80f1-1fbc6eed00c2 None None] PATH_INFO: `/` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:41.680795 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 5/10] 10.222.0.58 () {54 vars in 926 bytes} [Tue Oct 12 16:36:41 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:36:41.682746 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da21f8fb-be28-44c4-9c73-97218366151f None None] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:41.683153 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da21f8fb-be28-44c4-9c73-97218366151f None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:41.683295 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da21f8fb-be28-44c4-9c73-97218366151f None None] PATH_INFO: `/` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:41.685378 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 6/11] 10.222.0.58 () {54 vars in 926 bytes} [Tue Oct 12 16:36:41 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 12 16:36:41.686600 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fbf790-48a7-456f-bb15-f9e873d69e8e None None] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:41.686888 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fbf790-48a7-456f-bb15-f9e873d69e8e None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:41.687167 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fbf790-48a7-456f-bb15-f9e873d69e8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:41.691106 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd62d1b-2909-4839-9d1e-47364074b29d None None] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:41.691395 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd62d1b-2909-4839-9d1e-47364074b29d None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:41.691674 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd62d1b-2909-4839-9d1e-47364074b29d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:41.708541 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.auth.core [None req-9dd62d1b-2909-4839-9d1e-47364074b29d None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:36:41.709731 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-9dd62d1b-2909-4839-9d1e-47364074b29d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:36:41.717676 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 7/12] 10.222.0.58 () {58 vars in 1023 bytes} [Tue Oct 12 16:36:41 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:36:41.728204 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG passlib.handlers.bcrypt [None req-22fbf790-48a7-456f-bb15-f9e873d69e8e None None] detected 'bcrypt' backend, version '3.2.0' {{(pid=85205) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Oct 12 16:36:41.728627 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG passlib.handlers.bcrypt [None req-22fbf790-48a7-456f-bb15-f9e873d69e8e None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=85205) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Oct 12 16:36:41.740660 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd62d1b-2909-4839-9d1e-47364074b29d None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:41.749477 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd62d1b-2909-4839-9d1e-47364074b29d None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:41.753771 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461c7b3f-c17d-4c5e-9ee5-0311200ec968 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:41.754431 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461c7b3f-c17d-4c5e-9ee5-0311200ec968 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:41.754714 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461c7b3f-c17d-4c5e-9ee5-0311200ec968 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:41.754990 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461c7b3f-c17d-4c5e-9ee5-0311200ec968 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:41.762742 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461c7b3f-c17d-4c5e-9ee5-0311200ec968 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:41.764495 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461c7b3f-c17d-4c5e-9ee5-0311200ec968 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:41.772922 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 8/13] 10.222.0.58 () {58 vars in 1324 bytes} [Tue Oct 12 16:36:41 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 12 16:36:41.775109 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.auth.core [None req-22fbf790-48a7-456f-bb15-f9e873d69e8e None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:36:41.776715 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-22fbf790-48a7-456f-bb15-f9e873d69e8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:36:41.779416 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461c7b3f-c17d-4c5e-9ee5-0311200ec968 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:41.787814 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461c7b3f-c17d-4c5e-9ee5-0311200ec968 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:41.792777 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852be825-904e-450f-8511-49e3a60cd4c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:41.793526 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852be825-904e-450f-8511-49e3a60cd4c3 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:41.793813 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852be825-904e-450f-8511-49e3a60cd4c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:41.794127 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852be825-904e-450f-8511-49e3a60cd4c3 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:41.795310 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852be825-904e-450f-8511-49e3a60cd4c3 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:41.796987 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852be825-904e-450f-8511-49e3a60cd4c3 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:41.798703 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 9/14] 10.222.0.58 () {56 vars in 1129 bytes} [Tue Oct 12 16:36:41 2021] GET /identity/v3/domains/default => generated 199 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 16:36:41.803892 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 6/15] 10.222.0.58 () {58 vars in 1023 bytes} [Tue Oct 12 16:36:41 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:36:41.828417 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852be825-904e-450f-8511-49e3a60cd4c3 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:41.839216 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852be825-904e-450f-8511-49e3a60cd4c3 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:41.843685 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac462173-6c8b-4a66-906e-018ed7c4436d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:41.844488 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac462173-6c8b-4a66-906e-018ed7c4436d admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:41.844778 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac462173-6c8b-4a66-906e-018ed7c4436d admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:41.845057 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac462173-6c8b-4a66-906e-018ed7c4436d admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:41.859728 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac462173-6c8b-4a66-906e-018ed7c4436d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 16:36:41.866788 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: WARNING keystone.server.flask.application [None req-ac462173-6c8b-4a66-906e-018ed7c4436d admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 16:36:41.868109 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 10/16] 10.222.0.58 () {56 vars in 1117 bytes} [Tue Oct 12 16:36:41 2021] GET /identity/v3/roles/admin => generated 83 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:36:41.874736 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fbf790-48a7-456f-bb15-f9e873d69e8e None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:41.884999 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fbf790-48a7-456f-bb15-f9e873d69e8e None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:41.889840 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47088c7-1fa7-4a84-8710-4957b698692c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:41.890901 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47088c7-1fa7-4a84-8710-4957b698692c admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:41.891455 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47088c7-1fa7-4a84-8710-4957b698692c admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:41.891736 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47088c7-1fa7-4a84-8710-4957b698692c admin admin] PATH_INFO: `/v3/roles` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:41.892668 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47088c7-1fa7-4a84-8710-4957b698692c admin admin] RBAC: Adding query filter params (name=admin) {{(pid=85205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:36:41.892974 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47088c7-1fa7-4a84-8710-4957b698692c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:41.894793 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: WARNING py.warnings [None req-c47088c7-1fa7-4a84-8710-4957b698692c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:list_roles failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 12 16:36:41.894793 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: warnings.warn(msg) Oct 12 16:36:41.894793 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: Oct 12 16:36:41.895698 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47088c7-1fa7-4a84-8710-4957b698692c admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:41.914252 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 7/17] 10.222.0.58 () {56 vars in 1120 bytes} [Tue Oct 12 16:36:41 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:36:41.921258 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac462173-6c8b-4a66-906e-018ed7c4436d admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:41.932377 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac462173-6c8b-4a66-906e-018ed7c4436d admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:41.936757 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c8808b-8b2c-43e5-ad9f-052d39b11751 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:41.937649 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c8808b-8b2c-43e5-ad9f-052d39b11751 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:41.937964 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c8808b-8b2c-43e5-ad9f-052d39b11751 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:41.938245 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c8808b-8b2c-43e5-ad9f-052d39b11751 admin admin] PATH_INFO: `/v3/users/296f95d6453b448dad63081ef9a200d3` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:41.939545 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c8808b-8b2c-43e5-ad9f-052d39b11751 admin admin] RBAC: Authorizing `identity:get_user(user_id=296f95d6453b448dad63081ef9a200d3)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:41.941414 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c8808b-8b2c-43e5-ad9f-052d39b11751 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:41.943334 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 11/18] 10.222.0.58 () {56 vars in 1198 bytes} [Tue Oct 12 16:36:41 2021] GET /identity/v3/users/296f95d6453b448dad63081ef9a200d3 => generated 247 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:36:41.950113 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47088c7-1fa7-4a84-8710-4957b698692c admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:41.960190 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47088c7-1fa7-4a84-8710-4957b698692c admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:41.965341 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3342cc18-dde2-4850-88ea-8a0d3946a276 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:41.966174 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3342cc18-dde2-4850-88ea-8a0d3946a276 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:41.966456 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3342cc18-dde2-4850-88ea-8a0d3946a276 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:41.966731 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3342cc18-dde2-4850-88ea-8a0d3946a276 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:41.968166 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3342cc18-dde2-4850-88ea-8a0d3946a276 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:41.970001 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3342cc18-dde2-4850-88ea-8a0d3946a276 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:41.971622 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 8/19] 10.222.0.58 () {56 vars in 1129 bytes} [Tue Oct 12 16:36:41 2021] GET /identity/v3/domains/default => generated 199 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 16:36:41.978104 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c8808b-8b2c-43e5-ad9f-052d39b11751 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:41.987891 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c8808b-8b2c-43e5-ad9f-052d39b11751 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:41.992995 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8d8887-44a9-4e49-bfbd-80ce7dba88fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:41.993665 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8d8887-44a9-4e49-bfbd-80ce7dba88fb admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:41.993982 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8d8887-44a9-4e49-bfbd-80ce7dba88fb admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:41.994264 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8d8887-44a9-4e49-bfbd-80ce7dba88fb admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:41.995131 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8d8887-44a9-4e49-bfbd-80ce7dba88fb admin admin] RBAC: Adding query filter params (role.id=610824e4f50f4fb8954610e98c1de784, scope.domain.id=default, user.id=296f95d6453b448dad63081ef9a200d3) {{(pid=85204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:36:41.995443 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8d8887-44a9-4e49-bfbd-80ce7dba88fb admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:41.997162 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: WARNING py.warnings [None req-1a8d8887-44a9-4e49-bfbd-80ce7dba88fb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:list_role_assignments failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 12 16:36:41.997162 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: warnings.warn(msg) Oct 12 16:36:41.997162 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: Oct 12 16:36:41.998364 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8d8887-44a9-4e49-bfbd-80ce7dba88fb admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:42.005455 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 12/20] 10.222.0.58 () {56 vars in 1343 bytes} [Tue Oct 12 16:36:41 2021] GET /identity/v3/role_assignments?user.id=296f95d6453b448dad63081ef9a200d3&scope.domain.id=default&role.id=610824e4f50f4fb8954610e98c1de784 => generated 233 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:36:44.462615 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc49abf-afcd-4cb8-85b0-75c8c732bb64 None None] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:44.463626 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc49abf-afcd-4cb8-85b0-75c8c732bb64 None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:44.464106 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc49abf-afcd-4cb8-85b0-75c8c732bb64 None None] PATH_INFO: `/` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:44.466346 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 9/21] 10.222.0.58 () {54 vars in 926 bytes} [Tue Oct 12 16:36:44 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:36:44.491530 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e81c43-d3ea-4b00-808c-55f1215b8ea1 None None] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:44.492045 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e81c43-d3ea-4b00-808c-55f1215b8ea1 None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:44.492126 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e81c43-d3ea-4b00-808c-55f1215b8ea1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:44.517095 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.auth.core [None req-19e81c43-d3ea-4b00-808c-55f1215b8ea1 None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:36:44.518805 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-19e81c43-d3ea-4b00-808c-55f1215b8ea1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:36:44.533784 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 13/22] 10.222.0.58 () {58 vars in 1023 bytes} [Tue Oct 12 16:36:44 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:36:44.564579 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc49abf-afcd-4cb8-85b0-75c8c732bb64 None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:44.578160 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc49abf-afcd-4cb8-85b0-75c8c732bb64 None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:44.582848 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b3feb2-caaa-4355-8e5a-81fa1756f622 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:44.583889 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b3feb2-caaa-4355-8e5a-81fa1756f622 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:44.584409 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b3feb2-caaa-4355-8e5a-81fa1756f622 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:44.584886 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b3feb2-caaa-4355-8e5a-81fa1756f622 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:44.602029 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e01114c-9dd2-400c-bdde-56a93ab8ef4b None None] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:44.602659 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e01114c-9dd2-400c-bdde-56a93ab8ef4b None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:44.603134 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e01114c-9dd2-400c-bdde-56a93ab8ef4b None None] PATH_INFO: `/` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:44.605339 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b3feb2-caaa-4355-8e5a-81fa1756f622 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:44.605553 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 14/23] 10.222.0.58 () {54 vars in 926 bytes} [Tue Oct 12 16:36:44 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:36:44.607206 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b3feb2-caaa-4355-8e5a-81fa1756f622 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:44.610739 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a6a8c8-15f4-40c6-a5a4-ae24b2d3a3f5 None None] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:44.611250 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a6a8c8-15f4-40c6-a5a4-ae24b2d3a3f5 None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:44.611747 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a6a8c8-15f4-40c6-a5a4-ae24b2d3a3f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:44.625900 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: WARNING keystone.server.flask.application [None req-e7b3feb2-caaa-4355-8e5a-81fa1756f622 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 16:36:44.626828 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 10/24] 10.222.0.58 () {56 vars in 1129 bytes} [Tue Oct 12 16:36:44 2021] GET /identity/v3/domains/Default => generated 87 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:36:44.633933 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b3feb2-caaa-4355-8e5a-81fa1756f622 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:44.636584 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.auth.core [None req-43a6a8c8-15f4-40c6-a5a4-ae24b2d3a3f5 None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:36:44.638029 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-43a6a8c8-15f4-40c6-a5a4-ae24b2d3a3f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:36:44.643677 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b3feb2-caaa-4355-8e5a-81fa1756f622 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:44.655935 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc50a394-3fc0-4189-b43e-38b4c5a40242 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:44.656610 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc50a394-3fc0-4189-b43e-38b4c5a40242 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:44.656896 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc50a394-3fc0-4189-b43e-38b4c5a40242 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:44.657174 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc50a394-3fc0-4189-b43e-38b4c5a40242 admin admin] PATH_INFO: `/v3/domains` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:44.657557 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 15/25] 10.222.0.58 () {58 vars in 1023 bytes} [Tue Oct 12 16:36:44 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:36:44.658242 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc50a394-3fc0-4189-b43e-38b4c5a40242 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:36:44.658560 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc50a394-3fc0-4189-b43e-38b4c5a40242 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:44.659571 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: WARNING py.warnings [None req-dc50a394-3fc0-4189-b43e-38b4c5a40242 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:list_domains failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 12 16:36:44.659571 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: warnings.warn(msg) Oct 12 16:36:44.659571 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: Oct 12 16:36:44.660469 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc50a394-3fc0-4189-b43e-38b4c5a40242 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:44.696739 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 11/26] 10.222.0.58 () {56 vars in 1130 bytes} [Tue Oct 12 16:36:44 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 16:36:44.703356 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a6a8c8-15f4-40c6-a5a4-ae24b2d3a3f5 None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:44.714073 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc50a394-3fc0-4189-b43e-38b4c5a40242 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:44.719956 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a6a8c8-15f4-40c6-a5a4-ae24b2d3a3f5 None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:44.724052 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc50a394-3fc0-4189-b43e-38b4c5a40242 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:44.725861 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7954a33-1c58-401b-b82b-516d9fc9caad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:44.726858 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7954a33-1c58-401b-b82b-516d9fc9caad admin admin] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:44.727389 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7954a33-1c58-401b-b82b-516d9fc9caad admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:44.727887 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7954a33-1c58-401b-b82b-516d9fc9caad admin admin] PATH_INFO: `/v3/projects` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:44.728873 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7954a33-1c58-401b-b82b-516d9fc9caad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:44.730182 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: WARNING py.warnings [None req-a7954a33-1c58-401b-b82b-516d9fc9caad admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:create_project failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 12 16:36:44.730182 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: warnings.warn(msg) Oct 12 16:36:44.730182 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: Oct 12 16:36:44.732404 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7954a33-1c58-401b-b82b-516d9fc9caad admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:44.742592 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3a55b3-54c7-4cdb-b449-40be83a87883 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:44.744161 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3a55b3-54c7-4cdb-b449-40be83a87883 admin admin] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:44.744658 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3a55b3-54c7-4cdb-b449-40be83a87883 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:44.745143 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3a55b3-54c7-4cdb-b449-40be83a87883 admin admin] PATH_INFO: `/v3/roles` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:44.746187 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3a55b3-54c7-4cdb-b449-40be83a87883 admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:44.747418 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: WARNING py.warnings [None req-ad3a55b3-54c7-4cdb-b449-40be83a87883 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:create_role failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 12 16:36:44.747418 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: warnings.warn(msg) Oct 12 16:36:44.747418 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: Oct 12 16:36:44.748662 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3a55b3-54c7-4cdb-b449-40be83a87883 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:44.946712 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 12/27] 10.222.0.58 () {60 vars in 1152 bytes} [Tue Oct 12 16:36:44 2021] POST /identity/v3/roles => generated 219 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:36:44.951704 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 16/28] 10.222.0.58 () {60 vars in 1162 bytes} [Tue Oct 12 16:36:44 2021] POST /identity/v3/projects => generated 301 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:36:44.953625 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6a317c-588e-454e-b60a-442500fcaa5d None None] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:44.954183 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6a317c-588e-454e-b60a-442500fcaa5d None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:44.954704 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6a317c-588e-454e-b60a-442500fcaa5d None None] PATH_INFO: `/` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:44.957234 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 17/29] 10.222.0.58 () {54 vars in 926 bytes} [Tue Oct 12 16:36:44 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:36:44.964482 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017ba1de-667e-4344-a159-f65b19318e14 None None] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:44.965111 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017ba1de-667e-4344-a159-f65b19318e14 None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:44.965599 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017ba1de-667e-4344-a159-f65b19318e14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:45.000584 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.auth.core [None req-017ba1de-667e-4344-a159-f65b19318e14 None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:36:45.002313 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-017ba1de-667e-4344-a159-f65b19318e14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:36:45.116832 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 13/30] 10.222.0.58 () {58 vars in 1023 bytes} [Tue Oct 12 16:36:44 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:36:45.149507 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14f904d-7f52-48b8-9a65-506fefd3e4a9 None None] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:45.150181 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14f904d-7f52-48b8-9a65-506fefd3e4a9 None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:45.150680 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14f904d-7f52-48b8-9a65-506fefd3e4a9 None None] PATH_INFO: `/` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:45.152721 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 18/31] 10.222.0.58 () {54 vars in 926 bytes} [Tue Oct 12 16:36:45 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:36:45.161973 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e355d2-91f4-498f-a3fd-336bdca4b2d6 None None] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:45.162322 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e355d2-91f4-498f-a3fd-336bdca4b2d6 None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:45.162689 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e355d2-91f4-498f-a3fd-336bdca4b2d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:45.180254 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14f904d-7f52-48b8-9a65-506fefd3e4a9 None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:45.190434 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.auth.core [None req-c2e355d2-91f4-498f-a3fd-336bdca4b2d6 None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:36:45.191695 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-c2e355d2-91f4-498f-a3fd-336bdca4b2d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:36:45.203676 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14f904d-7f52-48b8-9a65-506fefd3e4a9 None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:45.207217 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 14/32] 10.222.0.58 () {58 vars in 1023 bytes} [Tue Oct 12 16:36:45 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:36:45.220298 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30913103-1126-4dc5-a00b-f5b4fae322bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:45.220912 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30913103-1126-4dc5-a00b-f5b4fae322bb admin admin] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:45.221196 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30913103-1126-4dc5-a00b-f5b4fae322bb admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:45.221474 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30913103-1126-4dc5-a00b-f5b4fae322bb admin admin] PATH_INFO: `/v3/roles` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:45.222309 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30913103-1126-4dc5-a00b-f5b4fae322bb admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:45.223571 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: WARNING py.warnings [None req-30913103-1126-4dc5-a00b-f5b4fae322bb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:create_role failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 12 16:36:45.223571 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: warnings.warn(msg) Oct 12 16:36:45.223571 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: Oct 12 16:36:45.224496 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30913103-1126-4dc5-a00b-f5b4fae322bb admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:45.247957 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e355d2-91f4-498f-a3fd-336bdca4b2d6 None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:45.249832 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 19/33] 10.222.0.58 () {60 vars in 1152 bytes} [Tue Oct 12 16:36:45 2021] POST /identity/v3/roles => generated 225 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 16:36:45.262348 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e355d2-91f4-498f-a3fd-336bdca4b2d6 None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:45.270069 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7382c5-0921-42c3-82bc-11b852aa9af8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:45.271204 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7382c5-0921-42c3-82bc-11b852aa9af8 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:45.271645 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7382c5-0921-42c3-82bc-11b852aa9af8 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:45.272079 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7382c5-0921-42c3-82bc-11b852aa9af8 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:45.292072 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7382c5-0921-42c3-82bc-11b852aa9af8 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 16:36:45.304372 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: WARNING keystone.server.flask.application [None req-6d7382c5-0921-42c3-82bc-11b852aa9af8 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 16:36:45.306147 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 15/34] 10.222.0.58 () {56 vars in 1117 bytes} [Tue Oct 12 16:36:45 2021] GET /identity/v3/roles/admin => generated 83 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 16:36:45.312981 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30913103-1126-4dc5-a00b-f5b4fae322bb admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:45.328058 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30913103-1126-4dc5-a00b-f5b4fae322bb admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:45.340723 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914cafca-0bb9-47d3-a078-29d47a08e2ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:45.341428 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914cafca-0bb9-47d3-a078-29d47a08e2ff admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:45.341715 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914cafca-0bb9-47d3-a078-29d47a08e2ff admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:45.342078 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914cafca-0bb9-47d3-a078-29d47a08e2ff admin admin] PATH_INFO: `/v3/roles` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:45.342909 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914cafca-0bb9-47d3-a078-29d47a08e2ff admin admin] RBAC: Adding query filter params (name=admin) {{(pid=85204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:36:45.343225 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914cafca-0bb9-47d3-a078-29d47a08e2ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:45.344299 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: WARNING py.warnings [None req-914cafca-0bb9-47d3-a078-29d47a08e2ff admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:list_roles failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 12 16:36:45.344299 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: warnings.warn(msg) Oct 12 16:36:45.344299 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: Oct 12 16:36:45.345259 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914cafca-0bb9-47d3-a078-29d47a08e2ff admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:45.365915 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 20/35] 10.222.0.58 () {56 vars in 1120 bytes} [Tue Oct 12 16:36:45 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:36:45.372376 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7382c5-0921-42c3-82bc-11b852aa9af8 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:45.384938 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7382c5-0921-42c3-82bc-11b852aa9af8 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:45.395772 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b926e2-de95-4fd0-8f17-ad5f079d00c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:45.397010 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b926e2-de95-4fd0-8f17-ad5f079d00c9 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:45.397473 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b926e2-de95-4fd0-8f17-ad5f079d00c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:45.397968 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b926e2-de95-4fd0-8f17-ad5f079d00c9 admin admin] PATH_INFO: `/v3/users/296f95d6453b448dad63081ef9a200d3` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:45.402047 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b926e2-de95-4fd0-8f17-ad5f079d00c9 admin admin] RBAC: Authorizing `identity:get_user(user_id=296f95d6453b448dad63081ef9a200d3)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:45.404423 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b926e2-de95-4fd0-8f17-ad5f079d00c9 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:45.406530 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 16/36] 10.222.0.58 () {56 vars in 1198 bytes} [Tue Oct 12 16:36:45 2021] GET /identity/v3/users/296f95d6453b448dad63081ef9a200d3 => generated 247 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:36:45.412861 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914cafca-0bb9-47d3-a078-29d47a08e2ff admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:45.425043 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914cafca-0bb9-47d3-a078-29d47a08e2ff admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:45.432852 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59922ca9-37b7-4087-8fe4-bf0019b8c690 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:45.433672 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59922ca9-37b7-4087-8fe4-bf0019b8c690 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:45.434027 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59922ca9-37b7-4087-8fe4-bf0019b8c690 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:45.434314 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59922ca9-37b7-4087-8fe4-bf0019b8c690 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:45.435702 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59922ca9-37b7-4087-8fe4-bf0019b8c690 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:45.437475 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59922ca9-37b7-4087-8fe4-bf0019b8c690 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:45.439585 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 21/37] 10.222.0.58 () {56 vars in 1129 bytes} [Tue Oct 12 16:36:45 2021] GET /identity/v3/domains/default => generated 199 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:36:45.446075 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b926e2-de95-4fd0-8f17-ad5f079d00c9 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:45.462386 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b926e2-de95-4fd0-8f17-ad5f079d00c9 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:45.468225 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822e5d8f-3ec0-4a16-a81f-5f7e45b817bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:45.469944 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822e5d8f-3ec0-4a16-a81f-5f7e45b817bc admin admin] REQUEST_METHOD: `PUT` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:45.470491 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822e5d8f-3ec0-4a16-a81f-5f7e45b817bc admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:45.470971 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822e5d8f-3ec0-4a16-a81f-5f7e45b817bc admin admin] PATH_INFO: `/v3/domains/default/users/296f95d6453b448dad63081ef9a200d3/roles/610824e4f50f4fb8954610e98c1de784` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:45.473954 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822e5d8f-3ec0-4a16-a81f-5f7e45b817bc admin admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=296f95d6453b448dad63081ef9a200d3, role_id=610824e4f50f4fb8954610e98c1de784)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:45.475361 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: WARNING py.warnings [None req-822e5d8f-3ec0-4a16-a81f-5f7e45b817bc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:create_grant failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 12 16:36:45.475361 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: warnings.warn(msg) Oct 12 16:36:45.475361 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: Oct 12 16:36:45.478334 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822e5d8f-3ec0-4a16-a81f-5f7e45b817bc admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:45.501797 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 17/38] 10.222.0.58 () {58 vars in 1382 bytes} [Tue Oct 12 16:36:45 2021] PUT /identity/v3/domains/default/users/296f95d6453b448dad63081ef9a200d3/roles/610824e4f50f4fb8954610e98c1de784 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:36:46.080419 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad57069-6a7a-4922-bda3-21ffa5ca2941 None None] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:46.080911 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad57069-6a7a-4922-bda3-21ffa5ca2941 None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:46.080911 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad57069-6a7a-4922-bda3-21ffa5ca2941 None None] PATH_INFO: `/` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:46.082755 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 22/39] 10.222.0.58 () {54 vars in 926 bytes} [Tue Oct 12 16:36:46 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:36:46.088432 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0d5dca-9b78-41c4-9634-10dcc5ae6958 None None] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:46.088734 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0d5dca-9b78-41c4-9634-10dcc5ae6958 None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:46.089023 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0d5dca-9b78-41c4-9634-10dcc5ae6958 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:46.106389 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.auth.core [None req-2d0d5dca-9b78-41c4-9634-10dcc5ae6958 None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:36:46.107590 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-2d0d5dca-9b78-41c4-9634-10dcc5ae6958 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:36:46.163648 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 18/40] 10.222.0.58 () {58 vars in 1023 bytes} [Tue Oct 12 16:36:46 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:36:46.187425 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad57069-6a7a-4922-bda3-21ffa5ca2941 None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:46.199956 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad57069-6a7a-4922-bda3-21ffa5ca2941 None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:46.204235 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297823f4-584e-4d08-8d34-96412c4a60d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:46.204897 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297823f4-584e-4d08-8d34-96412c4a60d8 admin admin] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:46.205190 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297823f4-584e-4d08-8d34-96412c4a60d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:46.205471 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297823f4-584e-4d08-8d34-96412c4a60d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:46.206279 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297823f4-584e-4d08-8d34-96412c4a60d8 admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:46.207882 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297823f4-584e-4d08-8d34-96412c4a60d8 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:46.222942 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 23/41] 10.222.0.58 () {60 vars in 1152 bytes} [Tue Oct 12 16:36:46 2021] POST /identity/v3/roles => generated 223 bytes in 36 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:36:46.448010 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd92ae97-1137-4e1f-a0b3-7e1afa5fad8d None None] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:46.448309 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd92ae97-1137-4e1f-a0b3-7e1afa5fad8d None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:46.448591 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd92ae97-1137-4e1f-a0b3-7e1afa5fad8d None None] PATH_INFO: `/` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:46.450552 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 19/42] 10.222.0.58 () {54 vars in 926 bytes} [Tue Oct 12 16:36:46 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:36:46.456607 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0539738-0cc6-447e-b958-105c83a20a58 None None] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:46.456908 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0539738-0cc6-447e-b958-105c83a20a58 None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:46.457197 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0539738-0cc6-447e-b958-105c83a20a58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:46.475307 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.auth.core [None req-d0539738-0cc6-447e-b958-105c83a20a58 None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:36:46.476830 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-d0539738-0cc6-447e-b958-105c83a20a58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:36:46.485292 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 24/43] 10.222.0.58 () {58 vars in 1023 bytes} [Tue Oct 12 16:36:46 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:36:46.509901 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd92ae97-1137-4e1f-a0b3-7e1afa5fad8d None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:46.521789 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd92ae97-1137-4e1f-a0b3-7e1afa5fad8d None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:46.526025 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9e3226-315c-4623-98a3-e89fbda4b656 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:46.526792 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9e3226-315c-4623-98a3-e89fbda4b656 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:46.527077 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9e3226-315c-4623-98a3-e89fbda4b656 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:46.527353 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9e3226-315c-4623-98a3-e89fbda4b656 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:46.528563 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9e3226-315c-4623-98a3-e89fbda4b656 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:46.530323 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9e3226-315c-4623-98a3-e89fbda4b656 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:46.531878 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 20/44] 10.222.0.58 () {56 vars in 1129 bytes} [Tue Oct 12 16:36:46 2021] GET /identity/v3/domains/default => generated 199 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:36:46.537754 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0539738-0cc6-447e-b958-105c83a20a58 None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:46.547300 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0539738-0cc6-447e-b958-105c83a20a58 None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:46.551876 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81724d4-ae63-4160-9966-f79c0d944be7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:46.552537 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81724d4-ae63-4160-9966-f79c0d944be7 admin admin] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:46.552827 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81724d4-ae63-4160-9966-f79c0d944be7 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:46.553107 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81724d4-ae63-4160-9966-f79c0d944be7 admin admin] PATH_INFO: `/v3/projects` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:46.553848 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81724d4-ae63-4160-9966-f79c0d944be7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:46.556383 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81724d4-ae63-4160-9966-f79c0d944be7 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:46.581005 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 25/45] 10.222.0.58 () {60 vars in 1162 bytes} [Tue Oct 12 16:36:46 2021] POST /identity/v3/projects => generated 312 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 16:36:47.783328 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1509f9c-3410-4c0b-8e4c-983311f676ad None None] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:47.783852 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1509f9c-3410-4c0b-8e4c-983311f676ad None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:47.783935 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1509f9c-3410-4c0b-8e4c-983311f676ad None None] PATH_INFO: `/` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:47.785664 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 21/46] 10.222.0.58 () {54 vars in 926 bytes} [Tue Oct 12 16:36:47 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:36:47.791508 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4566d292-3c6a-4625-9c0b-1e59edb9201a None None] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:47.791899 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4566d292-3c6a-4625-9c0b-1e59edb9201a None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:47.792080 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4566d292-3c6a-4625-9c0b-1e59edb9201a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:47.810727 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.auth.core [None req-4566d292-3c6a-4625-9c0b-1e59edb9201a None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:36:47.811950 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-4566d292-3c6a-4625-9c0b-1e59edb9201a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:36:47.870927 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 26/47] 10.222.0.58 () {58 vars in 1023 bytes} [Tue Oct 12 16:36:47 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:36:47.894815 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1509f9c-3410-4c0b-8e4c-983311f676ad None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:47.906569 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1509f9c-3410-4c0b-8e4c-983311f676ad None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:47.910779 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc02a763-52b7-4e6c-be46-5f2d8cd4273d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:47.911549 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc02a763-52b7-4e6c-be46-5f2d8cd4273d admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:47.911832 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc02a763-52b7-4e6c-be46-5f2d8cd4273d admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:47.912108 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc02a763-52b7-4e6c-be46-5f2d8cd4273d admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:47.922406 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc02a763-52b7-4e6c-be46-5f2d8cd4273d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 16:36:47.929148 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: WARNING keystone.server.flask.application [None req-dc02a763-52b7-4e6c-be46-5f2d8cd4273d admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 16:36:47.930364 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 22/48] 10.222.0.58 () {56 vars in 1117 bytes} [Tue Oct 12 16:36:47 2021] GET /identity/v3/roles/admin => generated 83 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:36:47.937286 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4566d292-3c6a-4625-9c0b-1e59edb9201a None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:47.946239 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4566d292-3c6a-4625-9c0b-1e59edb9201a None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:47.950656 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c35d47-72fe-4851-94f4-d1ba62f9a1e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:47.951325 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c35d47-72fe-4851-94f4-d1ba62f9a1e7 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:47.951616 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c35d47-72fe-4851-94f4-d1ba62f9a1e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:47.951902 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c35d47-72fe-4851-94f4-d1ba62f9a1e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:47.952673 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c35d47-72fe-4851-94f4-d1ba62f9a1e7 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=85204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:36:47.952988 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c35d47-72fe-4851-94f4-d1ba62f9a1e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:47.954659 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c35d47-72fe-4851-94f4-d1ba62f9a1e7 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:47.962934 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 27/49] 10.222.0.58 () {56 vars in 1120 bytes} [Tue Oct 12 16:36:47 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:36:47.968852 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc02a763-52b7-4e6c-be46-5f2d8cd4273d admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:47.979543 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc02a763-52b7-4e6c-be46-5f2d8cd4273d admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:47.983899 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce123b7-7288-4e7c-84c2-200b10371b76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:47.984732 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce123b7-7288-4e7c-84c2-200b10371b76 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:47.985016 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce123b7-7288-4e7c-84c2-200b10371b76 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:47.985290 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce123b7-7288-4e7c-84c2-200b10371b76 admin admin] PATH_INFO: `/v3/users/296f95d6453b448dad63081ef9a200d3` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:47.986558 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce123b7-7288-4e7c-84c2-200b10371b76 admin admin] RBAC: Authorizing `identity:get_user(user_id=296f95d6453b448dad63081ef9a200d3)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:47.988370 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce123b7-7288-4e7c-84c2-200b10371b76 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:47.994904 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 23/50] 10.222.0.58 () {56 vars in 1198 bytes} [Tue Oct 12 16:36:47 2021] GET /identity/v3/users/296f95d6453b448dad63081ef9a200d3 => generated 247 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:36:47.996111 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c35d47-72fe-4851-94f4-d1ba62f9a1e7 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:48.005450 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c35d47-72fe-4851-94f4-d1ba62f9a1e7 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:48.009991 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666b9f55-8251-44a4-a2bd-325fab9df653 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:48.010748 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666b9f55-8251-44a4-a2bd-325fab9df653 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:48.011033 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666b9f55-8251-44a4-a2bd-325fab9df653 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:48.011310 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666b9f55-8251-44a4-a2bd-325fab9df653 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:48.012482 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666b9f55-8251-44a4-a2bd-325fab9df653 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:48.014177 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666b9f55-8251-44a4-a2bd-325fab9df653 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:48.015680 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 28/51] 10.222.0.58 () {56 vars in 1129 bytes} [Tue Oct 12 16:36:47 2021] GET /identity/v3/domains/default => generated 199 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:36:48.021318 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce123b7-7288-4e7c-84c2-200b10371b76 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:48.030537 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce123b7-7288-4e7c-84c2-200b10371b76 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:48.034866 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913f4242-918e-48cc-a474-66a1c549f2f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:48.035430 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913f4242-918e-48cc-a474-66a1c549f2f5 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:48.035714 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913f4242-918e-48cc-a474-66a1c549f2f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:48.035991 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913f4242-918e-48cc-a474-66a1c549f2f5 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:48.036820 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913f4242-918e-48cc-a474-66a1c549f2f5 admin admin] RBAC: Adding query filter params (role.id=610824e4f50f4fb8954610e98c1de784, scope.domain.id=default, user.id=296f95d6453b448dad63081ef9a200d3) {{(pid=85205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:36:48.037131 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913f4242-918e-48cc-a474-66a1c549f2f5 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:48.038123 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: WARNING py.warnings [None req-913f4242-918e-48cc-a474-66a1c549f2f5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:list_role_assignments failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 12 16:36:48.038123 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: warnings.warn(msg) Oct 12 16:36:48.038123 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: Oct 12 16:36:48.039249 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913f4242-918e-48cc-a474-66a1c549f2f5 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:48.046531 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 24/52] 10.222.0.58 () {56 vars in 1343 bytes} [Tue Oct 12 16:36:48 2021] GET /identity/v3/role_assignments?user.id=296f95d6453b448dad63081ef9a200d3&scope.domain.id=default&role.id=610824e4f50f4fb8954610e98c1de784 => generated 530 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 16:36:48.825282 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4429df-d41d-4c65-bd6b-53f760f72300 None None] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:48.825726 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4429df-d41d-4c65-bd6b-53f760f72300 None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:48.825834 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4429df-d41d-4c65-bd6b-53f760f72300 None None] PATH_INFO: `/` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:48.827643 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 29/53] 10.222.0.58 () {54 vars in 926 bytes} [Tue Oct 12 16:36:48 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:36:48.833516 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc30eeb9-66b8-482a-b55c-2bea018de118 None None] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:48.833927 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc30eeb9-66b8-482a-b55c-2bea018de118 None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:48.834095 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc30eeb9-66b8-482a-b55c-2bea018de118 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:48.851771 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.auth.core [None req-dc30eeb9-66b8-482a-b55c-2bea018de118 None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:36:48.852996 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-dc30eeb9-66b8-482a-b55c-2bea018de118 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:36:48.860356 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 25/54] 10.222.0.58 () {58 vars in 1023 bytes} [Tue Oct 12 16:36:48 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:36:48.883165 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4429df-d41d-4c65-bd6b-53f760f72300 None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:48.895747 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4429df-d41d-4c65-bd6b-53f760f72300 None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:48.900596 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd87e8aa-fe1c-4ee9-9643-a40bb3af0769 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:48.901363 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd87e8aa-fe1c-4ee9-9643-a40bb3af0769 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:48.901649 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd87e8aa-fe1c-4ee9-9643-a40bb3af0769 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:48.901960 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd87e8aa-fe1c-4ee9-9643-a40bb3af0769 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:48.903146 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd87e8aa-fe1c-4ee9-9643-a40bb3af0769 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:48.904843 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd87e8aa-fe1c-4ee9-9643-a40bb3af0769 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:48.906411 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 30/55] 10.222.0.58 () {56 vars in 1129 bytes} [Tue Oct 12 16:36:48 2021] GET /identity/v3/domains/default => generated 199 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:36:48.911752 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc30eeb9-66b8-482a-b55c-2bea018de118 None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:48.920202 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc30eeb9-66b8-482a-b55c-2bea018de118 None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:48.924532 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1121eca1-873b-479e-9a1d-3813aa370907 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:48.925156 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1121eca1-873b-479e-9a1d-3813aa370907 admin admin] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:48.925437 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1121eca1-873b-479e-9a1d-3813aa370907 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:48.925709 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1121eca1-873b-479e-9a1d-3813aa370907 admin admin] PATH_INFO: `/v3/projects` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:48.926466 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1121eca1-873b-479e-9a1d-3813aa370907 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:48.927459 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: WARNING py.warnings [None req-1121eca1-873b-479e-9a1d-3813aa370907 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:create_project failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 12 16:36:48.927459 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: warnings.warn(msg) Oct 12 16:36:48.927459 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: Oct 12 16:36:48.928657 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1121eca1-873b-479e-9a1d-3813aa370907 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:48.954541 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 26/56] 10.222.0.58 () {60 vars in 1161 bytes} [Tue Oct 12 16:36:48 2021] POST /identity/v3/projects => generated 298 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:36:51.175750 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e83c589-2ba7-4470-a9d9-9e12857ff1be None None] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:51.176258 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e83c589-2ba7-4470-a9d9-9e12857ff1be None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:51.176349 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e83c589-2ba7-4470-a9d9-9e12857ff1be None None] PATH_INFO: `/` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:51.178103 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 31/57] 10.222.0.58 () {54 vars in 926 bytes} [Tue Oct 12 16:36:51 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:36:51.184394 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1f6326-455a-4495-8fde-a8c044a9df49 None None] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:51.184818 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1f6326-455a-4495-8fde-a8c044a9df49 None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:51.184961 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1f6326-455a-4495-8fde-a8c044a9df49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:51.202905 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.auth.core [None req-5f1f6326-455a-4495-8fde-a8c044a9df49 None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:36:51.204108 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-5f1f6326-455a-4495-8fde-a8c044a9df49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:36:51.258205 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 27/58] 10.222.0.58 () {58 vars in 1023 bytes} [Tue Oct 12 16:36:51 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:36:51.284329 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e83c589-2ba7-4470-a9d9-9e12857ff1be None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:51.296235 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e83c589-2ba7-4470-a9d9-9e12857ff1be None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:51.300449 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e04d73-d802-4388-a6ff-adf4e313e42f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:51.301223 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e04d73-d802-4388-a6ff-adf4e313e42f admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:51.301516 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e04d73-d802-4388-a6ff-adf4e313e42f admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:51.301801 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e04d73-d802-4388-a6ff-adf4e313e42f admin admin] PATH_INFO: `/v3/domains/default` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:51.303037 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e04d73-d802-4388-a6ff-adf4e313e42f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:51.304729 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e04d73-d802-4388-a6ff-adf4e313e42f admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:51.306840 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 32/59] 10.222.0.58 () {56 vars in 1129 bytes} [Tue Oct 12 16:36:51 2021] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:36:51.312405 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1f6326-455a-4495-8fde-a8c044a9df49 None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:51.320974 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1f6326-455a-4495-8fde-a8c044a9df49 None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:51.325907 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae90b9f-7aee-4f72-bd34-b9b3b1bc2ff1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:51.326561 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae90b9f-7aee-4f72-bd34-b9b3b1bc2ff1 admin admin] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:51.326845 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae90b9f-7aee-4f72-bd34-b9b3b1bc2ff1 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:51.327121 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae90b9f-7aee-4f72-bd34-b9b3b1bc2ff1 admin admin] PATH_INFO: `/v3/users` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:51.327847 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae90b9f-7aee-4f72-bd34-b9b3b1bc2ff1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:51.328840 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: WARNING py.warnings [None req-eae90b9f-7aee-4f72-bd34-b9b3b1bc2ff1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:create_user failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 12 16:36:51.328840 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: warnings.warn(msg) Oct 12 16:36:51.328840 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: Oct 12 16:36:51.330307 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae90b9f-7aee-4f72-bd34-b9b3b1bc2ff1 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:51.355543 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 28/60] 10.222.0.58 () {60 vars in 1153 bytes} [Tue Oct 12 16:36:51 2021] POST /identity/v3/users => generated 275 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 16:36:54.839709 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c962a6-47dd-4f09-bb88-aaa20d735f22 None None] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:54.840209 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c962a6-47dd-4f09-bb88-aaa20d735f22 None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:54.840281 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c962a6-47dd-4f09-bb88-aaa20d735f22 None None] PATH_INFO: `/` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:54.842167 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 33/61] 10.222.0.58 () {54 vars in 926 bytes} [Tue Oct 12 16:36:54 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:36:54.858045 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39926b5b-9412-4270-910b-a4f1fe9abbb4 None None] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:54.858557 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39926b5b-9412-4270-910b-a4f1fe9abbb4 None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:54.858635 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39926b5b-9412-4270-910b-a4f1fe9abbb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:54.890333 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.auth.core [None req-39926b5b-9412-4270-910b-a4f1fe9abbb4 None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:36:54.891567 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-39926b5b-9412-4270-910b-a4f1fe9abbb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:36:54.906311 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 29/62] 10.222.0.58 () {58 vars in 1023 bytes} [Tue Oct 12 16:36:54 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:36:54.926595 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925ed499-fde8-42e4-a425-9ff74863f13e None None] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:54.926881 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925ed499-fde8-42e4-a425-9ff74863f13e None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:54.927160 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925ed499-fde8-42e4-a425-9ff74863f13e None None] PATH_INFO: `/` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:54.929176 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 34/63] 10.222.0.58 () {54 vars in 926 bytes} [Tue Oct 12 16:36:54 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:36:54.935298 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39926b5b-9412-4270-910b-a4f1fe9abbb4 None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:54.945402 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39926b5b-9412-4270-910b-a4f1fe9abbb4 None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:54.953826 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d62b72-d474-4c83-a0f9-a4822814a1f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:54.954691 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d62b72-d474-4c83-a0f9-a4822814a1f4 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:54.954976 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d62b72-d474-4c83-a0f9-a4822814a1f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:54.955252 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d62b72-d474-4c83-a0f9-a4822814a1f4 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:54.960005 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142e0fa3-68fb-4a3e-a225-d623554bfeb3 None None] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:54.960607 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142e0fa3-68fb-4a3e-a225-d623554bfeb3 None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:54.961092 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142e0fa3-68fb-4a3e-a225-d623554bfeb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:54.979039 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d62b72-d474-4c83-a0f9-a4822814a1f4 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 16:36:54.980532 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.auth.core [None req-142e0fa3-68fb-4a3e-a225-d623554bfeb3 None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:36:54.981985 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-142e0fa3-68fb-4a3e-a225-d623554bfeb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:36:54.990078 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: WARNING keystone.server.flask.application [None req-c0d62b72-d474-4c83-a0f9-a4822814a1f4 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 12 16:36:54.990078 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 30/64] 10.222.0.58 () {56 vars in 1135 bytes} [Tue Oct 12 16:36:54 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:36:54.995302 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d62b72-d474-4c83-a0f9-a4822814a1f4 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:55.003148 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 35/65] 10.222.0.58 () {58 vars in 1023 bytes} [Tue Oct 12 16:36:54 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:36:55.012921 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d62b72-d474-4c83-a0f9-a4822814a1f4 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:55.021207 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2354bfcd-7360-42df-a663-df90a9a9b8da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:55.021904 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2354bfcd-7360-42df-a663-df90a9a9b8da admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:55.022184 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2354bfcd-7360-42df-a663-df90a9a9b8da admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:55.022456 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2354bfcd-7360-42df-a663-df90a9a9b8da admin admin] PATH_INFO: `/v3/roles` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:55.023229 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2354bfcd-7360-42df-a663-df90a9a9b8da admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=85205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:36:55.023536 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2354bfcd-7360-42df-a663-df90a9a9b8da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:55.025156 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2354bfcd-7360-42df-a663-df90a9a9b8da admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:55.034852 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3845a6f-20c8-4c77-b8ab-d0584e68ca07 None None] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:55.035351 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3845a6f-20c8-4c77-b8ab-d0584e68ca07 None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:55.035783 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3845a6f-20c8-4c77-b8ab-d0584e68ca07 None None] PATH_INFO: `/` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:55.039052 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 36/66] 10.222.0.58 () {54 vars in 926 bytes} [Tue Oct 12 16:36:55 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 12 16:36:55.041907 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 31/67] 10.222.0.58 () {56 vars in 1132 bytes} [Tue Oct 12 16:36:54 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:36:55.044827 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0a1f1a-2dfd-407c-803b-3b7d40084693 None None] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:55.045287 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0a1f1a-2dfd-407c-803b-3b7d40084693 None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:55.045708 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0a1f1a-2dfd-407c-803b-3b7d40084693 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:55.048120 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2354bfcd-7360-42df-a663-df90a9a9b8da admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:55.061392 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2354bfcd-7360-42df-a663-df90a9a9b8da admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:55.066160 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75d2e38-4c62-4b01-91c5-75228d0689a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:55.066712 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75d2e38-4c62-4b01-91c5-75228d0689a3 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:55.066995 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75d2e38-4c62-4b01-91c5-75228d0689a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:55.067269 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75d2e38-4c62-4b01-91c5-75228d0689a3 admin admin] PATH_INFO: `/v3/users/3e3ad764755947d6af5bc63c40f75cda` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:55.073378 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.auth.core [None req-3a0a1f1a-2dfd-407c-803b-3b7d40084693 None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:36:55.075193 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-3a0a1f1a-2dfd-407c-803b-3b7d40084693 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:36:55.082604 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75d2e38-4c62-4b01-91c5-75228d0689a3 admin admin] RBAC: Authorizing `identity:get_user(user_id=3e3ad764755947d6af5bc63c40f75cda)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:55.084519 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 37/68] 10.222.0.58 () {58 vars in 1023 bytes} [Tue Oct 12 16:36:55 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:36:55.084721 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75d2e38-4c62-4b01-91c5-75228d0689a3 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:55.086856 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 32/69] 10.222.0.58 () {56 vars in 1198 bytes} [Tue Oct 12 16:36:55 2021] GET /identity/v3/users/3e3ad764755947d6af5bc63c40f75cda => generated 275 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 16:36:55.093413 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75d2e38-4c62-4b01-91c5-75228d0689a3 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:55.093552 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0a1f1a-2dfd-407c-803b-3b7d40084693 None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:55.103328 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75d2e38-4c62-4b01-91c5-75228d0689a3 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:55.103599 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0a1f1a-2dfd-407c-803b-3b7d40084693 None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:55.113041 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38004605-7cd1-4437-9b03-39b0199311ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:55.115488 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38004605-7cd1-4437-9b03-39b0199311ea admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:55.116418 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38004605-7cd1-4437-9b03-39b0199311ea admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:55.118133 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38004605-7cd1-4437-9b03-39b0199311ea admin admin] PATH_INFO: `/v3/roles/member` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:55.118870 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01884455-e649-4e03-bba8-21398bb51ed3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:55.119758 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01884455-e649-4e03-bba8-21398bb51ed3 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:55.120371 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01884455-e649-4e03-bba8-21398bb51ed3 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:55.120814 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01884455-e649-4e03-bba8-21398bb51ed3 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:55.129121 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01884455-e649-4e03-bba8-21398bb51ed3 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:55.130499 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38004605-7cd1-4437-9b03-39b0199311ea admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 16:36:55.131099 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01884455-e649-4e03-bba8-21398bb51ed3 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:55.137691 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: WARNING keystone.server.flask.application [None req-38004605-7cd1-4437-9b03-39b0199311ea admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 12 16:36:55.139109 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 38/70] 10.222.0.58 () {56 vars in 1120 bytes} [Tue Oct 12 16:36:55 2021] GET /identity/v3/roles/member => generated 84 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:36:55.140252 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981a2205-60eb-4172-b53a-64bc75fb2093 None None] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:55.140354 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 33/71] 10.222.0.58 () {58 vars in 1324 bytes} [Tue Oct 12 16:36:55 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 12 16:36:55.140506 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981a2205-60eb-4172-b53a-64bc75fb2093 None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:55.142293 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981a2205-60eb-4172-b53a-64bc75fb2093 None None] PATH_INFO: `/` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:55.142415 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01884455-e649-4e03-bba8-21398bb51ed3 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:55.145367 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 39/72] 10.222.0.58 () {54 vars in 926 bytes} [Tue Oct 12 16:36:55 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:36:55.147883 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981a2205-60eb-4172-b53a-64bc75fb2093 None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:55.156605 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01884455-e649-4e03-bba8-21398bb51ed3 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:55.160988 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f6b6f5-44e8-4cb5-b3b7-881979670bc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:55.161776 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f6b6f5-44e8-4cb5-b3b7-881979670bc5 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:55.162103 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f6b6f5-44e8-4cb5-b3b7-881979670bc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:55.162385 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f6b6f5-44e8-4cb5-b3b7-881979670bc5 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:55.164646 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981a2205-60eb-4172-b53a-64bc75fb2093 None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:55.169568 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c8f848-8590-44d6-b7e4-a9afa57c095c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:55.170243 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c8f848-8590-44d6-b7e4-a9afa57c095c admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:55.170528 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c8f848-8590-44d6-b7e4-a9afa57c095c admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:55.170797 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c8f848-8590-44d6-b7e4-a9afa57c095c admin admin] PATH_INFO: `/v3/roles` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:55.171557 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c8f848-8590-44d6-b7e4-a9afa57c095c admin admin] RBAC: Adding query filter params (name=member) {{(pid=85204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:36:55.171869 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c8f848-8590-44d6-b7e4-a9afa57c095c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:55.173214 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f6b6f5-44e8-4cb5-b3b7-881979670bc5 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 16:36:55.173468 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c8f848-8590-44d6-b7e4-a9afa57c095c admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:55.180051 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: WARNING keystone.server.flask.application [None req-10f6b6f5-44e8-4cb5-b3b7-881979670bc5 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 16:36:55.181389 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 34/73] 10.222.0.58 () {56 vars in 1117 bytes} [Tue Oct 12 16:36:55 2021] GET /identity/v3/roles/admin => generated 83 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:36:55.185999 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 40/74] 10.222.0.58 () {56 vars in 1122 bytes} [Tue Oct 12 16:36:55 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:36:55.185999 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130dd344-6f08-4c86-8575-a4da6a882a6e None None] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:55.185999 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130dd344-6f08-4c86-8575-a4da6a882a6e None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:55.185999 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130dd344-6f08-4c86-8575-a4da6a882a6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:55.187481 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f6b6f5-44e8-4cb5-b3b7-881979670bc5 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:55.198023 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f6b6f5-44e8-4cb5-b3b7-881979670bc5 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:55.203062 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02520c8b-3bb5-4069-ae23-a2a9ddc31739 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:55.204244 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02520c8b-3bb5-4069-ae23-a2a9ddc31739 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:55.204516 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.auth.core [None req-130dd344-6f08-4c86-8575-a4da6a882a6e None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:36:55.204907 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02520c8b-3bb5-4069-ae23-a2a9ddc31739 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:55.205398 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02520c8b-3bb5-4069-ae23-a2a9ddc31739 admin admin] PATH_INFO: `/v3/projects/78966be562ca4918a5e25eac86ccd8ab` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:55.205753 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-130dd344-6f08-4c86-8575-a4da6a882a6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:36:55.207151 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02520c8b-3bb5-4069-ae23-a2a9ddc31739 admin admin] RBAC: Authorizing `identity:get_project(project_id=78966be562ca4918a5e25eac86ccd8ab)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:55.209657 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02520c8b-3bb5-4069-ae23-a2a9ddc31739 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:55.212216 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 35/75] 10.222.0.58 () {56 vars in 1207 bytes} [Tue Oct 12 16:36:55 2021] GET /identity/v3/projects/78966be562ca4918a5e25eac86ccd8ab => generated 298 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:36:55.213865 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02520c8b-3bb5-4069-ae23-a2a9ddc31739 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:55.219564 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 41/76] 10.222.0.58 () {58 vars in 1023 bytes} [Tue Oct 12 16:36:55 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:36:55.220793 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130dd344-6f08-4c86-8575-a4da6a882a6e None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:55.229372 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02520c8b-3bb5-4069-ae23-a2a9ddc31739 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:55.232008 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130dd344-6f08-4c86-8575-a4da6a882a6e None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:55.234130 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e1d75f-83fb-4289-a4b7-a1fbd5443775 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:55.234800 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e1d75f-83fb-4289-a4b7-a1fbd5443775 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:55.235093 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e1d75f-83fb-4289-a4b7-a1fbd5443775 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:55.235397 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e1d75f-83fb-4289-a4b7-a1fbd5443775 admin admin] PATH_INFO: `/v3/roles` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:55.236238 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e1d75f-83fb-4289-a4b7-a1fbd5443775 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=85205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:36:55.236549 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e1d75f-83fb-4289-a4b7-a1fbd5443775 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:55.237987 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8d04d8-62c5-43fc-a731-341d92150b77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:55.238297 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e1d75f-83fb-4289-a4b7-a1fbd5443775 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:55.239208 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8d04d8-62c5-43fc-a731-341d92150b77 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:55.239848 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8d04d8-62c5-43fc-a731-341d92150b77 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:55.240311 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8d04d8-62c5-43fc-a731-341d92150b77 admin admin] PATH_INFO: `/v3/users/3e3ad764755947d6af5bc63c40f75cda` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:55.242064 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8d04d8-62c5-43fc-a731-341d92150b77 admin admin] RBAC: Authorizing `identity:get_user(user_id=3e3ad764755947d6af5bc63c40f75cda)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:55.245019 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8d04d8-62c5-43fc-a731-341d92150b77 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:55.247307 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 42/77] 10.222.0.58 () {56 vars in 1198 bytes} [Tue Oct 12 16:36:55 2021] GET /identity/v3/users/3e3ad764755947d6af5bc63c40f75cda => generated 275 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:36:55.247847 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 36/78] 10.222.0.58 () {56 vars in 1120 bytes} [Tue Oct 12 16:36:55 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:36:55.248500 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8d04d8-62c5-43fc-a731-341d92150b77 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:55.248816 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e1d75f-83fb-4289-a4b7-a1fbd5443775 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:55.258554 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e1d75f-83fb-4289-a4b7-a1fbd5443775 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:55.263321 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8d04d8-62c5-43fc-a731-341d92150b77 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:55.263554 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ad4494-14fa-4e0e-b993-d4a0f6f71a6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:55.264279 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ad4494-14fa-4e0e-b993-d4a0f6f71a6f admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:55.264566 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ad4494-14fa-4e0e-b993-d4a0f6f71a6f admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:55.264845 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ad4494-14fa-4e0e-b993-d4a0f6f71a6f admin admin] PATH_INFO: `/v3/roles/member` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:55.267743 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3a04fd-3a2b-4fb1-8f53-56b8e6eb54ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:55.268379 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3a04fd-3a2b-4fb1-8f53-56b8e6eb54ab admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:55.268663 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3a04fd-3a2b-4fb1-8f53-56b8e6eb54ab admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:55.268941 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3a04fd-3a2b-4fb1-8f53-56b8e6eb54ab admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:55.269847 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3a04fd-3a2b-4fb1-8f53-56b8e6eb54ab admin admin] RBAC: Adding query filter params (role.id=638eb220c5a346cb8cf0e7128f938c65, scope.project.id=78966be562ca4918a5e25eac86ccd8ab, user.id=3e3ad764755947d6af5bc63c40f75cda) {{(pid=85204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:36:55.270126 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3a04fd-3a2b-4fb1-8f53-56b8e6eb54ab admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:55.271979 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3a04fd-3a2b-4fb1-8f53-56b8e6eb54ab admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:55.274927 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ad4494-14fa-4e0e-b993-d4a0f6f71a6f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 16:36:55.277950 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 43/79] 10.222.0.58 () {56 vars in 1395 bytes} [Tue Oct 12 16:36:55 2021] GET /identity/v3/role_assignments?user.id=3e3ad764755947d6af5bc63c40f75cda&scope.project.id=78966be562ca4918a5e25eac86ccd8ab&role.id=638eb220c5a346cb8cf0e7128f938c65 => generated 259 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:36:55.279285 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3a04fd-3a2b-4fb1-8f53-56b8e6eb54ab admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:55.288103 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: WARNING keystone.server.flask.application [None req-64ad4494-14fa-4e0e-b993-d4a0f6f71a6f admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 12 16:36:55.289197 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3a04fd-3a2b-4fb1-8f53-56b8e6eb54ab admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:55.290491 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 37/80] 10.222.0.58 () {56 vars in 1120 bytes} [Tue Oct 12 16:36:55 2021] GET /identity/v3/roles/member => generated 84 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:36:55.292476 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ad4494-14fa-4e0e-b993-d4a0f6f71a6f admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:55.294575 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace931db-89ad-4942-89ef-0be38b30537c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:55.295240 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace931db-89ad-4942-89ef-0be38b30537c admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:55.295526 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace931db-89ad-4942-89ef-0be38b30537c admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:55.295806 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace931db-89ad-4942-89ef-0be38b30537c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:55.304487 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace931db-89ad-4942-89ef-0be38b30537c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:55.306333 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace931db-89ad-4942-89ef-0be38b30537c admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:55.306845 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ad4494-14fa-4e0e-b993-d4a0f6f71a6f admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:55.312916 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0abb24-0857-43e8-b3cb-5a8b41e9e103 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:55.314488 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0abb24-0857-43e8-b3cb-5a8b41e9e103 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:55.314993 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0abb24-0857-43e8-b3cb-5a8b41e9e103 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:55.315476 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0abb24-0857-43e8-b3cb-5a8b41e9e103 admin admin] PATH_INFO: `/v3/users/296f95d6453b448dad63081ef9a200d3` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:55.321377 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 44/81] 10.222.0.58 () {58 vars in 1324 bytes} [Tue Oct 12 16:36:55 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:36:55.321377 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace931db-89ad-4942-89ef-0be38b30537c admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:55.323273 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0abb24-0857-43e8-b3cb-5a8b41e9e103 admin admin] RBAC: Authorizing `identity:get_user(user_id=296f95d6453b448dad63081ef9a200d3)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:55.325304 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0abb24-0857-43e8-b3cb-5a8b41e9e103 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:55.327873 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 38/82] 10.222.0.58 () {56 vars in 1198 bytes} [Tue Oct 12 16:36:55 2021] GET /identity/v3/users/296f95d6453b448dad63081ef9a200d3 => generated 247 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:36:55.333941 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0abb24-0857-43e8-b3cb-5a8b41e9e103 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:55.337847 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace931db-89ad-4942-89ef-0be38b30537c admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:55.343184 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd67f5a7-e4b3-461c-8ad1-c8ddc3511847 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:55.343880 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd67f5a7-e4b3-461c-8ad1-c8ddc3511847 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:55.344170 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd67f5a7-e4b3-461c-8ad1-c8ddc3511847 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:55.344455 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd67f5a7-e4b3-461c-8ad1-c8ddc3511847 admin admin] PATH_INFO: `/v3/roles` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:55.345245 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd67f5a7-e4b3-461c-8ad1-c8ddc3511847 admin admin] RBAC: Adding query filter params (name=member) {{(pid=85204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:36:55.345564 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd67f5a7-e4b3-461c-8ad1-c8ddc3511847 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:55.345662 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0abb24-0857-43e8-b3cb-5a8b41e9e103 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:55.347257 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd67f5a7-e4b3-461c-8ad1-c8ddc3511847 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:55.350297 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a360224-5086-4c6a-9d35-ae841a81973e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:55.351184 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a360224-5086-4c6a-9d35-ae841a81973e admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:55.351471 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a360224-5086-4c6a-9d35-ae841a81973e admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:55.351752 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a360224-5086-4c6a-9d35-ae841a81973e admin admin] PATH_INFO: `/v3/projects/78966be562ca4918a5e25eac86ccd8ab` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:55.353021 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a360224-5086-4c6a-9d35-ae841a81973e admin admin] RBAC: Authorizing `identity:get_project(project_id=78966be562ca4918a5e25eac86ccd8ab)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:55.355189 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a360224-5086-4c6a-9d35-ae841a81973e admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:55.356755 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 45/83] 10.222.0.58 () {56 vars in 1122 bytes} [Tue Oct 12 16:36:55 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:36:55.357837 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 39/84] 10.222.0.58 () {56 vars in 1207 bytes} [Tue Oct 12 16:36:55 2021] GET /identity/v3/projects/78966be562ca4918a5e25eac86ccd8ab => generated 298 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:36:55.357958 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd67f5a7-e4b3-461c-8ad1-c8ddc3511847 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:55.361463 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6b7bf3-d990-4ec8-82a1-029110f87fc2 None None] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:55.361463 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6b7bf3-d990-4ec8-82a1-029110f87fc2 None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:55.361463 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6b7bf3-d990-4ec8-82a1-029110f87fc2 None None] PATH_INFO: `/` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:55.365073 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 40/85] 10.222.0.58 () {54 vars in 926 bytes} [Tue Oct 12 16:36:55 2021] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:36:55.365848 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6b7bf3-d990-4ec8-82a1-029110f87fc2 None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:55.371085 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd67f5a7-e4b3-461c-8ad1-c8ddc3511847 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:55.375661 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdec295f-b298-4087-a286-e13151e7994d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:55.376338 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdec295f-b298-4087-a286-e13151e7994d admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:55.376630 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdec295f-b298-4087-a286-e13151e7994d admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:55.376912 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdec295f-b298-4087-a286-e13151e7994d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:55.378205 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6b7bf3-d990-4ec8-82a1-029110f87fc2 None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:55.382557 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35aaf2e-0683-4dc6-9688-428d7fbb35c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:55.383446 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35aaf2e-0683-4dc6-9688-428d7fbb35c9 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:55.383732 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35aaf2e-0683-4dc6-9688-428d7fbb35c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:55.384014 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35aaf2e-0683-4dc6-9688-428d7fbb35c9 admin admin] PATH_INFO: `/v3/users/3e3ad764755947d6af5bc63c40f75cda` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:55.386100 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35aaf2e-0683-4dc6-9688-428d7fbb35c9 admin admin] RBAC: Authorizing `identity:get_user(user_id=3e3ad764755947d6af5bc63c40f75cda)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:55.386496 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdec295f-b298-4087-a286-e13151e7994d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:55.388276 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35aaf2e-0683-4dc6-9688-428d7fbb35c9 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:55.388369 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdec295f-b298-4087-a286-e13151e7994d admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:55.395181 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 41/86] 10.222.0.58 () {56 vars in 1198 bytes} [Tue Oct 12 16:36:55 2021] GET /identity/v3/users/3e3ad764755947d6af5bc63c40f75cda => generated 275 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:36:55.395181 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35aaf2e-0683-4dc6-9688-428d7fbb35c9 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:55.401791 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 46/87] 10.222.0.58 () {58 vars in 1324 bytes} [Tue Oct 12 16:36:55 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:36:55.404331 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a67e4d-bfd0-4e83-884c-c2543ec8048b None None] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:55.404702 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a67e4d-bfd0-4e83-884c-c2543ec8048b None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:55.404901 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a67e4d-bfd0-4e83-884c-c2543ec8048b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:55.407536 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35aaf2e-0683-4dc6-9688-428d7fbb35c9 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:55.412027 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e997de6d-04ec-479e-a1ec-16148eb9da4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:55.412700 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e997de6d-04ec-479e-a1ec-16148eb9da4a admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:55.412991 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e997de6d-04ec-479e-a1ec-16148eb9da4a admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:55.413275 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e997de6d-04ec-479e-a1ec-16148eb9da4a admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:55.414192 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e997de6d-04ec-479e-a1ec-16148eb9da4a admin admin] RBAC: Adding query filter params (role.id=55ba49fe29884e64b57c3ad13188d554, scope.project.id=78966be562ca4918a5e25eac86ccd8ab, user.id=3e3ad764755947d6af5bc63c40f75cda) {{(pid=85205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:36:55.414511 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e997de6d-04ec-479e-a1ec-16148eb9da4a admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:55.416546 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e997de6d-04ec-479e-a1ec-16148eb9da4a admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:55.423131 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 42/88] 10.222.0.58 () {56 vars in 1395 bytes} [Tue Oct 12 16:36:55 2021] GET /identity/v3/role_assignments?user.id=3e3ad764755947d6af5bc63c40f75cda&scope.project.id=78966be562ca4918a5e25eac86ccd8ab&role.id=55ba49fe29884e64b57c3ad13188d554 => generated 259 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:36:55.423827 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e997de6d-04ec-479e-a1ec-16148eb9da4a admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:55.425691 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.auth.core [None req-56a67e4d-bfd0-4e83-884c-c2543ec8048b None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:36:55.427197 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-56a67e4d-bfd0-4e83-884c-c2543ec8048b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:36:55.434493 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e997de6d-04ec-479e-a1ec-16148eb9da4a admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:55.436420 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 47/89] 10.222.0.58 () {58 vars in 1023 bytes} [Tue Oct 12 16:36:55 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:36:55.437780 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a67e4d-bfd0-4e83-884c-c2543ec8048b None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:55.452441 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05737af-6e35-48e6-b282-528395e96c3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:55.453195 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05737af-6e35-48e6-b282-528395e96c3e admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:55.455018 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a67e4d-bfd0-4e83-884c-c2543ec8048b None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:55.455761 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05737af-6e35-48e6-b282-528395e96c3e admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:55.456089 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05737af-6e35-48e6-b282-528395e96c3e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:55.460680 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b0e8c8-a943-43ed-8ad3-2d70fda1dcc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:55.461988 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b0e8c8-a943-43ed-8ad3-2d70fda1dcc1 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:55.462611 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b0e8c8-a943-43ed-8ad3-2d70fda1dcc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:55.463180 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b0e8c8-a943-43ed-8ad3-2d70fda1dcc1 admin admin] PATH_INFO: `/v3/projects/78966be562ca4918a5e25eac86ccd8ab` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:55.465237 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b0e8c8-a943-43ed-8ad3-2d70fda1dcc1 admin admin] RBAC: Authorizing `identity:get_project(project_id=78966be562ca4918a5e25eac86ccd8ab)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:55.467671 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b0e8c8-a943-43ed-8ad3-2d70fda1dcc1 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:55.474328 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 48/90] 10.222.0.58 () {56 vars in 1207 bytes} [Tue Oct 12 16:36:55 2021] GET /identity/v3/projects/78966be562ca4918a5e25eac86ccd8ab => generated 298 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:36:55.477252 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b0e8c8-a943-43ed-8ad3-2d70fda1dcc1 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:55.480499 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05737af-6e35-48e6-b282-528395e96c3e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:55.482469 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05737af-6e35-48e6-b282-528395e96c3e admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:55.489304 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b0e8c8-a943-43ed-8ad3-2d70fda1dcc1 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:55.494333 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 43/91] 10.222.0.58 () {58 vars in 1324 bytes} [Tue Oct 12 16:36:55 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:36:55.494930 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9d30b7-859e-4938-8184-fbdeca4bb961 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:55.495289 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05737af-6e35-48e6-b282-528395e96c3e admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:55.496162 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9d30b7-859e-4938-8184-fbdeca4bb961 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:55.496654 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9d30b7-859e-4938-8184-fbdeca4bb961 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:55.497196 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9d30b7-859e-4938-8184-fbdeca4bb961 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:55.498334 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9d30b7-859e-4938-8184-fbdeca4bb961 admin admin] RBAC: Adding query filter params (role.id=610824e4f50f4fb8954610e98c1de784, scope.project.id=78966be562ca4918a5e25eac86ccd8ab, user.id=296f95d6453b448dad63081ef9a200d3) {{(pid=85204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:36:55.498863 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9d30b7-859e-4938-8184-fbdeca4bb961 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:55.501073 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9d30b7-859e-4938-8184-fbdeca4bb961 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:55.505831 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05737af-6e35-48e6-b282-528395e96c3e admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:55.508434 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 49/92] 10.222.0.58 () {56 vars in 1395 bytes} [Tue Oct 12 16:36:55 2021] GET /identity/v3/role_assignments?user.id=296f95d6453b448dad63081ef9a200d3&scope.project.id=78966be562ca4918a5e25eac86ccd8ab&role.id=610824e4f50f4fb8954610e98c1de784 => generated 259 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:36:55.509789 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9d30b7-859e-4938-8184-fbdeca4bb961 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:55.511513 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7991195e-3bb4-4f93-9e48-0b003f9b9b5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:55.512738 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7991195e-3bb4-4f93-9e48-0b003f9b9b5b admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:55.515589 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7991195e-3bb4-4f93-9e48-0b003f9b9b5b admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:55.515589 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7991195e-3bb4-4f93-9e48-0b003f9b9b5b admin admin] PATH_INFO: `/v3/domains/default` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:55.516873 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7991195e-3bb4-4f93-9e48-0b003f9b9b5b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:55.518894 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7991195e-3bb4-4f93-9e48-0b003f9b9b5b admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:55.521210 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 44/93] 10.222.0.58 () {56 vars in 1129 bytes} [Tue Oct 12 16:36:55 2021] GET /identity/v3/domains/default => generated 199 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:36:55.527679 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9d30b7-859e-4938-8184-fbdeca4bb961 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:55.528386 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7991195e-3bb4-4f93-9e48-0b003f9b9b5b admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:55.532971 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2ddb0e-2b5f-44d0-ab19-0ff0271df64d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:55.534214 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2ddb0e-2b5f-44d0-ab19-0ff0271df64d admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:55.534656 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2ddb0e-2b5f-44d0-ab19-0ff0271df64d admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:55.535120 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2ddb0e-2b5f-44d0-ab19-0ff0271df64d admin admin] PATH_INFO: `/v3/projects/1415d5493e784eb7919162a50f191476` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:55.536682 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2ddb0e-2b5f-44d0-ab19-0ff0271df64d admin admin] RBAC: Authorizing `identity:get_project(project_id=1415d5493e784eb7919162a50f191476)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:55.539064 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2ddb0e-2b5f-44d0-ab19-0ff0271df64d admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:55.539809 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7991195e-3bb4-4f93-9e48-0b003f9b9b5b admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:55.541616 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 50/94] 10.222.0.58 () {56 vars in 1207 bytes} [Tue Oct 12 16:36:55 2021] GET /identity/v3/projects/1415d5493e784eb7919162a50f191476 => generated 312 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:36:55.548768 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2ddb0e-2b5f-44d0-ab19-0ff0271df64d admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:55.550735 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b14526b-9820-4e29-83ba-3972844ba635 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:55.551607 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b14526b-9820-4e29-83ba-3972844ba635 admin admin] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:55.552002 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b14526b-9820-4e29-83ba-3972844ba635 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:55.552417 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b14526b-9820-4e29-83ba-3972844ba635 admin admin] PATH_INFO: `/v3/projects` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:55.553319 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b14526b-9820-4e29-83ba-3972844ba635 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:55.555457 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b14526b-9820-4e29-83ba-3972844ba635 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:55.561547 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2ddb0e-2b5f-44d0-ab19-0ff0271df64d admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:55.569161 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717afb0b-bad7-44dc-8755-aca8e4a6422c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:55.569762 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717afb0b-bad7-44dc-8755-aca8e4a6422c admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:55.570120 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717afb0b-bad7-44dc-8755-aca8e4a6422c admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:55.570405 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717afb0b-bad7-44dc-8755-aca8e4a6422c admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:55.571987 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717afb0b-bad7-44dc-8755-aca8e4a6422c admin admin] RBAC: Adding query filter params (role.id=55ba49fe29884e64b57c3ad13188d554, scope.project.id=1415d5493e784eb7919162a50f191476, user.id=3e3ad764755947d6af5bc63c40f75cda) {{(pid=85204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:36:55.571987 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717afb0b-bad7-44dc-8755-aca8e4a6422c admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:55.574162 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717afb0b-bad7-44dc-8755-aca8e4a6422c admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:55.580785 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 51/95] 10.222.0.58 () {56 vars in 1395 bytes} [Tue Oct 12 16:36:55 2021] GET /identity/v3/role_assignments?user.id=3e3ad764755947d6af5bc63c40f75cda&scope.project.id=1415d5493e784eb7919162a50f191476&role.id=55ba49fe29884e64b57c3ad13188d554 => generated 259 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:36:55.612886 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 45/96] 10.222.0.58 () {60 vars in 1162 bytes} [Tue Oct 12 16:36:55 2021] POST /identity/v3/projects => generated 302 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 16:36:58.115852 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e9ce73-0ed8-4902-8228-442a0ff1efc0 None None] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:58.116364 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e9ce73-0ed8-4902-8228-442a0ff1efc0 None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:58.116364 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e9ce73-0ed8-4902-8228-442a0ff1efc0 None None] PATH_INFO: `/` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:58.118482 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 52/97] 10.222.0.58 () {54 vars in 926 bytes} [Tue Oct 12 16:36:58 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:36:58.125288 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6451262-8696-450b-8a1a-db37d6af69fd None None] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:58.126253 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6451262-8696-450b-8a1a-db37d6af69fd None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:58.126763 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6451262-8696-450b-8a1a-db37d6af69fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:58.147102 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.auth.core [None req-c6451262-8696-450b-8a1a-db37d6af69fd None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:36:58.150002 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-c6451262-8696-450b-8a1a-db37d6af69fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:36:58.217380 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 46/98] 10.222.0.58 () {58 vars in 1023 bytes} [Tue Oct 12 16:36:58 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:36:58.239677 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a8ab76-20e3-43cf-bee0-7d73debf38a4 None None] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:58.240581 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a8ab76-20e3-43cf-bee0-7d73debf38a4 None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:58.241073 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a8ab76-20e3-43cf-bee0-7d73debf38a4 None None] PATH_INFO: `/` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:58.241482 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6451262-8696-450b-8a1a-db37d6af69fd None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:58.243312 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 53/99] 10.222.0.58 () {54 vars in 926 bytes} [Tue Oct 12 16:36:58 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:36:58.249292 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a789bc26-2683-4baf-ab6e-1fde697d8ac3 None None] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:58.249851 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a789bc26-2683-4baf-ab6e-1fde697d8ac3 None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:58.250373 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a789bc26-2683-4baf-ab6e-1fde697d8ac3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:58.250886 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6451262-8696-450b-8a1a-db37d6af69fd None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:58.255517 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a2dba2-88bd-42b5-b541-166e28737fb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:58.256311 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a2dba2-88bd-42b5-b541-166e28737fb0 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:58.256602 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a2dba2-88bd-42b5-b541-166e28737fb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:58.256899 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a2dba2-88bd-42b5-b541-166e28737fb0 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:58.268962 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a2dba2-88bd-42b5-b541-166e28737fb0 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 16:36:58.272641 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.auth.core [None req-a789bc26-2683-4baf-ab6e-1fde697d8ac3 None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:36:58.274083 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-a789bc26-2683-4baf-ab6e-1fde697d8ac3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:36:58.276641 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: WARNING keystone.server.flask.application [None req-00a2dba2-88bd-42b5-b541-166e28737fb0 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 16:36:58.278166 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 47/100] 10.222.0.58 () {56 vars in 1117 bytes} [Tue Oct 12 16:36:58 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 16:36:58.284460 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a2dba2-88bd-42b5-b541-166e28737fb0 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:58.285959 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 54/101] 10.222.0.58 () {58 vars in 1023 bytes} [Tue Oct 12 16:36:58 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:36:58.294934 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a2dba2-88bd-42b5-b541-166e28737fb0 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:58.299505 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7a9a14-1ac7-4b27-93b3-2725644dff5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:58.300169 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7a9a14-1ac7-4b27-93b3-2725644dff5c admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:58.300461 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7a9a14-1ac7-4b27-93b3-2725644dff5c admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:58.300748 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7a9a14-1ac7-4b27-93b3-2725644dff5c admin admin] PATH_INFO: `/v3/roles` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:58.301536 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7a9a14-1ac7-4b27-93b3-2725644dff5c admin admin] RBAC: Adding query filter params (name=admin) {{(pid=85205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:36:58.301855 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7a9a14-1ac7-4b27-93b3-2725644dff5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:58.303640 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7a9a14-1ac7-4b27-93b3-2725644dff5c admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:58.313326 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a789bc26-2683-4baf-ab6e-1fde697d8ac3 None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:58.314295 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 48/102] 10.222.0.58 () {56 vars in 1120 bytes} [Tue Oct 12 16:36:58 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:36:58.320665 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7a9a14-1ac7-4b27-93b3-2725644dff5c admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:58.325317 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a789bc26-2683-4baf-ab6e-1fde697d8ac3 None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:58.330514 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a6f947-2e4f-4c1f-af7e-192507592c82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:58.331697 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a6f947-2e4f-4c1f-af7e-192507592c82 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:58.331875 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7a9a14-1ac7-4b27-93b3-2725644dff5c admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:58.332356 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a6f947-2e4f-4c1f-af7e-192507592c82 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:58.332928 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a6f947-2e4f-4c1f-af7e-192507592c82 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:58.337038 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82aa2b4-63e2-4f6a-9379-37e65b7c2085 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:58.337708 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82aa2b4-63e2-4f6a-9379-37e65b7c2085 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:58.338042 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82aa2b4-63e2-4f6a-9379-37e65b7c2085 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:58.338326 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82aa2b4-63e2-4f6a-9379-37e65b7c2085 admin admin] PATH_INFO: `/v3/users/296f95d6453b448dad63081ef9a200d3` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:58.340196 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82aa2b4-63e2-4f6a-9379-37e65b7c2085 admin admin] RBAC: Authorizing `identity:get_user(user_id=296f95d6453b448dad63081ef9a200d3)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:58.342104 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82aa2b4-63e2-4f6a-9379-37e65b7c2085 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:58.343954 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 49/103] 10.222.0.58 () {56 vars in 1198 bytes} [Tue Oct 12 16:36:58 2021] GET /identity/v3/users/296f95d6453b448dad63081ef9a200d3 => generated 247 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 16:36:58.348467 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a6f947-2e4f-4c1f-af7e-192507592c82 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 16:36:58.349748 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82aa2b4-63e2-4f6a-9379-37e65b7c2085 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:58.356479 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: WARNING keystone.server.flask.application [None req-65a6f947-2e4f-4c1f-af7e-192507592c82 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 12 16:36:58.358210 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 55/104] 10.222.0.58 () {56 vars in 1135 bytes} [Tue Oct 12 16:36:58 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:36:58.359626 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82aa2b4-63e2-4f6a-9379-37e65b7c2085 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:58.365300 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a6f947-2e4f-4c1f-af7e-192507592c82 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:58.366447 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5304424-33a8-4583-8318-be80899008db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:58.367270 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5304424-33a8-4583-8318-be80899008db admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:58.367634 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5304424-33a8-4583-8318-be80899008db admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:58.367985 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5304424-33a8-4583-8318-be80899008db admin admin] PATH_INFO: `/v3/projects/78966be562ca4918a5e25eac86ccd8ab` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:58.369265 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5304424-33a8-4583-8318-be80899008db admin admin] RBAC: Authorizing `identity:get_project(project_id=78966be562ca4918a5e25eac86ccd8ab)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:58.371478 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5304424-33a8-4583-8318-be80899008db admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:58.373300 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 50/105] 10.222.0.58 () {56 vars in 1207 bytes} [Tue Oct 12 16:36:58 2021] GET /identity/v3/projects/78966be562ca4918a5e25eac86ccd8ab => generated 298 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 16:36:58.374700 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38704ec5-ba6b-4565-a172-1767d3790572 None None] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:58.375164 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38704ec5-ba6b-4565-a172-1767d3790572 None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:58.375621 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38704ec5-ba6b-4565-a172-1767d3790572 None None] PATH_INFO: `/` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:58.377364 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a6f947-2e4f-4c1f-af7e-192507592c82 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:58.377506 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 51/106] 10.222.0.58 () {54 vars in 926 bytes} [Tue Oct 12 16:36:58 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:36:58.383228 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6089a1a4-832e-4942-bba5-e53dc208f34b None None] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:58.383539 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6089a1a4-832e-4942-bba5-e53dc208f34b None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:58.383809 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6089a1a4-832e-4942-bba5-e53dc208f34b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:58.387103 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3bdd06-429a-4442-98d5-e30966837b13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:58.388126 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3bdd06-429a-4442-98d5-e30966837b13 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:58.388614 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3bdd06-429a-4442-98d5-e30966837b13 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:58.389172 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3bdd06-429a-4442-98d5-e30966837b13 admin admin] PATH_INFO: `/v3/roles` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:58.390193 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3bdd06-429a-4442-98d5-e30966837b13 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=85204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:36:58.390756 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3bdd06-429a-4442-98d5-e30966837b13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:58.392610 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3bdd06-429a-4442-98d5-e30966837b13 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:58.402655 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 56/107] 10.222.0.58 () {56 vars in 1132 bytes} [Tue Oct 12 16:36:58 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 16:36:58.403210 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.auth.core [None req-6089a1a4-832e-4942-bba5-e53dc208f34b None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:36:58.403895 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3bdd06-429a-4442-98d5-e30966837b13 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:58.404450 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-6089a1a4-832e-4942-bba5-e53dc208f34b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:36:58.414958 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3bdd06-429a-4442-98d5-e30966837b13 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:58.417509 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 52/108] 10.222.0.58 () {58 vars in 1023 bytes} [Tue Oct 12 16:36:58 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:36:58.425894 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6089a1a4-832e-4942-bba5-e53dc208f34b None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:58.426018 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb80aa6-3034-41c4-9ca3-5264f262bc40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:58.426018 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb80aa6-3034-41c4-9ca3-5264f262bc40 admin admin] REQUEST_METHOD: `PUT` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:58.426018 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb80aa6-3034-41c4-9ca3-5264f262bc40 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:58.426018 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb80aa6-3034-41c4-9ca3-5264f262bc40 admin admin] PATH_INFO: `/v3/projects/78966be562ca4918a5e25eac86ccd8ab/users/296f95d6453b448dad63081ef9a200d3/roles/610824e4f50f4fb8954610e98c1de784` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:58.426353 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb80aa6-3034-41c4-9ca3-5264f262bc40 admin admin] RBAC: Authorizing `identity:create_grant(project_id=78966be562ca4918a5e25eac86ccd8ab, user_id=296f95d6453b448dad63081ef9a200d3, role_id=610824e4f50f4fb8954610e98c1de784)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:58.426353 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: WARNING py.warnings [None req-bdb80aa6-3034-41c4-9ca3-5264f262bc40 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:create_grant failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 12 16:36:58.426353 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: warnings.warn(msg) Oct 12 16:36:58.426353 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: Oct 12 16:36:58.427519 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb80aa6-3034-41c4-9ca3-5264f262bc40 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:58.436310 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6089a1a4-832e-4942-bba5-e53dc208f34b None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:58.441976 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65498b8a-a9e1-49ba-88ac-6b486cbc8765 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:58.443159 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65498b8a-a9e1-49ba-88ac-6b486cbc8765 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:58.443654 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65498b8a-a9e1-49ba-88ac-6b486cbc8765 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:58.444173 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65498b8a-a9e1-49ba-88ac-6b486cbc8765 admin admin] PATH_INFO: `/v3/users/3e3ad764755947d6af5bc63c40f75cda` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:58.445705 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65498b8a-a9e1-49ba-88ac-6b486cbc8765 admin admin] RBAC: Authorizing `identity:get_user(user_id=3e3ad764755947d6af5bc63c40f75cda)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:58.447730 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 57/109] 10.222.0.58 () {58 vars in 1460 bytes} [Tue Oct 12 16:36:58 2021] PUT /identity/v3/projects/78966be562ca4918a5e25eac86ccd8ab/users/296f95d6453b448dad63081ef9a200d3/roles/610824e4f50f4fb8954610e98c1de784 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:36:58.449049 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65498b8a-a9e1-49ba-88ac-6b486cbc8765 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:58.451142 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 53/110] 10.222.0.58 () {56 vars in 1198 bytes} [Tue Oct 12 16:36:58 2021] GET /identity/v3/users/3e3ad764755947d6af5bc63c40f75cda => generated 275 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:36:58.457655 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb80aa6-3034-41c4-9ca3-5264f262bc40 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:58.459355 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65498b8a-a9e1-49ba-88ac-6b486cbc8765 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:58.470731 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65498b8a-a9e1-49ba-88ac-6b486cbc8765 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:58.528632 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb80aa6-3034-41c4-9ca3-5264f262bc40 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:58.534003 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f3c803-4138-4976-80ae-aa8fa5f4679a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:58.535012 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f3c803-4138-4976-80ae-aa8fa5f4679a admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:58.535306 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f3c803-4138-4976-80ae-aa8fa5f4679a admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:58.535601 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f3c803-4138-4976-80ae-aa8fa5f4679a admin admin] PATH_INFO: `/v3/projects/78966be562ca4918a5e25eac86ccd8ab` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:58.535832 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d27074-4c37-4584-823d-c1f593fe2ec2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:58.536890 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d27074-4c37-4584-823d-c1f593fe2ec2 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:58.537016 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f3c803-4138-4976-80ae-aa8fa5f4679a admin admin] RBAC: Authorizing `identity:get_project(project_id=78966be562ca4918a5e25eac86ccd8ab)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:58.537490 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d27074-4c37-4584-823d-c1f593fe2ec2 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:58.537981 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d27074-4c37-4584-823d-c1f593fe2ec2 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:58.539386 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f3c803-4138-4976-80ae-aa8fa5f4679a admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:58.541851 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 58/111] 10.222.0.58 () {56 vars in 1207 bytes} [Tue Oct 12 16:36:58 2021] GET /identity/v3/projects/78966be562ca4918a5e25eac86ccd8ab => generated 298 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:36:58.547987 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a8a3f1-c316-4b02-8f01-7c86df804dcf None None] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:58.547987 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a8a3f1-c316-4b02-8f01-7c86df804dcf None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:58.547987 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a8a3f1-c316-4b02-8f01-7c86df804dcf None None] PATH_INFO: `/` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:58.547987 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 59/112] 10.222.0.58 () {54 vars in 926 bytes} [Tue Oct 12 16:36:58 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:36:58.548947 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a8a3f1-c316-4b02-8f01-7c86df804dcf None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:58.559712 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d27074-4c37-4584-823d-c1f593fe2ec2 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 16:36:58.564738 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a8a3f1-c316-4b02-8f01-7c86df804dcf None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:58.567943 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: WARNING keystone.server.flask.application [None req-72d27074-4c37-4584-823d-c1f593fe2ec2 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 12 16:36:58.569287 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30389f18-755c-4659-aff8-71140367f472 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:58.569741 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 54/113] 10.222.0.58 () {56 vars in 1120 bytes} [Tue Oct 12 16:36:58 2021] GET /identity/v3/roles/member => generated 84 bytes in 111 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:36:58.571224 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67b60a1-5a80-4d36-b77a-27d15d29c1dd None None] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:58.571718 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67b60a1-5a80-4d36-b77a-27d15d29c1dd None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:58.572195 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67b60a1-5a80-4d36-b77a-27d15d29c1dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:58.575000 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30389f18-755c-4659-aff8-71140367f472 admin admin] REQUEST_METHOD: `PUT` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:58.575944 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30389f18-755c-4659-aff8-71140367f472 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:58.576931 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30389f18-755c-4659-aff8-71140367f472 admin admin] PATH_INFO: `/v3/projects/78966be562ca4918a5e25eac86ccd8ab/users/3e3ad764755947d6af5bc63c40f75cda/roles/638eb220c5a346cb8cf0e7128f938c65` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:58.582802 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30389f18-755c-4659-aff8-71140367f472 admin admin] RBAC: Authorizing `identity:create_grant(project_id=78966be562ca4918a5e25eac86ccd8ab, user_id=3e3ad764755947d6af5bc63c40f75cda, role_id=638eb220c5a346cb8cf0e7128f938c65)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:58.585836 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30389f18-755c-4659-aff8-71140367f472 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:58.596102 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.auth.core [None req-c67b60a1-5a80-4d36-b77a-27d15d29c1dd None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:36:58.597519 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-c67b60a1-5a80-4d36-b77a-27d15d29c1dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:36:58.603173 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 60/114] 10.222.0.58 () {58 vars in 1460 bytes} [Tue Oct 12 16:36:58 2021] PUT /identity/v3/projects/78966be562ca4918a5e25eac86ccd8ab/users/3e3ad764755947d6af5bc63c40f75cda/roles/638eb220c5a346cb8cf0e7128f938c65 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:36:58.605174 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30389f18-755c-4659-aff8-71140367f472 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:58.699122 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30389f18-755c-4659-aff8-71140367f472 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:58.704537 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b8f5ea-5037-4e39-bae9-cb682bef55ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:58.705236 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b8f5ea-5037-4e39-bae9-cb682bef55ab admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:58.705521 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b8f5ea-5037-4e39-bae9-cb682bef55ab admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:58.705787 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b8f5ea-5037-4e39-bae9-cb682bef55ab admin admin] PATH_INFO: `/v3/roles` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:58.706641 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b8f5ea-5037-4e39-bae9-cb682bef55ab admin admin] RBAC: Adding query filter params (name=member) {{(pid=85204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:36:58.706954 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b8f5ea-5037-4e39-bae9-cb682bef55ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:58.708614 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b8f5ea-5037-4e39-bae9-cb682bef55ab admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:58.717992 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 61/115] 10.222.0.58 () {56 vars in 1122 bytes} [Tue Oct 12 16:36:58 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:36:58.719361 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2007edf0-3f3f-4417-babc-76b6cc1b038b None None] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:58.719652 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2007edf0-3f3f-4417-babc-76b6cc1b038b None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:58.719931 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2007edf0-3f3f-4417-babc-76b6cc1b038b None None] PATH_INFO: `/` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:58.720275 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 55/116] 10.222.0.58 () {58 vars in 1023 bytes} [Tue Oct 12 16:36:58 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:36:58.721573 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 62/117] 10.222.0.58 () {54 vars in 926 bytes} [Tue Oct 12 16:36:58 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:36:58.726827 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67b60a1-5a80-4d36-b77a-27d15d29c1dd None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:58.727555 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6cb46d-6646-4eb4-a00a-29a4e63e14a0 None None] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:58.727925 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6cb46d-6646-4eb4-a00a-29a4e63e14a0 None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:58.728284 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6cb46d-6646-4eb4-a00a-29a4e63e14a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:58.746088 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67b60a1-5a80-4d36-b77a-27d15d29c1dd None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:58.748598 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.auth.core [None req-6a6cb46d-6646-4eb4-a00a-29a4e63e14a0 None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:36:58.749945 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-6a6cb46d-6646-4eb4-a00a-29a4e63e14a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:36:58.751981 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220cf7d4-f0d6-4d13-b204-d27ea951f84d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:58.752986 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220cf7d4-f0d6-4d13-b204-d27ea951f84d admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:58.753272 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220cf7d4-f0d6-4d13-b204-d27ea951f84d admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:58.753654 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220cf7d4-f0d6-4d13-b204-d27ea951f84d admin admin] PATH_INFO: `/v3/users/3e3ad764755947d6af5bc63c40f75cda` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:58.755255 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220cf7d4-f0d6-4d13-b204-d27ea951f84d admin admin] RBAC: Authorizing `identity:get_user(user_id=3e3ad764755947d6af5bc63c40f75cda)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:58.757768 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220cf7d4-f0d6-4d13-b204-d27ea951f84d admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:58.759182 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 63/118] 10.222.0.58 () {58 vars in 1023 bytes} [Tue Oct 12 16:36:58 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:36:58.759549 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 56/119] 10.222.0.58 () {56 vars in 1198 bytes} [Tue Oct 12 16:36:58 2021] GET /identity/v3/users/3e3ad764755947d6af5bc63c40f75cda => generated 275 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:36:58.760049 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6cb46d-6646-4eb4-a00a-29a4e63e14a0 None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:58.767447 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220cf7d4-f0d6-4d13-b204-d27ea951f84d admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:58.773666 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6cb46d-6646-4eb4-a00a-29a4e63e14a0 None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:58.780074 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d798892d-512e-4e0b-8c06-2bae5bcef6ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:58.780254 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220cf7d4-f0d6-4d13-b204-d27ea951f84d admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:58.781473 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d798892d-512e-4e0b-8c06-2bae5bcef6ea admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:58.782144 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d798892d-512e-4e0b-8c06-2bae5bcef6ea admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:58.782651 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d798892d-512e-4e0b-8c06-2bae5bcef6ea admin admin] PATH_INFO: `/v3/roles/member` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:58.784975 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6289ec3c-cde4-4059-840a-198427473409 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:58.785869 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6289ec3c-cde4-4059-840a-198427473409 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:58.786206 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6289ec3c-cde4-4059-840a-198427473409 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:58.786486 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6289ec3c-cde4-4059-840a-198427473409 admin admin] PATH_INFO: `/v3/projects/78966be562ca4918a5e25eac86ccd8ab` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:58.787830 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6289ec3c-cde4-4059-840a-198427473409 admin admin] RBAC: Authorizing `identity:get_project(project_id=78966be562ca4918a5e25eac86ccd8ab)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:58.789978 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6289ec3c-cde4-4059-840a-198427473409 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:58.791914 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 57/120] 10.222.0.58 () {56 vars in 1207 bytes} [Tue Oct 12 16:36:58 2021] GET /identity/v3/projects/78966be562ca4918a5e25eac86ccd8ab => generated 298 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 16:36:58.792778 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6289ec3c-cde4-4059-840a-198427473409 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:58.798499 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d798892d-512e-4e0b-8c06-2bae5bcef6ea admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 16:36:58.809351 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6289ec3c-cde4-4059-840a-198427473409 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:58.812105 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9aa8f82-7b42-4a0f-b8bf-89b0fdd29d98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:58.812398 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: WARNING keystone.server.flask.application [None req-d798892d-512e-4e0b-8c06-2bae5bcef6ea admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 12 16:36:58.812938 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9aa8f82-7b42-4a0f-b8bf-89b0fdd29d98 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:58.813419 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9aa8f82-7b42-4a0f-b8bf-89b0fdd29d98 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:58.813710 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9aa8f82-7b42-4a0f-b8bf-89b0fdd29d98 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:58.814570 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 64/121] 10.222.0.58 () {56 vars in 1120 bytes} [Tue Oct 12 16:36:58 2021] GET /identity/v3/roles/member => generated 84 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:36:58.814995 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9aa8f82-7b42-4a0f-b8bf-89b0fdd29d98 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:58.815751 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d798892d-512e-4e0b-8c06-2bae5bcef6ea admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:58.818090 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9aa8f82-7b42-4a0f-b8bf-89b0fdd29d98 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:58.820394 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 58/122] 10.222.0.58 () {56 vars in 1129 bytes} [Tue Oct 12 16:36:58 2021] GET /identity/v3/domains/default => generated 199 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:36:58.826907 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9aa8f82-7b42-4a0f-b8bf-89b0fdd29d98 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:58.834357 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d798892d-512e-4e0b-8c06-2bae5bcef6ea admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:58.838896 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9aa8f82-7b42-4a0f-b8bf-89b0fdd29d98 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:58.839090 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805dcd2b-795c-46d8-95c6-98a98e7bbd68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:58.839994 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805dcd2b-795c-46d8-95c6-98a98e7bbd68 admin admin] REQUEST_METHOD: `PUT` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:58.840282 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805dcd2b-795c-46d8-95c6-98a98e7bbd68 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:58.840561 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805dcd2b-795c-46d8-95c6-98a98e7bbd68 admin admin] PATH_INFO: `/v3/projects/78966be562ca4918a5e25eac86ccd8ab/users/3e3ad764755947d6af5bc63c40f75cda/roles/55ba49fe29884e64b57c3ad13188d554` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:58.843849 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805dcd2b-795c-46d8-95c6-98a98e7bbd68 admin admin] RBAC: Authorizing `identity:create_grant(project_id=78966be562ca4918a5e25eac86ccd8ab, user_id=3e3ad764755947d6af5bc63c40f75cda, role_id=55ba49fe29884e64b57c3ad13188d554)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:58.845241 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b68f034-ce11-4b9b-9101-3f751bdf7736 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:58.846129 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b68f034-ce11-4b9b-9101-3f751bdf7736 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:58.846578 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805dcd2b-795c-46d8-95c6-98a98e7bbd68 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:58.846745 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b68f034-ce11-4b9b-9101-3f751bdf7736 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:58.847203 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b68f034-ce11-4b9b-9101-3f751bdf7736 admin admin] PATH_INFO: `/v3/roles` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:58.848134 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b68f034-ce11-4b9b-9101-3f751bdf7736 admin admin] RBAC: Adding query filter params (name=member) {{(pid=85205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:36:58.848612 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b68f034-ce11-4b9b-9101-3f751bdf7736 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:58.851215 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b68f034-ce11-4b9b-9101-3f751bdf7736 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:58.861013 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 59/123] 10.222.0.58 () {56 vars in 1122 bytes} [Tue Oct 12 16:36:58 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:36:58.862107 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b68f034-ce11-4b9b-9101-3f751bdf7736 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:58.864945 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 65/124] 10.222.0.58 () {58 vars in 1460 bytes} [Tue Oct 12 16:36:58 2021] PUT /identity/v3/projects/78966be562ca4918a5e25eac86ccd8ab/users/3e3ad764755947d6af5bc63c40f75cda/roles/55ba49fe29884e64b57c3ad13188d554 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:36:58.871224 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805dcd2b-795c-46d8-95c6-98a98e7bbd68 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:58.873633 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b68f034-ce11-4b9b-9101-3f751bdf7736 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:58.950482 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba75267-1851-4e29-840f-c253127a2141 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:58.951164 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba75267-1851-4e29-840f-c253127a2141 admin admin] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:58.951421 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba75267-1851-4e29-840f-c253127a2141 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:58.951705 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba75267-1851-4e29-840f-c253127a2141 admin admin] PATH_INFO: `/v3/users` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:58.952458 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba75267-1851-4e29-840f-c253127a2141 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:58.954477 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba75267-1851-4e29-840f-c253127a2141 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:58.969913 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805dcd2b-795c-46d8-95c6-98a98e7bbd68 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:58.971150 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8011590-cb11-49d8-9c0a-35dc43d43968 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:58.972140 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8011590-cb11-49d8-9c0a-35dc43d43968 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:58.972681 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8011590-cb11-49d8-9c0a-35dc43d43968 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:58.973068 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8011590-cb11-49d8-9c0a-35dc43d43968 admin admin] PATH_INFO: `/v3/users/3e3ad764755947d6af5bc63c40f75cda` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:58.974628 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8011590-cb11-49d8-9c0a-35dc43d43968 admin admin] RBAC: Authorizing `identity:get_user(user_id=3e3ad764755947d6af5bc63c40f75cda)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:58.977055 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8011590-cb11-49d8-9c0a-35dc43d43968 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:58.979221 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 66/125] 10.222.0.58 () {56 vars in 1198 bytes} [Tue Oct 12 16:36:58 2021] GET /identity/v3/users/3e3ad764755947d6af5bc63c40f75cda => generated 275 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 16:36:58.985388 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8011590-cb11-49d8-9c0a-35dc43d43968 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:58.987480 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 60/126] 10.222.0.58 () {60 vars in 1153 bytes} [Tue Oct 12 16:36:58 2021] POST /identity/v3/users => generated 283 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:36:59.000086 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8011590-cb11-49d8-9c0a-35dc43d43968 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:59.004969 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de7f2bf-a367-4450-8602-16d7baaca9c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:59.005866 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de7f2bf-a367-4450-8602-16d7baaca9c3 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:59.006185 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de7f2bf-a367-4450-8602-16d7baaca9c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:59.006468 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de7f2bf-a367-4450-8602-16d7baaca9c3 admin admin] PATH_INFO: `/v3/projects/1415d5493e784eb7919162a50f191476` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:59.007783 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de7f2bf-a367-4450-8602-16d7baaca9c3 admin admin] RBAC: Authorizing `identity:get_project(project_id=1415d5493e784eb7919162a50f191476)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:59.014016 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de7f2bf-a367-4450-8602-16d7baaca9c3 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:59.016020 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 67/127] 10.222.0.58 () {56 vars in 1207 bytes} [Tue Oct 12 16:36:58 2021] GET /identity/v3/projects/1415d5493e784eb7919162a50f191476 => generated 312 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 16:36:59.028624 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba75267-1851-4e29-840f-c253127a2141 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:59.045030 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba75267-1851-4e29-840f-c253127a2141 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:59.052822 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fa1ee1-f606-4491-a452-4e6fa319051b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:59.054235 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fa1ee1-f606-4491-a452-4e6fa319051b admin admin] REQUEST_METHOD: `PUT` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:59.054814 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fa1ee1-f606-4491-a452-4e6fa319051b admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:59.055293 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fa1ee1-f606-4491-a452-4e6fa319051b admin admin] PATH_INFO: `/v3/projects/1415d5493e784eb7919162a50f191476/users/3e3ad764755947d6af5bc63c40f75cda/roles/55ba49fe29884e64b57c3ad13188d554` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:59.059337 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fa1ee1-f606-4491-a452-4e6fa319051b admin admin] RBAC: Authorizing `identity:create_grant(project_id=1415d5493e784eb7919162a50f191476, user_id=3e3ad764755947d6af5bc63c40f75cda, role_id=55ba49fe29884e64b57c3ad13188d554)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:59.062618 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fa1ee1-f606-4491-a452-4e6fa319051b admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:59.086091 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 61/128] 10.222.0.58 () {58 vars in 1460 bytes} [Tue Oct 12 16:36:59 2021] PUT /identity/v3/projects/1415d5493e784eb7919162a50f191476/users/3e3ad764755947d6af5bc63c40f75cda/roles/55ba49fe29884e64b57c3ad13188d554 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:37:01.007148 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c652e7-9851-419a-b5d5-df1541334f78 None None] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:01.008202 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c652e7-9851-419a-b5d5-df1541334f78 None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:01.008773 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c652e7-9851-419a-b5d5-df1541334f78 None None] PATH_INFO: `/` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:01.011126 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 68/129] 10.222.0.58 () {54 vars in 926 bytes} [Tue Oct 12 16:37:01 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:37:01.017241 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ffab9f-c8f7-4072-97ae-5be88a70b052 None None] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:01.017708 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ffab9f-c8f7-4072-97ae-5be88a70b052 None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:01.017799 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ffab9f-c8f7-4072-97ae-5be88a70b052 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:01.047131 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.auth.core [None req-a0ffab9f-c8f7-4072-97ae-5be88a70b052 None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:37:01.048358 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-a0ffab9f-c8f7-4072-97ae-5be88a70b052 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:37:01.107737 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 62/130] 10.222.0.58 () {58 vars in 1023 bytes} [Tue Oct 12 16:37:01 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:37:01.154145 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c652e7-9851-419a-b5d5-df1541334f78 None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:01.175233 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c652e7-9851-419a-b5d5-df1541334f78 None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:01.180032 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a184cc-756c-46fe-9780-220611eafee6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:01.181093 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a184cc-756c-46fe-9780-220611eafee6 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:01.181592 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a184cc-756c-46fe-9780-220611eafee6 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:01.182108 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a184cc-756c-46fe-9780-220611eafee6 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:01.193306 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a184cc-756c-46fe-9780-220611eafee6 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 16:37:01.200532 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: WARNING keystone.server.flask.application [None req-33a184cc-756c-46fe-9780-220611eafee6 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 16:37:01.202293 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 69/131] 10.222.0.58 () {56 vars in 1117 bytes} [Tue Oct 12 16:37:01 2021] GET /identity/v3/roles/admin => generated 83 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:37:01.208330 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ffab9f-c8f7-4072-97ae-5be88a70b052 None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:01.220706 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ffab9f-c8f7-4072-97ae-5be88a70b052 None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:01.229580 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00aa9d1-31c9-49cc-b022-6fdce8c6d1ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:01.230311 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00aa9d1-31c9-49cc-b022-6fdce8c6d1ee admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:01.230604 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00aa9d1-31c9-49cc-b022-6fdce8c6d1ee admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:01.230876 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00aa9d1-31c9-49cc-b022-6fdce8c6d1ee admin admin] PATH_INFO: `/v3/roles` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:01.231648 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00aa9d1-31c9-49cc-b022-6fdce8c6d1ee admin admin] RBAC: Adding query filter params (name=admin) {{(pid=85205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:37:01.231956 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00aa9d1-31c9-49cc-b022-6fdce8c6d1ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:01.233552 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00aa9d1-31c9-49cc-b022-6fdce8c6d1ee admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:01.248579 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 63/132] 10.222.0.58 () {56 vars in 1120 bytes} [Tue Oct 12 16:37:01 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:37:01.254891 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a184cc-756c-46fe-9780-220611eafee6 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:01.270313 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a184cc-756c-46fe-9780-220611eafee6 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:01.275407 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1655610d-c36f-4a4d-8776-1eee289e0eb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:01.276583 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1655610d-c36f-4a4d-8776-1eee289e0eb1 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:01.277088 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1655610d-c36f-4a4d-8776-1eee289e0eb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:01.277578 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1655610d-c36f-4a4d-8776-1eee289e0eb1 admin admin] PATH_INFO: `/v3/users/296f95d6453b448dad63081ef9a200d3` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:01.279114 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1655610d-c36f-4a4d-8776-1eee289e0eb1 admin admin] RBAC: Authorizing `identity:get_user(user_id=296f95d6453b448dad63081ef9a200d3)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:01.281175 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1655610d-c36f-4a4d-8776-1eee289e0eb1 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:01.284047 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 70/133] 10.222.0.58 () {56 vars in 1198 bytes} [Tue Oct 12 16:37:01 2021] GET /identity/v3/users/296f95d6453b448dad63081ef9a200d3 => generated 247 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:37:01.290827 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00aa9d1-31c9-49cc-b022-6fdce8c6d1ee admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:01.305764 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00aa9d1-31c9-49cc-b022-6fdce8c6d1ee admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:01.318143 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d296703-b691-4743-b4af-6feef4ab8c9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:01.318974 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d296703-b691-4743-b4af-6feef4ab8c9d admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:01.319321 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d296703-b691-4743-b4af-6feef4ab8c9d admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:01.319606 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d296703-b691-4743-b4af-6feef4ab8c9d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:01.328871 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d296703-b691-4743-b4af-6feef4ab8c9d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:01.330672 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d296703-b691-4743-b4af-6feef4ab8c9d admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:01.343912 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 64/134] 10.222.0.58 () {58 vars in 1324 bytes} [Tue Oct 12 16:37:01 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:37:01.349976 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1655610d-c36f-4a4d-8776-1eee289e0eb1 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:01.361753 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1655610d-c36f-4a4d-8776-1eee289e0eb1 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:01.371765 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2dc138-2a3e-448a-800a-8d91209b114d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:01.372929 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2dc138-2a3e-448a-800a-8d91209b114d admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:01.373435 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2dc138-2a3e-448a-800a-8d91209b114d admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:01.373953 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2dc138-2a3e-448a-800a-8d91209b114d admin admin] PATH_INFO: `/v3/projects/78966be562ca4918a5e25eac86ccd8ab` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:01.375510 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2dc138-2a3e-448a-800a-8d91209b114d admin admin] RBAC: Authorizing `identity:get_project(project_id=78966be562ca4918a5e25eac86ccd8ab)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:01.378515 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2dc138-2a3e-448a-800a-8d91209b114d admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:01.380614 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 71/135] 10.222.0.58 () {56 vars in 1207 bytes} [Tue Oct 12 16:37:01 2021] GET /identity/v3/projects/78966be562ca4918a5e25eac86ccd8ab => generated 298 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:37:01.387792 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d296703-b691-4743-b4af-6feef4ab8c9d admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:01.397130 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d296703-b691-4743-b4af-6feef4ab8c9d admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:01.405821 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5ceaaa-0e1e-47d9-b599-ba7ed08d0cb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:01.406525 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5ceaaa-0e1e-47d9-b599-ba7ed08d0cb4 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:01.406813 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5ceaaa-0e1e-47d9-b599-ba7ed08d0cb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:01.407092 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5ceaaa-0e1e-47d9-b599-ba7ed08d0cb4 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:01.407959 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5ceaaa-0e1e-47d9-b599-ba7ed08d0cb4 admin admin] RBAC: Adding query filter params (role.id=610824e4f50f4fb8954610e98c1de784, scope.project.id=78966be562ca4918a5e25eac86ccd8ab, user.id=296f95d6453b448dad63081ef9a200d3) {{(pid=85205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:37:01.408276 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5ceaaa-0e1e-47d9-b599-ba7ed08d0cb4 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:01.410217 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5ceaaa-0e1e-47d9-b599-ba7ed08d0cb4 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:01.417491 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 65/136] 10.222.0.58 () {56 vars in 1395 bytes} [Tue Oct 12 16:37:01 2021] GET /identity/v3/role_assignments?user.id=296f95d6453b448dad63081ef9a200d3&scope.project.id=78966be562ca4918a5e25eac86ccd8ab&role.id=610824e4f50f4fb8954610e98c1de784 => generated 608 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:37:01.711194 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcd59fc-dd6e-4aef-95af-c1e9b55d9fb1 None None] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:01.711920 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcd59fc-dd6e-4aef-95af-c1e9b55d9fb1 None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:01.712424 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcd59fc-dd6e-4aef-95af-c1e9b55d9fb1 None None] PATH_INFO: `/` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:01.714941 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 72/137] 10.222.0.58 () {54 vars in 926 bytes} [Tue Oct 12 16:37:01 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:37:01.721157 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f9ceba-1256-457e-8468-81f39223b382 None None] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:01.721764 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f9ceba-1256-457e-8468-81f39223b382 None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:01.722272 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f9ceba-1256-457e-8468-81f39223b382 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:01.745758 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.auth.core [None req-07f9ceba-1256-457e-8468-81f39223b382 None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:37:01.747314 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-07f9ceba-1256-457e-8468-81f39223b382 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:37:01.757493 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 66/138] 10.222.0.58 () {58 vars in 1023 bytes} [Tue Oct 12 16:37:01 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:37:01.815480 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcd59fc-dd6e-4aef-95af-c1e9b55d9fb1 None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:01.832660 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcd59fc-dd6e-4aef-95af-c1e9b55d9fb1 None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:01.837454 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176a7979-23b8-445b-8137-782c9df2018c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:01.838557 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176a7979-23b8-445b-8137-782c9df2018c admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:01.839601 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176a7979-23b8-445b-8137-782c9df2018c admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:01.840087 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176a7979-23b8-445b-8137-782c9df2018c admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:01.861065 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176a7979-23b8-445b-8137-782c9df2018c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 16:37:01.868974 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: WARNING keystone.server.flask.application [None req-176a7979-23b8-445b-8137-782c9df2018c admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 12 16:37:01.870833 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 73/139] 10.222.0.58 () {56 vars in 1135 bytes} [Tue Oct 12 16:37:01 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:37:01.876969 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f9ceba-1256-457e-8468-81f39223b382 None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:01.886896 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f9ceba-1256-457e-8468-81f39223b382 None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:01.891736 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058e72c2-48a3-4f0c-bd4c-140be148cbdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:01.892635 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058e72c2-48a3-4f0c-bd4c-140be148cbdf admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:01.893146 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058e72c2-48a3-4f0c-bd4c-140be148cbdf admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:01.893648 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058e72c2-48a3-4f0c-bd4c-140be148cbdf admin admin] PATH_INFO: `/v3/roles` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:01.894652 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058e72c2-48a3-4f0c-bd4c-140be148cbdf admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=85205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:37:01.895204 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058e72c2-48a3-4f0c-bd4c-140be148cbdf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:01.897032 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058e72c2-48a3-4f0c-bd4c-140be148cbdf admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:01.906798 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 67/140] 10.222.0.58 () {56 vars in 1132 bytes} [Tue Oct 12 16:37:01 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:37:01.912792 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176a7979-23b8-445b-8137-782c9df2018c admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:01.923830 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176a7979-23b8-445b-8137-782c9df2018c admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:01.933779 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ead64a4-8588-49c2-aa2a-c1654f17103c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:01.935104 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ead64a4-8588-49c2-aa2a-c1654f17103c admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:01.935639 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ead64a4-8588-49c2-aa2a-c1654f17103c admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:01.936132 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ead64a4-8588-49c2-aa2a-c1654f17103c admin admin] PATH_INFO: `/v3/users/3e3ad764755947d6af5bc63c40f75cda` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:01.937629 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ead64a4-8588-49c2-aa2a-c1654f17103c admin admin] RBAC: Authorizing `identity:get_user(user_id=3e3ad764755947d6af5bc63c40f75cda)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:01.940097 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ead64a4-8588-49c2-aa2a-c1654f17103c admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:01.941998 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 74/141] 10.222.0.58 () {56 vars in 1198 bytes} [Tue Oct 12 16:37:01 2021] GET /identity/v3/users/3e3ad764755947d6af5bc63c40f75cda => generated 275 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:37:01.948214 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058e72c2-48a3-4f0c-bd4c-140be148cbdf admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:01.958549 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058e72c2-48a3-4f0c-bd4c-140be148cbdf admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:01.966227 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997a1727-9f62-4789-ba69-55bafa15b43a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:01.967160 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997a1727-9f62-4789-ba69-55bafa15b43a admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:01.967659 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997a1727-9f62-4789-ba69-55bafa15b43a admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:01.968140 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997a1727-9f62-4789-ba69-55bafa15b43a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:01.978226 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997a1727-9f62-4789-ba69-55bafa15b43a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:01.980917 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997a1727-9f62-4789-ba69-55bafa15b43a admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:01.994100 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 68/142] 10.222.0.58 () {58 vars in 1324 bytes} [Tue Oct 12 16:37:01 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:37:02.000664 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ead64a4-8588-49c2-aa2a-c1654f17103c admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:02.011928 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ead64a4-8588-49c2-aa2a-c1654f17103c admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:02.020858 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73eacf3-b31e-4998-b5b9-d161242efeb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:02.022083 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73eacf3-b31e-4998-b5b9-d161242efeb3 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:02.022589 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73eacf3-b31e-4998-b5b9-d161242efeb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:02.023077 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73eacf3-b31e-4998-b5b9-d161242efeb3 admin admin] PATH_INFO: `/v3/projects/78966be562ca4918a5e25eac86ccd8ab` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:02.024532 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73eacf3-b31e-4998-b5b9-d161242efeb3 admin admin] RBAC: Authorizing `identity:get_project(project_id=78966be562ca4918a5e25eac86ccd8ab)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:02.027448 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73eacf3-b31e-4998-b5b9-d161242efeb3 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:02.029466 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 75/143] 10.222.0.58 () {56 vars in 1207 bytes} [Tue Oct 12 16:37:01 2021] GET /identity/v3/projects/78966be562ca4918a5e25eac86ccd8ab => generated 298 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:37:02.036018 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997a1727-9f62-4789-ba69-55bafa15b43a admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:02.046122 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997a1727-9f62-4789-ba69-55bafa15b43a admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:02.052756 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680711b9-73a1-45ee-85fc-54ccf1087f79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:02.053686 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680711b9-73a1-45ee-85fc-54ccf1087f79 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:02.054262 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680711b9-73a1-45ee-85fc-54ccf1087f79 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:02.054755 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680711b9-73a1-45ee-85fc-54ccf1087f79 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:02.055855 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680711b9-73a1-45ee-85fc-54ccf1087f79 admin admin] RBAC: Adding query filter params (role.id=638eb220c5a346cb8cf0e7128f938c65, scope.project.id=78966be562ca4918a5e25eac86ccd8ab, user.id=3e3ad764755947d6af5bc63c40f75cda) {{(pid=85205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:37:02.056383 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680711b9-73a1-45ee-85fc-54ccf1087f79 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:02.059054 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680711b9-73a1-45ee-85fc-54ccf1087f79 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:02.067048 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 69/144] 10.222.0.58 () {56 vars in 1395 bytes} [Tue Oct 12 16:37:02 2021] GET /identity/v3/role_assignments?user.id=3e3ad764755947d6af5bc63c40f75cda&scope.project.id=78966be562ca4918a5e25eac86ccd8ab&role.id=638eb220c5a346cb8cf0e7128f938c65 => generated 608 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:37:02.365567 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508645ef-c958-4bbd-83d6-2c90cccc380d None None] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:02.366283 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508645ef-c958-4bbd-83d6-2c90cccc380d None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:02.366797 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508645ef-c958-4bbd-83d6-2c90cccc380d None None] PATH_INFO: `/` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:02.368855 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 76/145] 10.222.0.58 () {54 vars in 926 bytes} [Tue Oct 12 16:37:02 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:37:02.375882 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a1c02c-a85c-4c7f-88e2-c422fd2c6d79 None None] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:02.376456 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a1c02c-a85c-4c7f-88e2-c422fd2c6d79 None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:02.376933 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a1c02c-a85c-4c7f-88e2-c422fd2c6d79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:02.384075 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d2fcc2-003f-43b4-b1dd-8c51beccf09d None None] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:02.384631 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d2fcc2-003f-43b4-b1dd-8c51beccf09d None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:02.385132 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d2fcc2-003f-43b4-b1dd-8c51beccf09d None None] PATH_INFO: `/` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:02.387534 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 77/146] 10.222.0.58 () {54 vars in 926 bytes} [Tue Oct 12 16:37:02 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 12 16:37:02.393672 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3d9594-3e02-419f-8184-b34b3d49920c None None] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:02.394309 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3d9594-3e02-419f-8184-b34b3d49920c None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:02.394806 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3d9594-3e02-419f-8184-b34b3d49920c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:02.422562 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.auth.core [None req-c7a1c02c-a85c-4c7f-88e2-c422fd2c6d79 None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:37:02.427264 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-c7a1c02c-a85c-4c7f-88e2-c422fd2c6d79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:37:02.429260 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.auth.core [None req-fd3d9594-3e02-419f-8184-b34b3d49920c None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:37:02.431940 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-fd3d9594-3e02-419f-8184-b34b3d49920c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:37:02.444292 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 70/147] 10.222.0.58 () {58 vars in 1023 bytes} [Tue Oct 12 16:37:02 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:37:02.446859 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 78/148] 10.222.0.58 () {58 vars in 1023 bytes} [Tue Oct 12 16:37:02 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Oct 12 16:37:02.489804 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a1c02c-a85c-4c7f-88e2-c422fd2c6d79 None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:02.490269 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3d9594-3e02-419f-8184-b34b3d49920c None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:02.500839 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a1c02c-a85c-4c7f-88e2-c422fd2c6d79 None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:02.502957 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3d9594-3e02-419f-8184-b34b3d49920c None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:02.506207 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a8ff1c-04ab-4dee-a608-9ea8ef553e09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:02.507491 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a8ff1c-04ab-4dee-a608-9ea8ef553e09 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:02.508010 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a8ff1c-04ab-4dee-a608-9ea8ef553e09 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:02.508497 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a8ff1c-04ab-4dee-a608-9ea8ef553e09 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:02.510881 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20aa5571-23b4-4f83-afbf-0adb401f6701 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:02.511814 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20aa5571-23b4-4f83-afbf-0adb401f6701 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:02.511996 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20aa5571-23b4-4f83-afbf-0adb401f6701 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:02.512246 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20aa5571-23b4-4f83-afbf-0adb401f6701 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:02.522950 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a8ff1c-04ab-4dee-a608-9ea8ef553e09 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 16:37:02.531587 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: WARNING keystone.server.flask.application [None req-38a8ff1c-04ab-4dee-a608-9ea8ef553e09 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 12 16:37:02.533235 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 71/149] 10.222.0.58 () {56 vars in 1120 bytes} [Tue Oct 12 16:37:02 2021] GET /identity/v3/roles/member => generated 84 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 16:37:02.537601 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20aa5571-23b4-4f83-afbf-0adb401f6701 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 16:37:02.540582 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a8ff1c-04ab-4dee-a608-9ea8ef553e09 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:02.545257 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: WARNING keystone.server.flask.application [None req-20aa5571-23b4-4f83-afbf-0adb401f6701 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 12 16:37:02.546809 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 79/150] 10.222.0.58 () {56 vars in 1120 bytes} [Tue Oct 12 16:37:02 2021] GET /identity/v3/roles/member => generated 84 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:37:02.552606 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a8ff1c-04ab-4dee-a608-9ea8ef553e09 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:02.553235 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20aa5571-23b4-4f83-afbf-0adb401f6701 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:02.563587 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41664ccc-4494-4262-86d4-69bf982938db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:02.563802 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20aa5571-23b4-4f83-afbf-0adb401f6701 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:02.564876 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41664ccc-4494-4262-86d4-69bf982938db admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:02.565385 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41664ccc-4494-4262-86d4-69bf982938db admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:02.565892 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41664ccc-4494-4262-86d4-69bf982938db admin admin] PATH_INFO: `/v3/roles` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:02.567004 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41664ccc-4494-4262-86d4-69bf982938db admin admin] RBAC: Adding query filter params (name=member) {{(pid=85205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:37:02.567543 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41664ccc-4494-4262-86d4-69bf982938db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:02.569365 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41664ccc-4494-4262-86d4-69bf982938db admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:02.578848 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dfa2b1-3de6-47a1-9665-9edc340ada90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:02.580016 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dfa2b1-3de6-47a1-9665-9edc340ada90 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:02.580525 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dfa2b1-3de6-47a1-9665-9edc340ada90 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:02.581012 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dfa2b1-3de6-47a1-9665-9edc340ada90 admin admin] PATH_INFO: `/v3/roles` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:02.582996 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44dfa2b1-3de6-47a1-9665-9edc340ada90 admin admin] RBAC: Adding query filter params (name=member) {{(pid=85204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:37:02.583534 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44dfa2b1-3de6-47a1-9665-9edc340ada90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:02.585754 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44dfa2b1-3de6-47a1-9665-9edc340ada90 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:02.589254 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 72/151] 10.222.0.58 () {56 vars in 1122 bytes} [Tue Oct 12 16:37:02 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:37:02.602488 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41664ccc-4494-4262-86d4-69bf982938db admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:02.610093 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 80/152] 10.222.0.58 () {56 vars in 1122 bytes} [Tue Oct 12 16:37:02 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:37:02.615399 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41664ccc-4494-4262-86d4-69bf982938db admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:02.616588 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dfa2b1-3de6-47a1-9665-9edc340ada90 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:02.628129 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dfa2b1-3de6-47a1-9665-9edc340ada90 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:02.633076 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b01096-4c06-4c48-b813-e98c89cf68ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:02.634295 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b01096-4c06-4c48-b813-e98c89cf68ca admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:02.634616 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15c96ae-9f81-4d04-aeb3-bac09cd42dd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:02.635093 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b01096-4c06-4c48-b813-e98c89cf68ca admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:02.635802 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15c96ae-9f81-4d04-aeb3-bac09cd42dd6 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:02.636068 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b01096-4c06-4c48-b813-e98c89cf68ca admin admin] PATH_INFO: `/v3/users/3e3ad764755947d6af5bc63c40f75cda` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:02.636167 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15c96ae-9f81-4d04-aeb3-bac09cd42dd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:02.636362 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15c96ae-9f81-4d04-aeb3-bac09cd42dd6 admin admin] PATH_INFO: `/v3/users/3e3ad764755947d6af5bc63c40f75cda` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:02.637665 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15c96ae-9f81-4d04-aeb3-bac09cd42dd6 admin admin] RBAC: Authorizing `identity:get_user(user_id=3e3ad764755947d6af5bc63c40f75cda)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:02.638196 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b01096-4c06-4c48-b813-e98c89cf68ca admin admin] RBAC: Authorizing `identity:get_user(user_id=3e3ad764755947d6af5bc63c40f75cda)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:02.639856 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15c96ae-9f81-4d04-aeb3-bac09cd42dd6 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:02.640891 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b01096-4c06-4c48-b813-e98c89cf68ca admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:02.641479 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 73/153] 10.222.0.58 () {56 vars in 1198 bytes} [Tue Oct 12 16:37:02 2021] GET /identity/v3/users/3e3ad764755947d6af5bc63c40f75cda => generated 275 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 16:37:02.643070 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 81/154] 10.222.0.58 () {56 vars in 1198 bytes} [Tue Oct 12 16:37:02 2021] GET /identity/v3/users/3e3ad764755947d6af5bc63c40f75cda => generated 275 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:37:02.649148 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15c96ae-9f81-4d04-aeb3-bac09cd42dd6 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:02.649574 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b01096-4c06-4c48-b813-e98c89cf68ca admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:02.669975 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b01096-4c06-4c48-b813-e98c89cf68ca admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:02.670302 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15c96ae-9f81-4d04-aeb3-bac09cd42dd6 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:02.680565 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b33e26-69f7-4e95-9793-65c4ee1696b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:02.681570 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b33e26-69f7-4e95-9793-65c4ee1696b6 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:02.682113 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b33e26-69f7-4e95-9793-65c4ee1696b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:02.682738 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b33e26-69f7-4e95-9793-65c4ee1696b6 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:02.687113 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde825ae-8676-411f-b9cb-7622eeba360f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:02.687778 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde825ae-8676-411f-b9cb-7622eeba360f admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:02.688076 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde825ae-8676-411f-b9cb-7622eeba360f admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:02.688371 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde825ae-8676-411f-b9cb-7622eeba360f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:02.695333 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b33e26-69f7-4e95-9793-65c4ee1696b6 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:02.697514 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b33e26-69f7-4e95-9793-65c4ee1696b6 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:02.711013 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde825ae-8676-411f-b9cb-7622eeba360f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:02.711700 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 82/155] 10.222.0.58 () {58 vars in 1324 bytes} [Tue Oct 12 16:37:02 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 12 16:37:02.713101 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde825ae-8676-411f-b9cb-7622eeba360f admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:02.724772 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b33e26-69f7-4e95-9793-65c4ee1696b6 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:02.733459 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 74/156] 10.222.0.58 () {58 vars in 1324 bytes} [Tue Oct 12 16:37:02 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:37:02.739017 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b33e26-69f7-4e95-9793-65c4ee1696b6 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:02.747812 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde825ae-8676-411f-b9cb-7622eeba360f admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:02.749697 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8876bd8d-6850-42a7-a7e9-ed7922347445 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:02.750946 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8876bd8d-6850-42a7-a7e9-ed7922347445 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:02.751446 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8876bd8d-6850-42a7-a7e9-ed7922347445 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:02.751924 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8876bd8d-6850-42a7-a7e9-ed7922347445 admin admin] PATH_INFO: `/v3/projects/1415d5493e784eb7919162a50f191476` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:02.753434 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8876bd8d-6850-42a7-a7e9-ed7922347445 admin admin] RBAC: Authorizing `identity:get_project(project_id=1415d5493e784eb7919162a50f191476)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:02.757031 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8876bd8d-6850-42a7-a7e9-ed7922347445 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:02.759612 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 83/157] 10.222.0.58 () {56 vars in 1207 bytes} [Tue Oct 12 16:37:02 2021] GET /identity/v3/projects/1415d5493e784eb7919162a50f191476 => generated 312 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:37:02.764055 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde825ae-8676-411f-b9cb-7622eeba360f admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:02.771792 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8876bd8d-6850-42a7-a7e9-ed7922347445 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:02.772902 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bbf32d-f391-4f47-8e21-92cf47c476c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:02.773765 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bbf32d-f391-4f47-8e21-92cf47c476c1 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:02.774083 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bbf32d-f391-4f47-8e21-92cf47c476c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:02.774371 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bbf32d-f391-4f47-8e21-92cf47c476c1 admin admin] PATH_INFO: `/v3/projects/78966be562ca4918a5e25eac86ccd8ab` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:02.775586 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bbf32d-f391-4f47-8e21-92cf47c476c1 admin admin] RBAC: Authorizing `identity:get_project(project_id=78966be562ca4918a5e25eac86ccd8ab)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:02.778215 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bbf32d-f391-4f47-8e21-92cf47c476c1 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:02.785274 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 75/158] 10.222.0.58 () {56 vars in 1207 bytes} [Tue Oct 12 16:37:02 2021] GET /identity/v3/projects/78966be562ca4918a5e25eac86ccd8ab => generated 298 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:37:02.787941 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bbf32d-f391-4f47-8e21-92cf47c476c1 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:02.796547 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8876bd8d-6850-42a7-a7e9-ed7922347445 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:02.803497 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bbf32d-f391-4f47-8e21-92cf47c476c1 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:02.806003 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a737ed-c33d-4d3a-b05e-85c88dd8b1c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:02.806672 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a737ed-c33d-4d3a-b05e-85c88dd8b1c7 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:02.806949 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a737ed-c33d-4d3a-b05e-85c88dd8b1c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:02.807266 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a737ed-c33d-4d3a-b05e-85c88dd8b1c7 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:02.808136 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a737ed-c33d-4d3a-b05e-85c88dd8b1c7 admin admin] RBAC: Adding query filter params (role.id=55ba49fe29884e64b57c3ad13188d554, scope.project.id=1415d5493e784eb7919162a50f191476, user.id=3e3ad764755947d6af5bc63c40f75cda) {{(pid=85204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:37:02.808450 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a737ed-c33d-4d3a-b05e-85c88dd8b1c7 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:02.811237 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a737ed-c33d-4d3a-b05e-85c88dd8b1c7 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:02.817407 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35108b46-cb72-48f8-a1f8-8e37615e60a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:02.818114 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35108b46-cb72-48f8-a1f8-8e37615e60a9 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:02.818402 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35108b46-cb72-48f8-a1f8-8e37615e60a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:02.818680 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35108b46-cb72-48f8-a1f8-8e37615e60a9 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:02.819587 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35108b46-cb72-48f8-a1f8-8e37615e60a9 admin admin] RBAC: Adding query filter params (role.id=55ba49fe29884e64b57c3ad13188d554, scope.project.id=78966be562ca4918a5e25eac86ccd8ab, user.id=3e3ad764755947d6af5bc63c40f75cda) {{(pid=85205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:37:02.819915 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35108b46-cb72-48f8-a1f8-8e37615e60a9 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:02.821756 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35108b46-cb72-48f8-a1f8-8e37615e60a9 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:02.824431 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 84/159] 10.222.0.58 () {56 vars in 1395 bytes} [Tue Oct 12 16:37:02 2021] GET /identity/v3/role_assignments?user.id=3e3ad764755947d6af5bc63c40f75cda&scope.project.id=1415d5493e784eb7919162a50f191476&role.id=55ba49fe29884e64b57c3ad13188d554 => generated 608 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:37:02.831209 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 76/160] 10.222.0.58 () {56 vars in 1395 bytes} [Tue Oct 12 16:37:02 2021] GET /identity/v3/role_assignments?user.id=3e3ad764755947d6af5bc63c40f75cda&scope.project.id=78966be562ca4918a5e25eac86ccd8ab&role.id=55ba49fe29884e64b57c3ad13188d554 => generated 608 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:37:03.473336 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaeb112f-01c7-4fea-a691-23a666e90158 None None] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:03.473861 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaeb112f-01c7-4fea-a691-23a666e90158 None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:03.473861 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaeb112f-01c7-4fea-a691-23a666e90158 None None] PATH_INFO: `/` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:03.475708 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 85/161] 10.222.0.58 () {54 vars in 926 bytes} [Tue Oct 12 16:37:03 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:37:03.482911 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f4719c-823d-4dc1-9940-fe6b1f46f11b None None] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:03.483965 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f4719c-823d-4dc1-9940-fe6b1f46f11b None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:03.484457 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f4719c-823d-4dc1-9940-fe6b1f46f11b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:03.506465 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.auth.core [None req-79f4719c-823d-4dc1-9940-fe6b1f46f11b None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:37:03.508155 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-79f4719c-823d-4dc1-9940-fe6b1f46f11b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:37:03.519656 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 77/162] 10.222.0.58 () {58 vars in 1023 bytes} [Tue Oct 12 16:37:03 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:37:03.544984 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaeb112f-01c7-4fea-a691-23a666e90158 None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:03.559398 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaeb112f-01c7-4fea-a691-23a666e90158 None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:03.566804 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3788b19d-1bf1-48ec-b2b3-07acdebbbd1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:03.567592 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3788b19d-1bf1-48ec-b2b3-07acdebbbd1a admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:03.567871 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3788b19d-1bf1-48ec-b2b3-07acdebbbd1a admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:03.568144 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3788b19d-1bf1-48ec-b2b3-07acdebbbd1a admin admin] PATH_INFO: `/v3/roles/member` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:03.582103 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3788b19d-1bf1-48ec-b2b3-07acdebbbd1a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 16:37:03.592439 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: WARNING keystone.server.flask.application [None req-3788b19d-1bf1-48ec-b2b3-07acdebbbd1a admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 12 16:37:03.593958 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 86/163] 10.222.0.58 () {56 vars in 1120 bytes} [Tue Oct 12 16:37:03 2021] GET /identity/v3/roles/member => generated 84 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:37:03.600335 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f4719c-823d-4dc1-9940-fe6b1f46f11b None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:03.614826 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f4719c-823d-4dc1-9940-fe6b1f46f11b None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:03.619656 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a213360-eede-4061-b305-6fd4aacd2670 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:03.620552 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a213360-eede-4061-b305-6fd4aacd2670 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:03.621059 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a213360-eede-4061-b305-6fd4aacd2670 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:03.621530 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a213360-eede-4061-b305-6fd4aacd2670 admin admin] PATH_INFO: `/v3/roles` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:03.622545 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a213360-eede-4061-b305-6fd4aacd2670 admin admin] RBAC: Adding query filter params (name=member) {{(pid=85205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:37:03.623057 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a213360-eede-4061-b305-6fd4aacd2670 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:03.624882 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a213360-eede-4061-b305-6fd4aacd2670 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:03.636908 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 78/164] 10.222.0.58 () {56 vars in 1122 bytes} [Tue Oct 12 16:37:03 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:37:03.642823 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3788b19d-1bf1-48ec-b2b3-07acdebbbd1a admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:03.654364 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3788b19d-1bf1-48ec-b2b3-07acdebbbd1a admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:03.662533 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9960cf6-826a-4f68-9d07-870418e3668a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:03.663460 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9960cf6-826a-4f68-9d07-870418e3668a admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:03.663742 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9960cf6-826a-4f68-9d07-870418e3668a admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:03.664068 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9960cf6-826a-4f68-9d07-870418e3668a admin admin] PATH_INFO: `/v3/users/36547cd3c64e4501b62c6e4de1b5c0a8` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:03.680309 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9960cf6-826a-4f68-9d07-870418e3668a admin admin] RBAC: Authorizing `identity:get_user(user_id=36547cd3c64e4501b62c6e4de1b5c0a8)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:03.682736 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9960cf6-826a-4f68-9d07-870418e3668a admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:03.684732 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 87/165] 10.222.0.58 () {56 vars in 1198 bytes} [Tue Oct 12 16:37:03 2021] GET /identity/v3/users/36547cd3c64e4501b62c6e4de1b5c0a8 => generated 283 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:37:03.690849 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a213360-eede-4061-b305-6fd4aacd2670 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:03.701357 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a213360-eede-4061-b305-6fd4aacd2670 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:03.707783 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c57eac7-23ec-4e25-8abf-d4363d2a02f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:03.708422 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c57eac7-23ec-4e25-8abf-d4363d2a02f8 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:03.708704 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c57eac7-23ec-4e25-8abf-d4363d2a02f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:03.709018 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c57eac7-23ec-4e25-8abf-d4363d2a02f8 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:03.719600 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c57eac7-23ec-4e25-8abf-d4363d2a02f8 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:03.722259 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c57eac7-23ec-4e25-8abf-d4363d2a02f8 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:03.732306 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 79/166] 10.222.0.58 () {58 vars in 1324 bytes} [Tue Oct 12 16:37:03 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:37:03.738371 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9960cf6-826a-4f68-9d07-870418e3668a admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:03.748447 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9960cf6-826a-4f68-9d07-870418e3668a admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:03.753680 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adfcde9-7a45-4b8d-a3fd-902d2a900935 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:03.754614 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adfcde9-7a45-4b8d-a3fd-902d2a900935 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:03.754879 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adfcde9-7a45-4b8d-a3fd-902d2a900935 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:03.755148 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adfcde9-7a45-4b8d-a3fd-902d2a900935 admin admin] PATH_INFO: `/v3/projects/2b6dd1730b03490493bf39ae8707f333` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:03.756361 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8adfcde9-7a45-4b8d-a3fd-902d2a900935 admin admin] RBAC: Authorizing `identity:get_project(project_id=2b6dd1730b03490493bf39ae8707f333)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:03.758504 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8adfcde9-7a45-4b8d-a3fd-902d2a900935 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:03.760937 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 88/167] 10.222.0.58 () {56 vars in 1207 bytes} [Tue Oct 12 16:37:03 2021] GET /identity/v3/projects/2b6dd1730b03490493bf39ae8707f333 => generated 302 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:37:03.767347 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c57eac7-23ec-4e25-8abf-d4363d2a02f8 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:03.777016 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c57eac7-23ec-4e25-8abf-d4363d2a02f8 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:03.781503 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943ba7f0-d495-4fc7-9ddc-55c47a0009f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:03.782173 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943ba7f0-d495-4fc7-9ddc-55c47a0009f8 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:03.782512 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943ba7f0-d495-4fc7-9ddc-55c47a0009f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:03.782790 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943ba7f0-d495-4fc7-9ddc-55c47a0009f8 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:03.783693 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943ba7f0-d495-4fc7-9ddc-55c47a0009f8 admin admin] RBAC: Adding query filter params (role.id=55ba49fe29884e64b57c3ad13188d554, scope.project.id=2b6dd1730b03490493bf39ae8707f333, user.id=36547cd3c64e4501b62c6e4de1b5c0a8) {{(pid=85205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:37:03.784005 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943ba7f0-d495-4fc7-9ddc-55c47a0009f8 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:03.785952 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943ba7f0-d495-4fc7-9ddc-55c47a0009f8 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:03.791722 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 80/168] 10.222.0.58 () {56 vars in 1395 bytes} [Tue Oct 12 16:37:03 2021] GET /identity/v3/role_assignments?user.id=36547cd3c64e4501b62c6e4de1b5c0a8&scope.project.id=2b6dd1730b03490493bf39ae8707f333&role.id=55ba49fe29884e64b57c3ad13188d554 => generated 259 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:37:03.980568 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5e23c4-a543-40fa-b377-725617dd3c14 None None] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:03.980921 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5e23c4-a543-40fa-b377-725617dd3c14 None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:03.981125 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5e23c4-a543-40fa-b377-725617dd3c14 None None] PATH_INFO: `/` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:03.983191 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 89/169] 10.222.0.58 () {54 vars in 926 bytes} [Tue Oct 12 16:37:03 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:37:03.989480 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef3495d-f702-4a60-a877-4e50a81b72d6 None None] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:03.989768 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef3495d-f702-4a60-a877-4e50a81b72d6 None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:03.990074 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef3495d-f702-4a60-a877-4e50a81b72d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:04.011619 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.auth.core [None req-6ef3495d-f702-4a60-a877-4e50a81b72d6 None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:37:04.013139 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-6ef3495d-f702-4a60-a877-4e50a81b72d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:37:04.025977 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 81/170] 10.222.0.58 () {58 vars in 1023 bytes} [Tue Oct 12 16:37:03 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:37:04.044851 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5e23c4-a543-40fa-b377-725617dd3c14 None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:04.058181 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5e23c4-a543-40fa-b377-725617dd3c14 None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:04.062743 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdf4a0a-d424-44d2-9738-49d65e70d919 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:04.063740 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdf4a0a-d424-44d2-9738-49d65e70d919 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:04.064163 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdf4a0a-d424-44d2-9738-49d65e70d919 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:04.064588 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdf4a0a-d424-44d2-9738-49d65e70d919 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:04.075903 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdf4a0a-d424-44d2-9738-49d65e70d919 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 16:37:04.083527 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: WARNING keystone.server.flask.application [None req-dfdf4a0a-d424-44d2-9738-49d65e70d919 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 16:37:04.084881 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 90/171] 10.222.0.58 () {56 vars in 1117 bytes} [Tue Oct 12 16:37:04 2021] GET /identity/v3/roles/admin => generated 83 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:37:04.091422 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef3495d-f702-4a60-a877-4e50a81b72d6 None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:04.100744 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef3495d-f702-4a60-a877-4e50a81b72d6 None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:04.105555 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01b9b86-712b-4e33-be83-a9cf8c5615a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:04.106467 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01b9b86-712b-4e33-be83-a9cf8c5615a2 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:04.106900 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01b9b86-712b-4e33-be83-a9cf8c5615a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:04.107310 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01b9b86-712b-4e33-be83-a9cf8c5615a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:04.108213 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01b9b86-712b-4e33-be83-a9cf8c5615a2 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=85205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:37:04.108654 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01b9b86-712b-4e33-be83-a9cf8c5615a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:04.110442 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01b9b86-712b-4e33-be83-a9cf8c5615a2 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:04.120259 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 82/172] 10.222.0.58 () {56 vars in 1120 bytes} [Tue Oct 12 16:37:04 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:37:04.126767 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdf4a0a-d424-44d2-9738-49d65e70d919 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:04.137840 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdf4a0a-d424-44d2-9738-49d65e70d919 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:04.142441 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b92c60-3f01-41f2-892d-491dbe8f5018 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:04.143522 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b92c60-3f01-41f2-892d-491dbe8f5018 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:04.143981 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b92c60-3f01-41f2-892d-491dbe8f5018 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:04.144389 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b92c60-3f01-41f2-892d-491dbe8f5018 admin admin] PATH_INFO: `/v3/users/296f95d6453b448dad63081ef9a200d3` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:04.145770 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b92c60-3f01-41f2-892d-491dbe8f5018 admin admin] RBAC: Authorizing `identity:get_user(user_id=296f95d6453b448dad63081ef9a200d3)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:04.147827 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b92c60-3f01-41f2-892d-491dbe8f5018 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:04.149610 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 91/173] 10.222.0.58 () {56 vars in 1198 bytes} [Tue Oct 12 16:37:04 2021] GET /identity/v3/users/296f95d6453b448dad63081ef9a200d3 => generated 247 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:37:04.155878 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01b9b86-712b-4e33-be83-a9cf8c5615a2 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:04.166119 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01b9b86-712b-4e33-be83-a9cf8c5615a2 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:04.170822 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130ae6a9-bed8-4dec-bf75-c6ad2c20d554 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:04.171617 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130ae6a9-bed8-4dec-bf75-c6ad2c20d554 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:04.172061 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130ae6a9-bed8-4dec-bf75-c6ad2c20d554 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:04.172472 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130ae6a9-bed8-4dec-bf75-c6ad2c20d554 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:04.181129 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130ae6a9-bed8-4dec-bf75-c6ad2c20d554 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:04.183678 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130ae6a9-bed8-4dec-bf75-c6ad2c20d554 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:04.192890 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 83/174] 10.222.0.58 () {58 vars in 1324 bytes} [Tue Oct 12 16:37:04 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:37:04.200096 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b92c60-3f01-41f2-892d-491dbe8f5018 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:04.210131 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b92c60-3f01-41f2-892d-491dbe8f5018 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:04.214814 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec32308-eb7f-48a0-a728-fe58c3f4e0c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:04.215805 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec32308-eb7f-48a0-a728-fe58c3f4e0c6 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:04.216224 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec32308-eb7f-48a0-a728-fe58c3f4e0c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:04.216661 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec32308-eb7f-48a0-a728-fe58c3f4e0c6 admin admin] PATH_INFO: `/v3/projects/2b6dd1730b03490493bf39ae8707f333` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:04.218288 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec32308-eb7f-48a0-a728-fe58c3f4e0c6 admin admin] RBAC: Authorizing `identity:get_project(project_id=2b6dd1730b03490493bf39ae8707f333)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:04.220550 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec32308-eb7f-48a0-a728-fe58c3f4e0c6 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:04.222443 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 92/175] 10.222.0.58 () {56 vars in 1207 bytes} [Tue Oct 12 16:37:04 2021] GET /identity/v3/projects/2b6dd1730b03490493bf39ae8707f333 => generated 302 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:37:04.229500 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130ae6a9-bed8-4dec-bf75-c6ad2c20d554 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:04.239830 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130ae6a9-bed8-4dec-bf75-c6ad2c20d554 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:04.245373 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461d0c3e-74d4-4dd5-9b1b-24f57fb97644 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:04.246305 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461d0c3e-74d4-4dd5-9b1b-24f57fb97644 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:04.246724 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461d0c3e-74d4-4dd5-9b1b-24f57fb97644 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:04.247214 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461d0c3e-74d4-4dd5-9b1b-24f57fb97644 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:04.248271 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461d0c3e-74d4-4dd5-9b1b-24f57fb97644 admin admin] RBAC: Adding query filter params (role.id=610824e4f50f4fb8954610e98c1de784, scope.project.id=2b6dd1730b03490493bf39ae8707f333, user.id=296f95d6453b448dad63081ef9a200d3) {{(pid=85205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:37:04.248727 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461d0c3e-74d4-4dd5-9b1b-24f57fb97644 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:04.251286 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461d0c3e-74d4-4dd5-9b1b-24f57fb97644 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:04.258113 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 84/176] 10.222.0.58 () {56 vars in 1395 bytes} [Tue Oct 12 16:37:04 2021] GET /identity/v3/role_assignments?user.id=296f95d6453b448dad63081ef9a200d3&scope.project.id=2b6dd1730b03490493bf39ae8707f333&role.id=610824e4f50f4fb8954610e98c1de784 => generated 259 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:37:04.385992 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224dd4b8-2194-4f85-acf5-8cdddf1f3189 None None] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:04.386440 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224dd4b8-2194-4f85-acf5-8cdddf1f3189 None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:04.386814 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224dd4b8-2194-4f85-acf5-8cdddf1f3189 None None] PATH_INFO: `/` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:04.388760 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 93/177] 10.222.0.58 () {54 vars in 926 bytes} [Tue Oct 12 16:37:04 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:37:04.395174 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0690e46-beed-46f5-9817-9b5189439486 None None] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:04.395453 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0690e46-beed-46f5-9817-9b5189439486 None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:04.395729 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0690e46-beed-46f5-9817-9b5189439486 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:04.414356 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.auth.core [None req-a0690e46-beed-46f5-9817-9b5189439486 None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:37:04.415573 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-a0690e46-beed-46f5-9817-9b5189439486 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:37:04.424400 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 85/178] 10.222.0.58 () {58 vars in 1023 bytes} [Tue Oct 12 16:37:04 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:37:04.448915 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224dd4b8-2194-4f85-acf5-8cdddf1f3189 None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:04.462119 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224dd4b8-2194-4f85-acf5-8cdddf1f3189 None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:04.466143 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a4e21a-a7be-4d1e-917a-adcc3c1fe9b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:04.466960 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a4e21a-a7be-4d1e-917a-adcc3c1fe9b0 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:04.467295 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a4e21a-a7be-4d1e-917a-adcc3c1fe9b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:04.467566 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a4e21a-a7be-4d1e-917a-adcc3c1fe9b0 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:04.468848 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a4e21a-a7be-4d1e-917a-adcc3c1fe9b0 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:04.470665 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a4e21a-a7be-4d1e-917a-adcc3c1fe9b0 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:04.472330 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 94/179] 10.222.0.58 () {56 vars in 1129 bytes} [Tue Oct 12 16:37:04 2021] GET /identity/v3/domains/default => generated 199 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:37:04.479488 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0690e46-beed-46f5-9817-9b5189439486 None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:04.489211 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0690e46-beed-46f5-9817-9b5189439486 None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:04.494292 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6e1601-61f2-4ff6-9433-22e0776334ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:04.495487 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6e1601-61f2-4ff6-9433-22e0776334ec admin admin] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:04.495771 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6e1601-61f2-4ff6-9433-22e0776334ec admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:04.496044 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6e1601-61f2-4ff6-9433-22e0776334ec admin admin] PATH_INFO: `/v3/groups` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:04.496779 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6e1601-61f2-4ff6-9433-22e0776334ec admin admin] RBAC: Authorizing `identity:create_group()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:04.498005 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: WARNING py.warnings [None req-8e6e1601-61f2-4ff6-9433-22e0776334ec admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:create_group failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 12 16:37:04.498005 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: warnings.warn(msg) Oct 12 16:37:04.498005 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: Oct 12 16:37:04.499185 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6e1601-61f2-4ff6-9433-22e0776334ec admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:04.516010 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 86/180] 10.222.0.58 () {60 vars in 1155 bytes} [Tue Oct 12 16:37:04 2021] POST /identity/v3/groups => generated 229 bytes in 38 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:37:04.623064 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b4b0eb-be1e-4a6d-8591-4101f93bccda None None] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:04.623731 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b4b0eb-be1e-4a6d-8591-4101f93bccda None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:04.623731 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b4b0eb-be1e-4a6d-8591-4101f93bccda None None] PATH_INFO: `/` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:04.625517 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 95/181] 10.222.0.58 () {54 vars in 926 bytes} [Tue Oct 12 16:37:04 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:37:04.632131 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8728256-20e7-4357-839d-64dbd6afc0e4 None None] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:04.632442 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8728256-20e7-4357-839d-64dbd6afc0e4 None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:04.632731 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8728256-20e7-4357-839d-64dbd6afc0e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:04.652719 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.auth.core [None req-b8728256-20e7-4357-839d-64dbd6afc0e4 None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:37:04.654120 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-b8728256-20e7-4357-839d-64dbd6afc0e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:37:04.662014 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 87/182] 10.222.0.58 () {58 vars in 1023 bytes} [Tue Oct 12 16:37:04 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:37:04.687475 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b4b0eb-be1e-4a6d-8591-4101f93bccda None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:04.699948 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b4b0eb-be1e-4a6d-8591-4101f93bccda None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:04.704319 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af607ddf-f4d1-4234-8c77-ffa05e982d96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:04.705132 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af607ddf-f4d1-4234-8c77-ffa05e982d96 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:04.705410 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af607ddf-f4d1-4234-8c77-ffa05e982d96 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:04.705685 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af607ddf-f4d1-4234-8c77-ffa05e982d96 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:04.717674 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af607ddf-f4d1-4234-8c77-ffa05e982d96 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 16:37:04.725391 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: WARNING keystone.server.flask.application [None req-af607ddf-f4d1-4234-8c77-ffa05e982d96 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 12 16:37:04.726719 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 96/183] 10.222.0.58 () {56 vars in 1135 bytes} [Tue Oct 12 16:37:04 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:37:04.733776 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8728256-20e7-4357-839d-64dbd6afc0e4 None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:04.743170 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8728256-20e7-4357-839d-64dbd6afc0e4 None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:04.747856 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164956fc-d9ed-441c-b191-9b2c576fe0a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:04.748461 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164956fc-d9ed-441c-b191-9b2c576fe0a9 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:04.748739 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164956fc-d9ed-441c-b191-9b2c576fe0a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:04.749012 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164956fc-d9ed-441c-b191-9b2c576fe0a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:04.749774 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164956fc-d9ed-441c-b191-9b2c576fe0a9 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=85205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:37:04.750114 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164956fc-d9ed-441c-b191-9b2c576fe0a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:04.751711 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164956fc-d9ed-441c-b191-9b2c576fe0a9 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:04.760934 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 88/184] 10.222.0.58 () {56 vars in 1132 bytes} [Tue Oct 12 16:37:04 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 16:37:04.767410 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af607ddf-f4d1-4234-8c77-ffa05e982d96 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:04.778816 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af607ddf-f4d1-4234-8c77-ffa05e982d96 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:04.783261 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c55980-5f5e-40cc-a3a8-7692246ad44d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:04.784163 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c55980-5f5e-40cc-a3a8-7692246ad44d admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:04.784443 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c55980-5f5e-40cc-a3a8-7692246ad44d admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:04.784717 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c55980-5f5e-40cc-a3a8-7692246ad44d admin admin] PATH_INFO: `/v3/users/36547cd3c64e4501b62c6e4de1b5c0a8` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:04.785968 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c55980-5f5e-40cc-a3a8-7692246ad44d admin admin] RBAC: Authorizing `identity:get_user(user_id=36547cd3c64e4501b62c6e4de1b5c0a8)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:04.788139 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c55980-5f5e-40cc-a3a8-7692246ad44d admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:04.789779 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 97/185] 10.222.0.58 () {56 vars in 1198 bytes} [Tue Oct 12 16:37:04 2021] GET /identity/v3/users/36547cd3c64e4501b62c6e4de1b5c0a8 => generated 283 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:37:04.796567 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164956fc-d9ed-441c-b191-9b2c576fe0a9 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:04.806454 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164956fc-d9ed-441c-b191-9b2c576fe0a9 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:04.813187 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f8ffe2-d3cf-495b-b3fb-9726562efb23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:04.814012 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f8ffe2-d3cf-495b-b3fb-9726562efb23 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:04.814292 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f8ffe2-d3cf-495b-b3fb-9726562efb23 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:04.814617 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f8ffe2-d3cf-495b-b3fb-9726562efb23 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:04.823128 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f8ffe2-d3cf-495b-b3fb-9726562efb23 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:04.825195 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f8ffe2-d3cf-495b-b3fb-9726562efb23 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:04.834225 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 89/186] 10.222.0.58 () {58 vars in 1324 bytes} [Tue Oct 12 16:37:04 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:37:04.841175 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c55980-5f5e-40cc-a3a8-7692246ad44d admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:04.850974 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c55980-5f5e-40cc-a3a8-7692246ad44d admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:04.856447 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099fea97-34c2-47ae-ab18-0cd4b64957f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:04.857289 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099fea97-34c2-47ae-ab18-0cd4b64957f3 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:04.857680 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099fea97-34c2-47ae-ab18-0cd4b64957f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:04.858040 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099fea97-34c2-47ae-ab18-0cd4b64957f3 admin admin] PATH_INFO: `/v3/projects/2b6dd1730b03490493bf39ae8707f333` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:04.859288 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099fea97-34c2-47ae-ab18-0cd4b64957f3 admin admin] RBAC: Authorizing `identity:get_project(project_id=2b6dd1730b03490493bf39ae8707f333)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:04.861312 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099fea97-34c2-47ae-ab18-0cd4b64957f3 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:04.863122 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 98/187] 10.222.0.58 () {56 vars in 1207 bytes} [Tue Oct 12 16:37:04 2021] GET /identity/v3/projects/2b6dd1730b03490493bf39ae8707f333 => generated 302 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 16:37:04.869691 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f8ffe2-d3cf-495b-b3fb-9726562efb23 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:04.878844 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f8ffe2-d3cf-495b-b3fb-9726562efb23 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:04.883430 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6e3e78-4994-4257-afd9-95e0bb86ac76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:04.884124 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6e3e78-4994-4257-afd9-95e0bb86ac76 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:04.884405 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6e3e78-4994-4257-afd9-95e0bb86ac76 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:04.884675 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6e3e78-4994-4257-afd9-95e0bb86ac76 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:04.885846 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6e3e78-4994-4257-afd9-95e0bb86ac76 admin admin] RBAC: Adding query filter params (role.id=638eb220c5a346cb8cf0e7128f938c65, scope.project.id=2b6dd1730b03490493bf39ae8707f333, user.id=36547cd3c64e4501b62c6e4de1b5c0a8) {{(pid=85205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:37:04.886190 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6e3e78-4994-4257-afd9-95e0bb86ac76 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:04.888083 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6e3e78-4994-4257-afd9-95e0bb86ac76 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:04.898014 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 90/188] 10.222.0.58 () {56 vars in 1395 bytes} [Tue Oct 12 16:37:04 2021] GET /identity/v3/role_assignments?user.id=36547cd3c64e4501b62c6e4de1b5c0a8&scope.project.id=2b6dd1730b03490493bf39ae8707f333&role.id=638eb220c5a346cb8cf0e7128f938c65 => generated 259 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:37:06.108969 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e909320b-0f0f-4fb4-9ebb-4618653257a8 None None] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:06.109633 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e909320b-0f0f-4fb4-9ebb-4618653257a8 None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:06.109633 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e909320b-0f0f-4fb4-9ebb-4618653257a8 None None] PATH_INFO: `/` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:06.111236 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 99/189] 10.222.0.58 () {54 vars in 926 bytes} [Tue Oct 12 16:37:06 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:37:06.116970 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e51c6cd-a74f-4360-88b2-55d7ba186ba5 None None] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:06.117447 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e51c6cd-a74f-4360-88b2-55d7ba186ba5 None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:06.117606 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e51c6cd-a74f-4360-88b2-55d7ba186ba5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:06.135779 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.auth.core [None req-5e51c6cd-a74f-4360-88b2-55d7ba186ba5 None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:37:06.136965 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-5e51c6cd-a74f-4360-88b2-55d7ba186ba5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:37:06.144670 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 91/190] 10.222.0.58 () {58 vars in 1023 bytes} [Tue Oct 12 16:37:06 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:37:06.168604 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e909320b-0f0f-4fb4-9ebb-4618653257a8 None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:06.181022 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e909320b-0f0f-4fb4-9ebb-4618653257a8 None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:06.185954 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6db6267-1c33-4ba7-85ee-d134edef336d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:06.186745 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6db6267-1c33-4ba7-85ee-d134edef336d admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:06.187027 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6db6267-1c33-4ba7-85ee-d134edef336d admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:06.187302 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6db6267-1c33-4ba7-85ee-d134edef336d admin admin] PATH_INFO: `/v3/roles/member` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:06.198522 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6db6267-1c33-4ba7-85ee-d134edef336d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 16:37:06.205453 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: WARNING keystone.server.flask.application [None req-e6db6267-1c33-4ba7-85ee-d134edef336d admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 12 16:37:06.206677 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 100/191] 10.222.0.58 () {56 vars in 1120 bytes} [Tue Oct 12 16:37:06 2021] GET /identity/v3/roles/member => generated 84 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:37:06.213513 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e51c6cd-a74f-4360-88b2-55d7ba186ba5 None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:06.222631 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e51c6cd-a74f-4360-88b2-55d7ba186ba5 None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:06.227157 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc81e002-15d1-4643-b835-1ce200547cba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:06.227828 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc81e002-15d1-4643-b835-1ce200547cba admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:06.228110 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc81e002-15d1-4643-b835-1ce200547cba admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:06.229263 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc81e002-15d1-4643-b835-1ce200547cba admin admin] PATH_INFO: `/v3/roles` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:06.230072 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc81e002-15d1-4643-b835-1ce200547cba admin admin] RBAC: Adding query filter params (name=member) {{(pid=85205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:37:06.230382 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc81e002-15d1-4643-b835-1ce200547cba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:06.231986 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc81e002-15d1-4643-b835-1ce200547cba admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:06.240668 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 92/192] 10.222.0.58 () {56 vars in 1122 bytes} [Tue Oct 12 16:37:06 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:37:06.246865 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6db6267-1c33-4ba7-85ee-d134edef336d admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:06.257125 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6db6267-1c33-4ba7-85ee-d134edef336d admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:06.261899 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dbbb0e-0a37-487b-9f7b-05fa9c36b69d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:06.262769 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dbbb0e-0a37-487b-9f7b-05fa9c36b69d admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:06.263055 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dbbb0e-0a37-487b-9f7b-05fa9c36b69d admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:06.263331 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dbbb0e-0a37-487b-9f7b-05fa9c36b69d admin admin] PATH_INFO: `/v3/users/36547cd3c64e4501b62c6e4de1b5c0a8` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:06.264550 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2dbbb0e-0a37-487b-9f7b-05fa9c36b69d admin admin] RBAC: Authorizing `identity:get_user(user_id=36547cd3c64e4501b62c6e4de1b5c0a8)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:06.266898 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2dbbb0e-0a37-487b-9f7b-05fa9c36b69d admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:06.268507 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 101/193] 10.222.0.58 () {56 vars in 1198 bytes} [Tue Oct 12 16:37:06 2021] GET /identity/v3/users/36547cd3c64e4501b62c6e4de1b5c0a8 => generated 283 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:37:06.274574 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc81e002-15d1-4643-b835-1ce200547cba admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:06.284749 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc81e002-15d1-4643-b835-1ce200547cba admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:06.289166 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd058da1-9639-4488-b685-06e5a87254db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:06.290042 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd058da1-9639-4488-b685-06e5a87254db admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:06.290324 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd058da1-9639-4488-b685-06e5a87254db admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:06.290600 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd058da1-9639-4488-b685-06e5a87254db admin admin] PATH_INFO: `/v3/projects/2b6dd1730b03490493bf39ae8707f333` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:06.291914 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd058da1-9639-4488-b685-06e5a87254db admin admin] RBAC: Authorizing `identity:get_project(project_id=2b6dd1730b03490493bf39ae8707f333)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:06.294032 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd058da1-9639-4488-b685-06e5a87254db admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:06.296248 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 93/194] 10.222.0.58 () {56 vars in 1207 bytes} [Tue Oct 12 16:37:06 2021] GET /identity/v3/projects/2b6dd1730b03490493bf39ae8707f333 => generated 302 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:37:06.302258 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dbbb0e-0a37-487b-9f7b-05fa9c36b69d admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:06.312543 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dbbb0e-0a37-487b-9f7b-05fa9c36b69d admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:06.316908 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d768c125-9c86-492b-aea8-cd201f03d4a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:06.317773 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d768c125-9c86-492b-aea8-cd201f03d4a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:06.318085 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d768c125-9c86-492b-aea8-cd201f03d4a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:06.318360 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d768c125-9c86-492b-aea8-cd201f03d4a9 admin admin] PATH_INFO: `/v3/projects/2b6dd1730b03490493bf39ae8707f333/users/36547cd3c64e4501b62c6e4de1b5c0a8/roles/55ba49fe29884e64b57c3ad13188d554` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:06.320323 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d768c125-9c86-492b-aea8-cd201f03d4a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b6dd1730b03490493bf39ae8707f333, user_id=36547cd3c64e4501b62c6e4de1b5c0a8, role_id=55ba49fe29884e64b57c3ad13188d554)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:06.322984 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d768c125-9c86-492b-aea8-cd201f03d4a9 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:06.338004 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 102/195] 10.222.0.58 () {58 vars in 1460 bytes} [Tue Oct 12 16:37:06 2021] PUT /identity/v3/projects/2b6dd1730b03490493bf39ae8707f333/users/36547cd3c64e4501b62c6e4de1b5c0a8/roles/55ba49fe29884e64b57c3ad13188d554 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 16:37:06.547675 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9294d5c-d177-412a-b61d-30385a25cdb0 None None] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:06.548048 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9294d5c-d177-412a-b61d-30385a25cdb0 None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:06.548220 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9294d5c-d177-412a-b61d-30385a25cdb0 None None] PATH_INFO: `/` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:06.550525 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 94/196] 10.222.0.58 () {54 vars in 926 bytes} [Tue Oct 12 16:37:06 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:37:06.556136 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bfcc15-3747-4f82-bb8a-58995c9f99e3 None None] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:06.556463 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bfcc15-3747-4f82-bb8a-58995c9f99e3 None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:06.556746 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bfcc15-3747-4f82-bb8a-58995c9f99e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:06.576990 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.auth.core [None req-40bfcc15-3747-4f82-bb8a-58995c9f99e3 None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:37:06.578212 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-40bfcc15-3747-4f82-bb8a-58995c9f99e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:37:06.636260 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 103/197] 10.222.0.58 () {58 vars in 1023 bytes} [Tue Oct 12 16:37:06 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:37:06.659451 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9294d5c-d177-412a-b61d-30385a25cdb0 None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:06.671719 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9294d5c-d177-412a-b61d-30385a25cdb0 None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:06.676056 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89634722-bc3f-4b1a-a46b-2f53601dd2f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:06.676836 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89634722-bc3f-4b1a-a46b-2f53601dd2f7 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:06.677119 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89634722-bc3f-4b1a-a46b-2f53601dd2f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:06.677394 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89634722-bc3f-4b1a-a46b-2f53601dd2f7 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:06.688817 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89634722-bc3f-4b1a-a46b-2f53601dd2f7 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 16:37:06.696063 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: WARNING keystone.server.flask.application [None req-89634722-bc3f-4b1a-a46b-2f53601dd2f7 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 16:37:06.698106 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 95/198] 10.222.0.58 () {56 vars in 1117 bytes} [Tue Oct 12 16:37:06 2021] GET /identity/v3/roles/admin => generated 83 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:37:06.704658 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bfcc15-3747-4f82-bb8a-58995c9f99e3 None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:06.714871 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bfcc15-3747-4f82-bb8a-58995c9f99e3 None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:06.719581 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6336967c-5280-4ca3-b303-6339cd2235c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:06.720339 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6336967c-5280-4ca3-b303-6339cd2235c1 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:06.720675 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6336967c-5280-4ca3-b303-6339cd2235c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:06.720957 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6336967c-5280-4ca3-b303-6339cd2235c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:06.721745 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6336967c-5280-4ca3-b303-6339cd2235c1 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=85204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:37:06.722089 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6336967c-5280-4ca3-b303-6339cd2235c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:06.723710 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6336967c-5280-4ca3-b303-6339cd2235c1 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:06.733217 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 104/199] 10.222.0.58 () {56 vars in 1120 bytes} [Tue Oct 12 16:37:06 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:37:06.739457 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89634722-bc3f-4b1a-a46b-2f53601dd2f7 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:06.752454 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89634722-bc3f-4b1a-a46b-2f53601dd2f7 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:06.756903 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec37e7f-6ecb-4558-bde0-2492294b1ee2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:06.757754 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec37e7f-6ecb-4558-bde0-2492294b1ee2 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:06.758056 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec37e7f-6ecb-4558-bde0-2492294b1ee2 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:06.758329 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec37e7f-6ecb-4558-bde0-2492294b1ee2 admin admin] PATH_INFO: `/v3/users/296f95d6453b448dad63081ef9a200d3` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:06.760106 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec37e7f-6ecb-4558-bde0-2492294b1ee2 admin admin] RBAC: Authorizing `identity:get_user(user_id=296f95d6453b448dad63081ef9a200d3)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:06.762045 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec37e7f-6ecb-4558-bde0-2492294b1ee2 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:06.764038 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 96/200] 10.222.0.58 () {56 vars in 1198 bytes} [Tue Oct 12 16:37:06 2021] GET /identity/v3/users/296f95d6453b448dad63081ef9a200d3 => generated 247 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:37:06.770299 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6336967c-5280-4ca3-b303-6339cd2235c1 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:06.780667 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6336967c-5280-4ca3-b303-6339cd2235c1 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:06.785189 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739750e1-6270-4ce2-9b15-75244055cd8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:06.786076 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739750e1-6270-4ce2-9b15-75244055cd8d admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:06.786414 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739750e1-6270-4ce2-9b15-75244055cd8d admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:06.786726 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739750e1-6270-4ce2-9b15-75244055cd8d admin admin] PATH_INFO: `/v3/projects/2b6dd1730b03490493bf39ae8707f333` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:06.787975 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739750e1-6270-4ce2-9b15-75244055cd8d admin admin] RBAC: Authorizing `identity:get_project(project_id=2b6dd1730b03490493bf39ae8707f333)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:06.790108 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739750e1-6270-4ce2-9b15-75244055cd8d admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:06.792126 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 105/201] 10.222.0.58 () {56 vars in 1207 bytes} [Tue Oct 12 16:37:06 2021] GET /identity/v3/projects/2b6dd1730b03490493bf39ae8707f333 => generated 302 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:37:06.798224 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec37e7f-6ecb-4558-bde0-2492294b1ee2 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:06.808674 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec37e7f-6ecb-4558-bde0-2492294b1ee2 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:06.813344 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d685f9cc-ce90-4cde-ae16-281eaef27bd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:06.814301 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d685f9cc-ce90-4cde-ae16-281eaef27bd2 admin admin] REQUEST_METHOD: `PUT` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:06.814578 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d685f9cc-ce90-4cde-ae16-281eaef27bd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:06.814848 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d685f9cc-ce90-4cde-ae16-281eaef27bd2 admin admin] PATH_INFO: `/v3/projects/2b6dd1730b03490493bf39ae8707f333/users/296f95d6453b448dad63081ef9a200d3/roles/610824e4f50f4fb8954610e98c1de784` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:06.816971 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d685f9cc-ce90-4cde-ae16-281eaef27bd2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b6dd1730b03490493bf39ae8707f333, user_id=296f95d6453b448dad63081ef9a200d3, role_id=610824e4f50f4fb8954610e98c1de784)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:06.819788 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d685f9cc-ce90-4cde-ae16-281eaef27bd2 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:06.835333 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 97/202] 10.222.0.58 () {58 vars in 1460 bytes} [Tue Oct 12 16:37:06 2021] PUT /identity/v3/projects/2b6dd1730b03490493bf39ae8707f333/users/296f95d6453b448dad63081ef9a200d3/roles/610824e4f50f4fb8954610e98c1de784 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:37:06.858698 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096db9c7-beba-4529-bb49-7601b7c3ddb8 None None] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:06.859012 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096db9c7-beba-4529-bb49-7601b7c3ddb8 None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:06.859251 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096db9c7-beba-4529-bb49-7601b7c3ddb8 None None] PATH_INFO: `/` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:06.861365 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 106/203] 10.222.0.58 () {54 vars in 926 bytes} [Tue Oct 12 16:37:06 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:37:06.867858 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8a0432-2fa2-47ec-b73b-85bceebc5b64 None None] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:06.868146 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8a0432-2fa2-47ec-b73b-85bceebc5b64 None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:06.868441 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8a0432-2fa2-47ec-b73b-85bceebc5b64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:06.892570 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.auth.core [None req-ef8a0432-2fa2-47ec-b73b-85bceebc5b64 None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:37:06.894558 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-ef8a0432-2fa2-47ec-b73b-85bceebc5b64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:37:06.960138 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 98/204] 10.222.0.58 () {58 vars in 1023 bytes} [Tue Oct 12 16:37:06 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:37:06.984525 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096db9c7-beba-4529-bb49-7601b7c3ddb8 None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:06.998405 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096db9c7-beba-4529-bb49-7601b7c3ddb8 None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:07.003254 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a19b4cd-862b-4a89-886b-b2a715cddff7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:07.004355 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a19b4cd-862b-4a89-886b-b2a715cddff7 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:07.004841 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a19b4cd-862b-4a89-886b-b2a715cddff7 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:07.005314 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a19b4cd-862b-4a89-886b-b2a715cddff7 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:07.006788 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a19b4cd-862b-4a89-886b-b2a715cddff7 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:07.008805 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a19b4cd-862b-4a89-886b-b2a715cddff7 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:07.011612 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 107/205] 10.222.0.58 () {56 vars in 1129 bytes} [Tue Oct 12 16:37:06 2021] GET /identity/v3/domains/default => generated 199 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:37:07.018292 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8a0432-2fa2-47ec-b73b-85bceebc5b64 None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:07.028377 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8a0432-2fa2-47ec-b73b-85bceebc5b64 None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:07.033554 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c57ada-c9d2-4513-a824-a76a33ed2f03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:07.034685 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c57ada-c9d2-4513-a824-a76a33ed2f03 admin admin] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:07.035173 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c57ada-c9d2-4513-a824-a76a33ed2f03 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:07.035646 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c57ada-c9d2-4513-a824-a76a33ed2f03 admin admin] PATH_INFO: `/v3/groups` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:07.036603 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c57ada-c9d2-4513-a824-a76a33ed2f03 admin admin] RBAC: Authorizing `identity:create_group()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:07.038850 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c57ada-c9d2-4513-a824-a76a33ed2f03 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:07.057562 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 99/206] 10.222.0.58 () {60 vars in 1155 bytes} [Tue Oct 12 16:37:07 2021] POST /identity/v3/groups => generated 226 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:37:07.184017 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a25552a-1f25-495c-a056-3eb86e9a32df None None] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:07.184532 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a25552a-1f25-495c-a056-3eb86e9a32df None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:07.184532 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a25552a-1f25-495c-a056-3eb86e9a32df None None] PATH_INFO: `/` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:07.186432 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 108/207] 10.222.0.58 () {54 vars in 926 bytes} [Tue Oct 12 16:37:07 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:37:07.193168 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b9fc96-dc4c-4c4d-aceb-f344af591a0e None None] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:07.193728 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b9fc96-dc4c-4c4d-aceb-f344af591a0e None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:07.193985 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b9fc96-dc4c-4c4d-aceb-f344af591a0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:07.215128 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.auth.core [None req-e7b9fc96-dc4c-4c4d-aceb-f344af591a0e None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:37:07.216390 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-e7b9fc96-dc4c-4c4d-aceb-f344af591a0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:37:07.224523 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 100/208] 10.222.0.58 () {58 vars in 1023 bytes} [Tue Oct 12 16:37:07 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:37:07.248916 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a25552a-1f25-495c-a056-3eb86e9a32df None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:07.263211 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a25552a-1f25-495c-a056-3eb86e9a32df None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:07.268827 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d732e8-244d-4d1a-b3e2-c232074d6855 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:07.269672 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d732e8-244d-4d1a-b3e2-c232074d6855 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:07.269999 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d732e8-244d-4d1a-b3e2-c232074d6855 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:07.270274 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d732e8-244d-4d1a-b3e2-c232074d6855 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:07.281696 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d732e8-244d-4d1a-b3e2-c232074d6855 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 16:37:07.289095 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: WARNING keystone.server.flask.application [None req-58d732e8-244d-4d1a-b3e2-c232074d6855 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 12 16:37:07.290550 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 109/209] 10.222.0.58 () {56 vars in 1135 bytes} [Tue Oct 12 16:37:07 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:37:07.296787 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b9fc96-dc4c-4c4d-aceb-f344af591a0e None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:07.307869 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b9fc96-dc4c-4c4d-aceb-f344af591a0e None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:07.312265 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6d06d6-32e0-426d-a488-f34b992f5348 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:07.312918 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6d06d6-32e0-426d-a488-f34b992f5348 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:07.313198 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6d06d6-32e0-426d-a488-f34b992f5348 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:07.313469 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6d06d6-32e0-426d-a488-f34b992f5348 admin admin] PATH_INFO: `/v3/roles` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:07.314262 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6d06d6-32e0-426d-a488-f34b992f5348 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=85205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:37:07.314566 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6d06d6-32e0-426d-a488-f34b992f5348 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:07.316136 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6d06d6-32e0-426d-a488-f34b992f5348 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:07.327656 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 101/210] 10.222.0.58 () {56 vars in 1132 bytes} [Tue Oct 12 16:37:07 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:37:07.334063 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d732e8-244d-4d1a-b3e2-c232074d6855 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:07.344940 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d732e8-244d-4d1a-b3e2-c232074d6855 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:07.350690 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa23f21e-4a92-4290-a1cf-a97686826135 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:07.351537 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa23f21e-4a92-4290-a1cf-a97686826135 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:07.351810 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa23f21e-4a92-4290-a1cf-a97686826135 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:07.352078 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa23f21e-4a92-4290-a1cf-a97686826135 admin admin] PATH_INFO: `/v3/users/36547cd3c64e4501b62c6e4de1b5c0a8` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:07.353817 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa23f21e-4a92-4290-a1cf-a97686826135 admin admin] RBAC: Authorizing `identity:get_user(user_id=36547cd3c64e4501b62c6e4de1b5c0a8)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:07.355959 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa23f21e-4a92-4290-a1cf-a97686826135 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:07.357843 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 110/211] 10.222.0.58 () {56 vars in 1198 bytes} [Tue Oct 12 16:37:07 2021] GET /identity/v3/users/36547cd3c64e4501b62c6e4de1b5c0a8 => generated 283 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:37:07.363828 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6d06d6-32e0-426d-a488-f34b992f5348 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:07.374432 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6d06d6-32e0-426d-a488-f34b992f5348 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:07.379427 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c5507e-385d-46c1-9ae0-f08d8ce37b2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:07.380273 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c5507e-385d-46c1-9ae0-f08d8ce37b2c admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:07.380611 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c5507e-385d-46c1-9ae0-f08d8ce37b2c admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:07.380883 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c5507e-385d-46c1-9ae0-f08d8ce37b2c admin admin] PATH_INFO: `/v3/projects/2b6dd1730b03490493bf39ae8707f333` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:07.382176 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c5507e-385d-46c1-9ae0-f08d8ce37b2c admin admin] RBAC: Authorizing `identity:get_project(project_id=2b6dd1730b03490493bf39ae8707f333)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:07.384357 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c5507e-385d-46c1-9ae0-f08d8ce37b2c admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:07.386344 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 102/212] 10.222.0.58 () {56 vars in 1207 bytes} [Tue Oct 12 16:37:07 2021] GET /identity/v3/projects/2b6dd1730b03490493bf39ae8707f333 => generated 302 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 16:37:07.392530 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa23f21e-4a92-4290-a1cf-a97686826135 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:07.402186 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa23f21e-4a92-4290-a1cf-a97686826135 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:07.406609 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622b2e4a-7e11-4bf7-8a1a-3f4c4419e1f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:07.407479 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622b2e4a-7e11-4bf7-8a1a-3f4c4419e1f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:07.407760 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622b2e4a-7e11-4bf7-8a1a-3f4c4419e1f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:07.408037 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622b2e4a-7e11-4bf7-8a1a-3f4c4419e1f5 admin admin] PATH_INFO: `/v3/projects/2b6dd1730b03490493bf39ae8707f333/users/36547cd3c64e4501b62c6e4de1b5c0a8/roles/638eb220c5a346cb8cf0e7128f938c65` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:07.410257 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622b2e4a-7e11-4bf7-8a1a-3f4c4419e1f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b6dd1730b03490493bf39ae8707f333, user_id=36547cd3c64e4501b62c6e4de1b5c0a8, role_id=638eb220c5a346cb8cf0e7128f938c65)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:07.412841 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622b2e4a-7e11-4bf7-8a1a-3f4c4419e1f5 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:07.429063 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 111/213] 10.222.0.58 () {58 vars in 1460 bytes} [Tue Oct 12 16:37:07 2021] PUT /identity/v3/projects/2b6dd1730b03490493bf39ae8707f333/users/36547cd3c64e4501b62c6e4de1b5c0a8/roles/638eb220c5a346cb8cf0e7128f938c65 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 16:37:08.768043 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c2cd6a-4c16-4c42-945a-6b3b2d52deac None None] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:08.769048 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c2cd6a-4c16-4c42-945a-6b3b2d52deac None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:08.769553 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c2cd6a-4c16-4c42-945a-6b3b2d52deac None None] PATH_INFO: `/` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:08.771564 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 103/214] 10.222.0.58 () {54 vars in 926 bytes} [Tue Oct 12 16:37:08 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:37:08.778339 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3d1276-2d70-4d8a-862e-a9c22317e41d None None] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:08.778776 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3d1276-2d70-4d8a-862e-a9c22317e41d None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:08.778972 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3d1276-2d70-4d8a-862e-a9c22317e41d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:08.811768 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.auth.core [None req-5f3d1276-2d70-4d8a-862e-a9c22317e41d None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:37:08.813000 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-5f3d1276-2d70-4d8a-862e-a9c22317e41d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:37:08.896148 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 112/215] 10.222.0.58 () {58 vars in 1023 bytes} [Tue Oct 12 16:37:08 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:37:08.936415 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c2cd6a-4c16-4c42-945a-6b3b2d52deac None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:08.954361 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c2cd6a-4c16-4c42-945a-6b3b2d52deac None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:08.963063 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfb9702-41a8-46e6-99f6-9d29de9d6cc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:08.964120 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfb9702-41a8-46e6-99f6-9d29de9d6cc5 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:08.964600 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfb9702-41a8-46e6-99f6-9d29de9d6cc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:08.965062 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfb9702-41a8-46e6-99f6-9d29de9d6cc5 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:08.983546 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfb9702-41a8-46e6-99f6-9d29de9d6cc5 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 16:37:08.990896 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: WARNING keystone.server.flask.application [None req-abfb9702-41a8-46e6-99f6-9d29de9d6cc5 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 12 16:37:08.992341 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 104/216] 10.222.0.58 () {56 vars in 1120 bytes} [Tue Oct 12 16:37:08 2021] GET /identity/v3/roles/member => generated 84 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:37:08.999398 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3d1276-2d70-4d8a-862e-a9c22317e41d None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:09.011072 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3d1276-2d70-4d8a-862e-a9c22317e41d None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:09.026700 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d9c7e2-9c6f-4ee6-98b1-421f245732db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:09.027331 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d9c7e2-9c6f-4ee6-98b1-421f245732db admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:09.027613 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d9c7e2-9c6f-4ee6-98b1-421f245732db admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:09.027891 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d9c7e2-9c6f-4ee6-98b1-421f245732db admin admin] PATH_INFO: `/v3/roles` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:09.028679 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d9c7e2-9c6f-4ee6-98b1-421f245732db admin admin] RBAC: Adding query filter params (name=member) {{(pid=85204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:37:09.028989 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d9c7e2-9c6f-4ee6-98b1-421f245732db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:09.030619 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d9c7e2-9c6f-4ee6-98b1-421f245732db admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:09.039697 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 113/217] 10.222.0.58 () {56 vars in 1122 bytes} [Tue Oct 12 16:37:08 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:37:09.046504 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfb9702-41a8-46e6-99f6-9d29de9d6cc5 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:09.061360 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfb9702-41a8-46e6-99f6-9d29de9d6cc5 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:09.066356 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724dee54-a88d-4496-a98d-3c3556a9639e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:09.067450 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724dee54-a88d-4496-a98d-3c3556a9639e admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:09.067926 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724dee54-a88d-4496-a98d-3c3556a9639e admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:09.068391 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724dee54-a88d-4496-a98d-3c3556a9639e admin admin] PATH_INFO: `/v3/users/36547cd3c64e4501b62c6e4de1b5c0a8` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:09.069908 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724dee54-a88d-4496-a98d-3c3556a9639e admin admin] RBAC: Authorizing `identity:get_user(user_id=36547cd3c64e4501b62c6e4de1b5c0a8)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:09.072279 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724dee54-a88d-4496-a98d-3c3556a9639e admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:09.074419 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 105/218] 10.222.0.58 () {56 vars in 1198 bytes} [Tue Oct 12 16:37:09 2021] GET /identity/v3/users/36547cd3c64e4501b62c6e4de1b5c0a8 => generated 283 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:37:09.080164 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d9c7e2-9c6f-4ee6-98b1-421f245732db admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:09.094990 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d9c7e2-9c6f-4ee6-98b1-421f245732db admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:09.103973 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05af4f53-97e0-440c-995c-db448d445dd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:09.104636 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05af4f53-97e0-440c-995c-db448d445dd1 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:09.104926 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05af4f53-97e0-440c-995c-db448d445dd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:09.105199 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05af4f53-97e0-440c-995c-db448d445dd1 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:09.118101 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05af4f53-97e0-440c-995c-db448d445dd1 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:09.120402 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05af4f53-97e0-440c-995c-db448d445dd1 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:09.136501 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 114/219] 10.222.0.58 () {58 vars in 1324 bytes} [Tue Oct 12 16:37:09 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:37:09.142567 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724dee54-a88d-4496-a98d-3c3556a9639e admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:09.153055 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724dee54-a88d-4496-a98d-3c3556a9639e admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:09.165697 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adba0ce-e8c6-40c1-9086-4078e6069be5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:09.166960 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adba0ce-e8c6-40c1-9086-4078e6069be5 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:09.167434 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adba0ce-e8c6-40c1-9086-4078e6069be5 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:09.167900 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adba0ce-e8c6-40c1-9086-4078e6069be5 admin admin] PATH_INFO: `/v3/projects/2b6dd1730b03490493bf39ae8707f333` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:09.170097 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7adba0ce-e8c6-40c1-9086-4078e6069be5 admin admin] RBAC: Authorizing `identity:get_project(project_id=2b6dd1730b03490493bf39ae8707f333)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:09.172331 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7adba0ce-e8c6-40c1-9086-4078e6069be5 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:09.174527 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 106/220] 10.222.0.58 () {56 vars in 1207 bytes} [Tue Oct 12 16:37:09 2021] GET /identity/v3/projects/2b6dd1730b03490493bf39ae8707f333 => generated 302 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:37:09.181176 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05af4f53-97e0-440c-995c-db448d445dd1 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:09.193324 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05af4f53-97e0-440c-995c-db448d445dd1 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:09.202500 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed921320-58ec-4d24-ba21-b6ed4660ac32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:09.203160 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed921320-58ec-4d24-ba21-b6ed4660ac32 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:09.203441 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed921320-58ec-4d24-ba21-b6ed4660ac32 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:09.203717 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed921320-58ec-4d24-ba21-b6ed4660ac32 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:09.204567 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed921320-58ec-4d24-ba21-b6ed4660ac32 admin admin] RBAC: Adding query filter params (role.id=55ba49fe29884e64b57c3ad13188d554, scope.project.id=2b6dd1730b03490493bf39ae8707f333, user.id=36547cd3c64e4501b62c6e4de1b5c0a8) {{(pid=85204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:37:09.204879 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed921320-58ec-4d24-ba21-b6ed4660ac32 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:09.206746 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed921320-58ec-4d24-ba21-b6ed4660ac32 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:09.213684 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 115/221] 10.222.0.58 () {56 vars in 1395 bytes} [Tue Oct 12 16:37:09 2021] GET /identity/v3/role_assignments?user.id=36547cd3c64e4501b62c6e4de1b5c0a8&scope.project.id=2b6dd1730b03490493bf39ae8707f333&role.id=55ba49fe29884e64b57c3ad13188d554 => generated 608 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:37:10.039830 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2c41ea-4304-48a9-a340-744f15643b29 None None] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:10.040782 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2c41ea-4304-48a9-a340-744f15643b29 None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:10.041324 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2c41ea-4304-48a9-a340-744f15643b29 None None] PATH_INFO: `/` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:10.043580 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 107/222] 10.222.0.58 () {54 vars in 926 bytes} [Tue Oct 12 16:37:10 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:37:10.049817 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3a89d7-5967-427b-8039-62ed687704b8 None None] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:10.050660 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3a89d7-5967-427b-8039-62ed687704b8 None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:10.051127 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3a89d7-5967-427b-8039-62ed687704b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:10.078346 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.auth.core [None req-3b3a89d7-5967-427b-8039-62ed687704b8 None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:37:10.079849 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-3b3a89d7-5967-427b-8039-62ed687704b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:37:10.093031 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 116/223] 10.222.0.58 () {58 vars in 1023 bytes} [Tue Oct 12 16:37:10 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Oct 12 16:37:10.135543 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2c41ea-4304-48a9-a340-744f15643b29 None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:10.151489 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2c41ea-4304-48a9-a340-744f15643b29 None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:10.156374 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0434cb52-fd0a-499c-8cfa-c04b1e834598 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:10.157430 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0434cb52-fd0a-499c-8cfa-c04b1e834598 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:10.157932 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0434cb52-fd0a-499c-8cfa-c04b1e834598 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:10.158397 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0434cb52-fd0a-499c-8cfa-c04b1e834598 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:10.175001 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0434cb52-fd0a-499c-8cfa-c04b1e834598 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 16:37:10.182778 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: WARNING keystone.server.flask.application [None req-0434cb52-fd0a-499c-8cfa-c04b1e834598 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 16:37:10.184208 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 108/224] 10.222.0.58 () {56 vars in 1117 bytes} [Tue Oct 12 16:37:10 2021] GET /identity/v3/roles/admin => generated 83 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:37:10.190986 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3a89d7-5967-427b-8039-62ed687704b8 None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:10.201069 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3a89d7-5967-427b-8039-62ed687704b8 None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:10.210880 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77ea971-b928-406b-b807-c874cad2dc5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:10.213793 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77ea971-b928-406b-b807-c874cad2dc5f admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:10.214466 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77ea971-b928-406b-b807-c874cad2dc5f admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:10.214934 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77ea971-b928-406b-b807-c874cad2dc5f admin admin] PATH_INFO: `/v3/roles` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:10.215918 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77ea971-b928-406b-b807-c874cad2dc5f admin admin] RBAC: Adding query filter params (name=admin) {{(pid=85204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:37:10.216416 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77ea971-b928-406b-b807-c874cad2dc5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:10.218245 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77ea971-b928-406b-b807-c874cad2dc5f admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:10.227611 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 117/225] 10.222.0.58 () {56 vars in 1120 bytes} [Tue Oct 12 16:37:10 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 16:37:10.234058 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0434cb52-fd0a-499c-8cfa-c04b1e834598 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:10.244681 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0434cb52-fd0a-499c-8cfa-c04b1e834598 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:10.254012 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3f9385-ffb1-4f25-85c6-7adc05b0a484 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:10.255160 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3f9385-ffb1-4f25-85c6-7adc05b0a484 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:10.255659 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3f9385-ffb1-4f25-85c6-7adc05b0a484 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:10.256139 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3f9385-ffb1-4f25-85c6-7adc05b0a484 admin admin] PATH_INFO: `/v3/users/296f95d6453b448dad63081ef9a200d3` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:10.257550 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3f9385-ffb1-4f25-85c6-7adc05b0a484 admin admin] RBAC: Authorizing `identity:get_user(user_id=296f95d6453b448dad63081ef9a200d3)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:10.260239 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3f9385-ffb1-4f25-85c6-7adc05b0a484 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:10.262413 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 109/226] 10.222.0.58 () {56 vars in 1198 bytes} [Tue Oct 12 16:37:10 2021] GET /identity/v3/users/296f95d6453b448dad63081ef9a200d3 => generated 247 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:37:10.268995 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77ea971-b928-406b-b807-c874cad2dc5f admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:10.279196 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77ea971-b928-406b-b807-c874cad2dc5f admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:10.290022 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a289e86-352e-4317-a535-a9507e64f828 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:10.290915 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a289e86-352e-4317-a535-a9507e64f828 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:10.291368 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a289e86-352e-4317-a535-a9507e64f828 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:10.291833 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a289e86-352e-4317-a535-a9507e64f828 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:10.300672 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a289e86-352e-4317-a535-a9507e64f828 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:10.302640 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a289e86-352e-4317-a535-a9507e64f828 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:10.316946 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 118/227] 10.222.0.58 () {58 vars in 1324 bytes} [Tue Oct 12 16:37:10 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:37:10.324033 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3f9385-ffb1-4f25-85c6-7adc05b0a484 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:10.334793 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3f9385-ffb1-4f25-85c6-7adc05b0a484 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:10.341949 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e059e75-2c87-45d0-9a30-d4397f1f713a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:10.343024 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e059e75-2c87-45d0-9a30-d4397f1f713a admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:10.343476 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e059e75-2c87-45d0-9a30-d4397f1f713a admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:10.343936 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e059e75-2c87-45d0-9a30-d4397f1f713a admin admin] PATH_INFO: `/v3/projects/2b6dd1730b03490493bf39ae8707f333` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:10.350817 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e059e75-2c87-45d0-9a30-d4397f1f713a admin admin] RBAC: Authorizing `identity:get_project(project_id=2b6dd1730b03490493bf39ae8707f333)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:10.353665 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e059e75-2c87-45d0-9a30-d4397f1f713a admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:10.356031 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 110/228] 10.222.0.58 () {56 vars in 1207 bytes} [Tue Oct 12 16:37:10 2021] GET /identity/v3/projects/2b6dd1730b03490493bf39ae8707f333 => generated 302 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:37:10.362912 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a289e86-352e-4317-a535-a9507e64f828 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:10.373408 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a289e86-352e-4317-a535-a9507e64f828 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:10.382305 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd435875-39f4-4e09-a08a-3c130653abc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:10.383285 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd435875-39f4-4e09-a08a-3c130653abc2 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:10.384040 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd435875-39f4-4e09-a08a-3c130653abc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:10.384485 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd435875-39f4-4e09-a08a-3c130653abc2 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:10.385523 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd435875-39f4-4e09-a08a-3c130653abc2 admin admin] RBAC: Adding query filter params (role.id=610824e4f50f4fb8954610e98c1de784, scope.project.id=2b6dd1730b03490493bf39ae8707f333, user.id=296f95d6453b448dad63081ef9a200d3) {{(pid=85204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:37:10.386073 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd435875-39f4-4e09-a08a-3c130653abc2 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:10.388134 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd435875-39f4-4e09-a08a-3c130653abc2 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:10.395378 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 119/229] 10.222.0.58 () {56 vars in 1395 bytes} [Tue Oct 12 16:37:10 2021] GET /identity/v3/role_assignments?user.id=296f95d6453b448dad63081ef9a200d3&scope.project.id=2b6dd1730b03490493bf39ae8707f333&role.id=610824e4f50f4fb8954610e98c1de784 => generated 608 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:37:10.677557 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b852debe-ca52-4d56-abc0-f77d2848ddfa None None] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:10.678252 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b852debe-ca52-4d56-abc0-f77d2848ddfa None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:10.678754 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b852debe-ca52-4d56-abc0-f77d2848ddfa None None] PATH_INFO: `/` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:10.681308 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 111/230] 10.222.0.58 () {54 vars in 926 bytes} [Tue Oct 12 16:37:10 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:37:10.688215 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b108a0db-a053-4203-bfc6-8e303337ea8b None None] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:10.688745 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b108a0db-a053-4203-bfc6-8e303337ea8b None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:10.689211 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b108a0db-a053-4203-bfc6-8e303337ea8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:10.712462 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.auth.core [None req-b108a0db-a053-4203-bfc6-8e303337ea8b None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:37:10.713985 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-b108a0db-a053-4203-bfc6-8e303337ea8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:37:10.722195 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 120/231] 10.222.0.58 () {58 vars in 1023 bytes} [Tue Oct 12 16:37:10 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:37:10.748886 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b852debe-ca52-4d56-abc0-f77d2848ddfa None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:10.767605 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b852debe-ca52-4d56-abc0-f77d2848ddfa None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:10.772596 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2946051a-2a7b-4f92-ae07-b7360170d5af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:10.773715 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2946051a-2a7b-4f92-ae07-b7360170d5af admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:10.774744 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2946051a-2a7b-4f92-ae07-b7360170d5af admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:10.775209 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2946051a-2a7b-4f92-ae07-b7360170d5af admin admin] PATH_INFO: `/v3/roles/member` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:10.795927 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2946051a-2a7b-4f92-ae07-b7360170d5af admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 16:37:10.803791 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: WARNING keystone.server.flask.application [None req-2946051a-2a7b-4f92-ae07-b7360170d5af admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 12 16:37:10.805359 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 112/232] 10.222.0.58 () {56 vars in 1120 bytes} [Tue Oct 12 16:37:10 2021] GET /identity/v3/roles/member => generated 84 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:37:10.813282 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b108a0db-a053-4203-bfc6-8e303337ea8b None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:10.820526 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915037f1-a24f-4f35-a2ba-cc4b68ffefe2 None None] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:10.821144 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915037f1-a24f-4f35-a2ba-cc4b68ffefe2 None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:10.821622 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915037f1-a24f-4f35-a2ba-cc4b68ffefe2 None None] PATH_INFO: `/` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:10.823683 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 113/233] 10.222.0.58 () {54 vars in 926 bytes} [Tue Oct 12 16:37:10 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:37:10.824907 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b108a0db-a053-4203-bfc6-8e303337ea8b None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:10.833826 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42407096-7c1f-4948-a759-0f97f89e8074 None None] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:10.834418 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42407096-7c1f-4948-a759-0f97f89e8074 None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:10.834901 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42407096-7c1f-4948-a759-0f97f89e8074 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:10.838532 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7910eef5-e0c3-4360-bac3-1e5602205c91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:10.839473 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7910eef5-e0c3-4360-bac3-1e5602205c91 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:10.839951 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7910eef5-e0c3-4360-bac3-1e5602205c91 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:10.840432 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7910eef5-e0c3-4360-bac3-1e5602205c91 admin admin] PATH_INFO: `/v3/roles` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:10.841395 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7910eef5-e0c3-4360-bac3-1e5602205c91 admin admin] RBAC: Adding query filter params (name=member) {{(pid=85204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:37:10.841915 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7910eef5-e0c3-4360-bac3-1e5602205c91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:10.843692 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7910eef5-e0c3-4360-bac3-1e5602205c91 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:10.857640 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 121/234] 10.222.0.58 () {56 vars in 1122 bytes} [Tue Oct 12 16:37:10 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:37:10.864265 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7910eef5-e0c3-4360-bac3-1e5602205c91 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:10.870849 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.auth.core [None req-42407096-7c1f-4948-a759-0f97f89e8074 None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:37:10.872227 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-42407096-7c1f-4948-a759-0f97f89e8074 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:37:10.874871 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7910eef5-e0c3-4360-bac3-1e5602205c91 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:10.886250 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db0c0aa-a0dc-4fa1-b03a-35f422fdf4be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:10.887203 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db0c0aa-a0dc-4fa1-b03a-35f422fdf4be admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:10.887690 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db0c0aa-a0dc-4fa1-b03a-35f422fdf4be admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:10.888173 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 114/235] 10.222.0.58 () {58 vars in 1023 bytes} [Tue Oct 12 16:37:10 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:37:10.888442 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db0c0aa-a0dc-4fa1-b03a-35f422fdf4be admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:10.902510 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db0c0aa-a0dc-4fa1-b03a-35f422fdf4be admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:10.904252 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db0c0aa-a0dc-4fa1-b03a-35f422fdf4be admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:10.913302 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 122/236] 10.222.0.58 () {58 vars in 1324 bytes} [Tue Oct 12 16:37:10 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:37:10.920083 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42407096-7c1f-4948-a759-0f97f89e8074 None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:10.932038 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42407096-7c1f-4948-a759-0f97f89e8074 None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:10.934030 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db0c0aa-a0dc-4fa1-b03a-35f422fdf4be admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:10.939681 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d38233-8034-42fe-b591-e867de18ab29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:10.940797 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d38233-8034-42fe-b591-e867de18ab29 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:10.941284 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d38233-8034-42fe-b591-e867de18ab29 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:10.941753 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d38233-8034-42fe-b591-e867de18ab29 admin admin] PATH_INFO: `/v3/projects/78966be562ca4918a5e25eac86ccd8ab` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:10.943637 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d38233-8034-42fe-b591-e867de18ab29 admin admin] RBAC: Authorizing `identity:get_project(project_id=78966be562ca4918a5e25eac86ccd8ab)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:10.945341 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db0c0aa-a0dc-4fa1-b03a-35f422fdf4be admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:10.946077 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d38233-8034-42fe-b591-e867de18ab29 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:10.948145 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 115/237] 10.222.0.58 () {56 vars in 1207 bytes} [Tue Oct 12 16:37:10 2021] GET /identity/v3/projects/78966be562ca4918a5e25eac86ccd8ab => generated 298 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:37:10.954154 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d38233-8034-42fe-b591-e867de18ab29 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:10.962841 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3758c84f-6d90-4890-926f-7c7c9d3c65c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:10.964495 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3758c84f-6d90-4890-926f-7c7c9d3c65c4 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:10.964923 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3758c84f-6d90-4890-926f-7c7c9d3c65c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:10.965341 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3758c84f-6d90-4890-926f-7c7c9d3c65c4 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:10.968024 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d38233-8034-42fe-b591-e867de18ab29 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:10.983324 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3758c84f-6d90-4890-926f-7c7c9d3c65c4 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 16:37:10.983597 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bec2f7-a83e-47d6-83ed-792535215c61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:10.984567 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bec2f7-a83e-47d6-83ed-792535215c61 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:10.984950 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bec2f7-a83e-47d6-83ed-792535215c61 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:10.985325 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bec2f7-a83e-47d6-83ed-792535215c61 admin admin] PATH_INFO: `/v3/groups/7cc7b98bdbe14160a3ad049cf9aa4639` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:10.991763 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: WARNING keystone.server.flask.application [None req-3758c84f-6d90-4890-926f-7c7c9d3c65c4 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 12 16:37:10.998297 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 123/238] 10.222.0.58 () {56 vars in 1135 bytes} [Tue Oct 12 16:37:10 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 16:37:11.000179 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3758c84f-6d90-4890-926f-7c7c9d3c65c4 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:11.001911 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bec2f7-a83e-47d6-83ed-792535215c61 admin admin] RBAC: Authorizing `identity:get_group(group_id=7cc7b98bdbe14160a3ad049cf9aa4639)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:11.003177 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: WARNING py.warnings [None req-14bec2f7-a83e-47d6-83ed-792535215c61 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:get_group failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 12 16:37:11.003177 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: warnings.warn(msg) Oct 12 16:37:11.003177 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: Oct 12 16:37:11.004714 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bec2f7-a83e-47d6-83ed-792535215c61 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:11.006674 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 116/239] 10.222.0.58 () {56 vars in 1201 bytes} [Tue Oct 12 16:37:10 2021] GET /identity/v3/groups/7cc7b98bdbe14160a3ad049cf9aa4639 => generated 226 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 16:37:11.011365 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3758c84f-6d90-4890-926f-7c7c9d3c65c4 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:11.018245 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bec2f7-a83e-47d6-83ed-792535215c61 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:11.021185 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f83556-6e72-47f6-96ce-06edee0a7b57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:11.021860 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f83556-6e72-47f6-96ce-06edee0a7b57 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:11.022248 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f83556-6e72-47f6-96ce-06edee0a7b57 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:11.022525 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f83556-6e72-47f6-96ce-06edee0a7b57 admin admin] PATH_INFO: `/v3/roles` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:11.023300 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f83556-6e72-47f6-96ce-06edee0a7b57 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=85204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:37:11.023610 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f83556-6e72-47f6-96ce-06edee0a7b57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:11.025757 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f83556-6e72-47f6-96ce-06edee0a7b57 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:11.039485 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 124/240] 10.222.0.58 () {56 vars in 1132 bytes} [Tue Oct 12 16:37:10 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 16:37:11.046487 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f83556-6e72-47f6-96ce-06edee0a7b57 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:11.048507 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bec2f7-a83e-47d6-83ed-792535215c61 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:11.056424 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f83556-6e72-47f6-96ce-06edee0a7b57 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:11.057599 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2aacef7-ddc3-4d44-af71-461ec6d3abd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:11.058530 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2aacef7-ddc3-4d44-af71-461ec6d3abd1 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:11.059016 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2aacef7-ddc3-4d44-af71-461ec6d3abd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:11.059516 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2aacef7-ddc3-4d44-af71-461ec6d3abd1 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:11.060587 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2aacef7-ddc3-4d44-af71-461ec6d3abd1 admin admin] RBAC: Adding query filter params (group.id=7cc7b98bdbe14160a3ad049cf9aa4639, role.id=55ba49fe29884e64b57c3ad13188d554, scope.project.id=78966be562ca4918a5e25eac86ccd8ab) {{(pid=85205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:37:11.061108 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2aacef7-ddc3-4d44-af71-461ec6d3abd1 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:11.063206 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2aacef7-ddc3-4d44-af71-461ec6d3abd1 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:11.071339 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085f662d-d19a-448a-a953-4ef59a888d30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:11.072146 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085f662d-d19a-448a-a953-4ef59a888d30 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:11.073065 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085f662d-d19a-448a-a953-4ef59a888d30 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:11.073348 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085f662d-d19a-448a-a953-4ef59a888d30 admin admin] PATH_INFO: `/v3/users/36547cd3c64e4501b62c6e4de1b5c0a8` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:11.074997 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085f662d-d19a-448a-a953-4ef59a888d30 admin admin] RBAC: Authorizing `identity:get_user(user_id=36547cd3c64e4501b62c6e4de1b5c0a8)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:11.076514 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 117/241] 10.222.0.58 () {56 vars in 1397 bytes} [Tue Oct 12 16:37:11 2021] GET /identity/v3/role_assignments?group.id=7cc7b98bdbe14160a3ad049cf9aa4639&scope.project.id=78966be562ca4918a5e25eac86ccd8ab&role.id=55ba49fe29884e64b57c3ad13188d554 => generated 260 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:37:11.077174 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085f662d-d19a-448a-a953-4ef59a888d30 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:11.079271 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 125/242] 10.222.0.58 () {56 vars in 1198 bytes} [Tue Oct 12 16:37:11 2021] GET /identity/v3/users/36547cd3c64e4501b62c6e4de1b5c0a8 => generated 283 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:37:11.088907 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2aacef7-ddc3-4d44-af71-461ec6d3abd1 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:11.107613 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2aacef7-ddc3-4d44-af71-461ec6d3abd1 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:11.118348 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ce32a8-5f82-4bc4-b217-0485bd5ccc65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:11.119408 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ce32a8-5f82-4bc4-b217-0485bd5ccc65 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:11.119893 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ce32a8-5f82-4bc4-b217-0485bd5ccc65 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:11.120367 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ce32a8-5f82-4bc4-b217-0485bd5ccc65 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:11.138000 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ce32a8-5f82-4bc4-b217-0485bd5ccc65 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:11.140072 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ce32a8-5f82-4bc4-b217-0485bd5ccc65 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:11.152391 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 118/243] 10.222.0.58 () {58 vars in 1324 bytes} [Tue Oct 12 16:37:11 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:37:11.158730 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085f662d-d19a-448a-a953-4ef59a888d30 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:11.172039 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085f662d-d19a-448a-a953-4ef59a888d30 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:11.185303 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a819bf0-3c3e-4ebe-b844-1c0c415c2faa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:11.186123 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a819bf0-3c3e-4ebe-b844-1c0c415c2faa admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:11.186405 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a819bf0-3c3e-4ebe-b844-1c0c415c2faa admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:11.186679 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a819bf0-3c3e-4ebe-b844-1c0c415c2faa admin admin] PATH_INFO: `/v3/projects/2b6dd1730b03490493bf39ae8707f333` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:11.190645 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a819bf0-3c3e-4ebe-b844-1c0c415c2faa admin admin] RBAC: Authorizing `identity:get_project(project_id=2b6dd1730b03490493bf39ae8707f333)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:11.192699 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a819bf0-3c3e-4ebe-b844-1c0c415c2faa admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:11.194771 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 126/244] 10.222.0.58 () {56 vars in 1207 bytes} [Tue Oct 12 16:37:11 2021] GET /identity/v3/projects/2b6dd1730b03490493bf39ae8707f333 => generated 302 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:37:11.201276 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ce32a8-5f82-4bc4-b217-0485bd5ccc65 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:11.215354 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ce32a8-5f82-4bc4-b217-0485bd5ccc65 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:11.222079 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66820b65-1904-4e64-9141-658cf8ccd02b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:11.222741 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66820b65-1904-4e64-9141-658cf8ccd02b admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:11.223040 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66820b65-1904-4e64-9141-658cf8ccd02b admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:11.223316 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66820b65-1904-4e64-9141-658cf8ccd02b admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:11.224167 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66820b65-1904-4e64-9141-658cf8ccd02b admin admin] RBAC: Adding query filter params (role.id=638eb220c5a346cb8cf0e7128f938c65, scope.project.id=2b6dd1730b03490493bf39ae8707f333, user.id=36547cd3c64e4501b62c6e4de1b5c0a8) {{(pid=85205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:37:11.224478 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66820b65-1904-4e64-9141-658cf8ccd02b admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:11.226471 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66820b65-1904-4e64-9141-658cf8ccd02b admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:11.239609 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 119/245] 10.222.0.58 () {56 vars in 1395 bytes} [Tue Oct 12 16:37:11 2021] GET /identity/v3/role_assignments?user.id=36547cd3c64e4501b62c6e4de1b5c0a8&scope.project.id=2b6dd1730b03490493bf39ae8707f333&role.id=638eb220c5a346cb8cf0e7128f938c65 => generated 608 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:37:11.253355 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d6fc44-da36-408d-a31a-c3dd65b3670a None None] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:11.253652 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d6fc44-da36-408d-a31a-c3dd65b3670a None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:11.253925 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d6fc44-da36-408d-a31a-c3dd65b3670a None None] PATH_INFO: `/` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:11.255700 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 127/246] 10.222.0.58 () {54 vars in 926 bytes} [Tue Oct 12 16:37:11 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:37:11.262807 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92d4ca2-7ffb-46b4-afda-b9d3f306ba04 None None] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:11.263137 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92d4ca2-7ffb-46b4-afda-b9d3f306ba04 None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:11.263417 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92d4ca2-7ffb-46b4-afda-b9d3f306ba04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:11.295722 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.auth.core [None req-a92d4ca2-7ffb-46b4-afda-b9d3f306ba04 None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:37:11.297028 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-a92d4ca2-7ffb-46b4-afda-b9d3f306ba04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:37:11.311710 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 120/247] 10.222.0.58 () {58 vars in 1023 bytes} [Tue Oct 12 16:37:11 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:37:11.353846 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d6fc44-da36-408d-a31a-c3dd65b3670a None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:11.375221 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d6fc44-da36-408d-a31a-c3dd65b3670a None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:11.379718 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1055681-7955-44f4-98bd-a3770b625314 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:11.380524 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1055681-7955-44f4-98bd-a3770b625314 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:11.380800 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1055681-7955-44f4-98bd-a3770b625314 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:11.381072 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1055681-7955-44f4-98bd-a3770b625314 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:11.403712 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1055681-7955-44f4-98bd-a3770b625314 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 16:37:11.412991 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: WARNING keystone.server.flask.application [None req-a1055681-7955-44f4-98bd-a3770b625314 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 12 16:37:11.415078 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 128/248] 10.222.0.58 () {56 vars in 1135 bytes} [Tue Oct 12 16:37:11 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:37:11.421350 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92d4ca2-7ffb-46b4-afda-b9d3f306ba04 None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:11.436370 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92d4ca2-7ffb-46b4-afda-b9d3f306ba04 None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:11.447600 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e80dac-187c-43f0-b1bd-c26c5f40ab13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:11.448328 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e80dac-187c-43f0-b1bd-c26c5f40ab13 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:11.448611 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e80dac-187c-43f0-b1bd-c26c5f40ab13 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:11.448886 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e80dac-187c-43f0-b1bd-c26c5f40ab13 admin admin] PATH_INFO: `/v3/roles` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:11.449676 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e80dac-187c-43f0-b1bd-c26c5f40ab13 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=85205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:37:11.450008 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e80dac-187c-43f0-b1bd-c26c5f40ab13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:11.451655 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e80dac-187c-43f0-b1bd-c26c5f40ab13 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:11.468046 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 121/249] 10.222.0.58 () {56 vars in 1132 bytes} [Tue Oct 12 16:37:11 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:37:11.474278 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1055681-7955-44f4-98bd-a3770b625314 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:11.485614 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1055681-7955-44f4-98bd-a3770b625314 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:11.497752 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fed5e4-0433-4069-8d6f-f5b52bae7ab7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:11.498463 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fed5e4-0433-4069-8d6f-f5b52bae7ab7 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:11.498739 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fed5e4-0433-4069-8d6f-f5b52bae7ab7 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:11.499010 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fed5e4-0433-4069-8d6f-f5b52bae7ab7 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:11.510544 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fed5e4-0433-4069-8d6f-f5b52bae7ab7 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:11.512718 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fed5e4-0433-4069-8d6f-f5b52bae7ab7 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:11.529574 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 129/250] 10.222.0.58 () {58 vars in 1324 bytes} [Tue Oct 12 16:37:11 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:37:11.537206 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e80dac-187c-43f0-b1bd-c26c5f40ab13 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:11.553024 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e80dac-187c-43f0-b1bd-c26c5f40ab13 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:11.567422 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169a6251-2ae9-4be4-b880-6419882a06cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:11.568319 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169a6251-2ae9-4be4-b880-6419882a06cb admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:11.568593 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169a6251-2ae9-4be4-b880-6419882a06cb admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:11.568863 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169a6251-2ae9-4be4-b880-6419882a06cb admin admin] PATH_INFO: `/v3/projects/78966be562ca4918a5e25eac86ccd8ab` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:11.570249 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169a6251-2ae9-4be4-b880-6419882a06cb admin admin] RBAC: Authorizing `identity:get_project(project_id=78966be562ca4918a5e25eac86ccd8ab)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:11.572542 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169a6251-2ae9-4be4-b880-6419882a06cb admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:11.574544 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 122/251] 10.222.0.58 () {56 vars in 1207 bytes} [Tue Oct 12 16:37:11 2021] GET /identity/v3/projects/78966be562ca4918a5e25eac86ccd8ab => generated 298 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:37:11.580754 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fed5e4-0433-4069-8d6f-f5b52bae7ab7 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:11.591023 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fed5e4-0433-4069-8d6f-f5b52bae7ab7 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:11.602876 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa67996-d8f5-4c02-a9d1-1aa214b9b378 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:11.604003 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa67996-d8f5-4c02-a9d1-1aa214b9b378 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:11.604432 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa67996-d8f5-4c02-a9d1-1aa214b9b378 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:11.604876 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa67996-d8f5-4c02-a9d1-1aa214b9b378 admin admin] PATH_INFO: `/v3/groups/7cc7b98bdbe14160a3ad049cf9aa4639` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:11.610787 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa67996-d8f5-4c02-a9d1-1aa214b9b378 admin admin] RBAC: Authorizing `identity:get_group(group_id=7cc7b98bdbe14160a3ad049cf9aa4639)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:11.612044 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: WARNING py.warnings [None req-7fa67996-d8f5-4c02-a9d1-1aa214b9b378 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:get_group failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 12 16:37:11.612044 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: warnings.warn(msg) Oct 12 16:37:11.612044 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: Oct 12 16:37:11.613541 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa67996-d8f5-4c02-a9d1-1aa214b9b378 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:11.615449 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 130/252] 10.222.0.58 () {56 vars in 1201 bytes} [Tue Oct 12 16:37:11 2021] GET /identity/v3/groups/7cc7b98bdbe14160a3ad049cf9aa4639 => generated 226 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:37:11.622178 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169a6251-2ae9-4be4-b880-6419882a06cb admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:11.635471 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169a6251-2ae9-4be4-b880-6419882a06cb admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:11.640292 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8e827a-8518-483e-b25c-b053b88730e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:11.641143 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8e827a-8518-483e-b25c-b053b88730e0 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:11.641570 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8e827a-8518-483e-b25c-b053b88730e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:11.642044 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8e827a-8518-483e-b25c-b053b88730e0 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:11.643034 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8e827a-8518-483e-b25c-b053b88730e0 admin admin] RBAC: Adding query filter params (group.id=7cc7b98bdbe14160a3ad049cf9aa4639, role.id=638eb220c5a346cb8cf0e7128f938c65, scope.project.id=78966be562ca4918a5e25eac86ccd8ab) {{(pid=85205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:37:11.643491 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8e827a-8518-483e-b25c-b053b88730e0 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:11.645555 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8e827a-8518-483e-b25c-b053b88730e0 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:11.653434 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 123/253] 10.222.0.58 () {56 vars in 1397 bytes} [Tue Oct 12 16:37:11 2021] GET /identity/v3/role_assignments?group.id=7cc7b98bdbe14160a3ad049cf9aa4639&scope.project.id=78966be562ca4918a5e25eac86ccd8ab&role.id=638eb220c5a346cb8cf0e7128f938c65 => generated 260 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:37:12.274713 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3a27f0-bfc0-478e-afb5-68084f8a7b97 None None] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:12.275730 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3a27f0-bfc0-478e-afb5-68084f8a7b97 None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:12.276241 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3a27f0-bfc0-478e-afb5-68084f8a7b97 None None] PATH_INFO: `/` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:12.278263 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 131/254] 10.222.0.58 () {54 vars in 926 bytes} [Tue Oct 12 16:37:12 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:37:12.284458 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bb36f9-98aa-456f-83be-66824668df6f None None] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:12.285278 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bb36f9-98aa-456f-83be-66824668df6f None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:12.285753 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bb36f9-98aa-456f-83be-66824668df6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:12.315029 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.auth.core [None req-81bb36f9-98aa-456f-83be-66824668df6f None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:37:12.316245 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-81bb36f9-98aa-456f-83be-66824668df6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:37:12.329610 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 124/255] 10.222.0.58 () {58 vars in 1023 bytes} [Tue Oct 12 16:37:12 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:37:12.371351 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3a27f0-bfc0-478e-afb5-68084f8a7b97 None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:12.389482 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3a27f0-bfc0-478e-afb5-68084f8a7b97 None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:12.398502 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661e619d-90cf-4c20-90ac-b95f2215b709 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:12.399667 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661e619d-90cf-4c20-90ac-b95f2215b709 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:12.400167 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661e619d-90cf-4c20-90ac-b95f2215b709 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:12.400652 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661e619d-90cf-4c20-90ac-b95f2215b709 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:12.414780 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661e619d-90cf-4c20-90ac-b95f2215b709 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 16:37:12.422008 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: WARNING keystone.server.flask.application [None req-661e619d-90cf-4c20-90ac-b95f2215b709 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 12 16:37:12.423749 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 132/256] 10.222.0.58 () {56 vars in 1120 bytes} [Tue Oct 12 16:37:12 2021] GET /identity/v3/roles/member => generated 84 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:37:12.430538 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bb36f9-98aa-456f-83be-66824668df6f None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:12.442914 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bb36f9-98aa-456f-83be-66824668df6f None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:12.452530 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffb100e-9d45-432f-8bcd-715f60c81a28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:12.453208 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffb100e-9d45-432f-8bcd-715f60c81a28 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:12.453493 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffb100e-9d45-432f-8bcd-715f60c81a28 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:12.453773 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffb100e-9d45-432f-8bcd-715f60c81a28 admin admin] PATH_INFO: `/v3/roles` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:12.454581 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffb100e-9d45-432f-8bcd-715f60c81a28 admin admin] RBAC: Adding query filter params (name=member) {{(pid=85205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:37:12.454892 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffb100e-9d45-432f-8bcd-715f60c81a28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:12.456629 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffb100e-9d45-432f-8bcd-715f60c81a28 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:12.472074 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 125/257] 10.222.0.58 () {56 vars in 1122 bytes} [Tue Oct 12 16:37:12 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:37:12.478454 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661e619d-90cf-4c20-90ac-b95f2215b709 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:12.488545 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661e619d-90cf-4c20-90ac-b95f2215b709 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:12.497953 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aacab4d-dd5d-445a-9172-71b8eed8c2b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:12.498861 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aacab4d-dd5d-445a-9172-71b8eed8c2b1 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:12.499342 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aacab4d-dd5d-445a-9172-71b8eed8c2b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:12.499836 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aacab4d-dd5d-445a-9172-71b8eed8c2b1 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:12.514820 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aacab4d-dd5d-445a-9172-71b8eed8c2b1 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:12.516783 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aacab4d-dd5d-445a-9172-71b8eed8c2b1 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:12.526028 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 133/258] 10.222.0.58 () {58 vars in 1324 bytes} [Tue Oct 12 16:37:12 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:37:12.532466 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffb100e-9d45-432f-8bcd-715f60c81a28 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:12.546796 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffb100e-9d45-432f-8bcd-715f60c81a28 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:12.556557 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4e22be-76d8-4fcc-a0eb-6370ad4d9a7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:12.557421 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4e22be-76d8-4fcc-a0eb-6370ad4d9a7c admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:12.557703 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4e22be-76d8-4fcc-a0eb-6370ad4d9a7c admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:12.558019 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4e22be-76d8-4fcc-a0eb-6370ad4d9a7c admin admin] PATH_INFO: `/v3/projects/2b6dd1730b03490493bf39ae8707f333` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:12.559230 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4e22be-76d8-4fcc-a0eb-6370ad4d9a7c admin admin] RBAC: Authorizing `identity:get_project(project_id=2b6dd1730b03490493bf39ae8707f333)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:12.561265 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4e22be-76d8-4fcc-a0eb-6370ad4d9a7c admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:12.562961 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 126/259] 10.222.0.58 () {56 vars in 1207 bytes} [Tue Oct 12 16:37:12 2021] GET /identity/v3/projects/2b6dd1730b03490493bf39ae8707f333 => generated 302 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:37:12.569110 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aacab4d-dd5d-445a-9172-71b8eed8c2b1 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:12.579107 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aacab4d-dd5d-445a-9172-71b8eed8c2b1 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:12.590040 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e78de62-0099-416f-a24d-bfb26e94aa79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:12.591139 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e78de62-0099-416f-a24d-bfb26e94aa79 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:12.591618 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e78de62-0099-416f-a24d-bfb26e94aa79 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:12.592085 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e78de62-0099-416f-a24d-bfb26e94aa79 admin admin] PATH_INFO: `/v3/groups/7cc7b98bdbe14160a3ad049cf9aa4639` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:12.594662 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e78de62-0099-416f-a24d-bfb26e94aa79 admin admin] RBAC: Authorizing `identity:get_group(group_id=7cc7b98bdbe14160a3ad049cf9aa4639)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:12.596625 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e78de62-0099-416f-a24d-bfb26e94aa79 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:12.598412 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 134/260] 10.222.0.58 () {56 vars in 1201 bytes} [Tue Oct 12 16:37:12 2021] GET /identity/v3/groups/7cc7b98bdbe14160a3ad049cf9aa4639 => generated 226 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:37:12.605832 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4e22be-76d8-4fcc-a0eb-6370ad4d9a7c admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:12.619609 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4e22be-76d8-4fcc-a0eb-6370ad4d9a7c admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:12.629500 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32c34a5-a2fe-4f02-a4f6-e358daf3ef59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:12.630368 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32c34a5-a2fe-4f02-a4f6-e358daf3ef59 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:12.630796 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32c34a5-a2fe-4f02-a4f6-e358daf3ef59 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:12.631216 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32c34a5-a2fe-4f02-a4f6-e358daf3ef59 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:12.632206 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32c34a5-a2fe-4f02-a4f6-e358daf3ef59 admin admin] RBAC: Adding query filter params (group.id=7cc7b98bdbe14160a3ad049cf9aa4639, role.id=55ba49fe29884e64b57c3ad13188d554, scope.project.id=2b6dd1730b03490493bf39ae8707f333) {{(pid=85205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:37:12.632688 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32c34a5-a2fe-4f02-a4f6-e358daf3ef59 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:12.634968 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32c34a5-a2fe-4f02-a4f6-e358daf3ef59 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:12.640987 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 127/261] 10.222.0.58 () {56 vars in 1397 bytes} [Tue Oct 12 16:37:12 2021] GET /identity/v3/role_assignments?group.id=7cc7b98bdbe14160a3ad049cf9aa4639&scope.project.id=2b6dd1730b03490493bf39ae8707f333&role.id=55ba49fe29884e64b57c3ad13188d554 => generated 260 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:37:12.971213 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbdf624-694e-4bff-8a29-570bd044c0e8 None None] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:12.971552 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbdf624-694e-4bff-8a29-570bd044c0e8 None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:12.971771 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbdf624-694e-4bff-8a29-570bd044c0e8 None None] PATH_INFO: `/` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:12.973548 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 135/262] 10.222.0.58 () {54 vars in 926 bytes} [Tue Oct 12 16:37:12 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:37:12.980897 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0279aef-2635-44f6-8cef-eec734cdbb7e None None] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:12.981486 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0279aef-2635-44f6-8cef-eec734cdbb7e None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:12.982021 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0279aef-2635-44f6-8cef-eec734cdbb7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:13.001515 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.auth.core [None req-a0279aef-2635-44f6-8cef-eec734cdbb7e None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:37:13.003036 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-a0279aef-2635-44f6-8cef-eec734cdbb7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:37:13.012588 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 128/263] 10.222.0.58 () {58 vars in 1023 bytes} [Tue Oct 12 16:37:12 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:37:13.038090 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbdf624-694e-4bff-8a29-570bd044c0e8 None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:13.055936 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbdf624-694e-4bff-8a29-570bd044c0e8 None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:13.063849 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45830044-ba29-4520-ac66-9d42eb7470bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:13.064596 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45830044-ba29-4520-ac66-9d42eb7470bc admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:13.064878 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45830044-ba29-4520-ac66-9d42eb7470bc admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:13.065155 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45830044-ba29-4520-ac66-9d42eb7470bc admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:13.078908 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45830044-ba29-4520-ac66-9d42eb7470bc admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 16:37:13.086755 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: WARNING keystone.server.flask.application [None req-45830044-ba29-4520-ac66-9d42eb7470bc admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 12 16:37:13.088276 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 136/264] 10.222.0.58 () {56 vars in 1135 bytes} [Tue Oct 12 16:37:13 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:37:13.094702 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0279aef-2635-44f6-8cef-eec734cdbb7e None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:13.108447 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0279aef-2635-44f6-8cef-eec734cdbb7e None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:13.117614 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d966ab-3836-452c-8b86-9632e9d16ebb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:13.118596 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d966ab-3836-452c-8b86-9632e9d16ebb admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:13.119076 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d966ab-3836-452c-8b86-9632e9d16ebb admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:13.119541 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d966ab-3836-452c-8b86-9632e9d16ebb admin admin] PATH_INFO: `/v3/roles` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:13.120502 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d966ab-3836-452c-8b86-9632e9d16ebb admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=85205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:37:13.121022 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d966ab-3836-452c-8b86-9632e9d16ebb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:13.122808 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d966ab-3836-452c-8b86-9632e9d16ebb admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:13.139044 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 129/265] 10.222.0.58 () {56 vars in 1132 bytes} [Tue Oct 12 16:37:13 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:37:13.148211 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45830044-ba29-4520-ac66-9d42eb7470bc admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:13.163517 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45830044-ba29-4520-ac66-9d42eb7470bc admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:13.173169 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cb763f-741e-45d4-b986-99f6a62ccc9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:13.173849 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cb763f-741e-45d4-b986-99f6a62ccc9f admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:13.174159 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cb763f-741e-45d4-b986-99f6a62ccc9f admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:13.174436 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cb763f-741e-45d4-b986-99f6a62ccc9f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:13.187243 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cb763f-741e-45d4-b986-99f6a62ccc9f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:13.189040 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cb763f-741e-45d4-b986-99f6a62ccc9f admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:13.204125 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 137/266] 10.222.0.58 () {58 vars in 1324 bytes} [Tue Oct 12 16:37:13 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:37:13.210553 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d966ab-3836-452c-8b86-9632e9d16ebb admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:13.227524 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d966ab-3836-452c-8b86-9632e9d16ebb admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:13.233436 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219b8c11-8e92-41c6-bead-a6be5309957e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:13.238625 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219b8c11-8e92-41c6-bead-a6be5309957e admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:13.239137 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219b8c11-8e92-41c6-bead-a6be5309957e admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:13.239615 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219b8c11-8e92-41c6-bead-a6be5309957e admin admin] PATH_INFO: `/v3/projects/2b6dd1730b03490493bf39ae8707f333` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:13.241078 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219b8c11-8e92-41c6-bead-a6be5309957e admin admin] RBAC: Authorizing `identity:get_project(project_id=2b6dd1730b03490493bf39ae8707f333)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:13.243376 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219b8c11-8e92-41c6-bead-a6be5309957e admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:13.245265 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 130/267] 10.222.0.58 () {56 vars in 1207 bytes} [Tue Oct 12 16:37:13 2021] GET /identity/v3/projects/2b6dd1730b03490493bf39ae8707f333 => generated 302 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:37:13.251382 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cb763f-741e-45d4-b986-99f6a62ccc9f admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:13.260818 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cb763f-741e-45d4-b986-99f6a62ccc9f admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:13.270016 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e380b3ab-5a61-400f-935a-5491bd53c76b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:13.270881 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e380b3ab-5a61-400f-935a-5491bd53c76b admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:13.271162 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e380b3ab-5a61-400f-935a-5491bd53c76b admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:13.271440 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e380b3ab-5a61-400f-935a-5491bd53c76b admin admin] PATH_INFO: `/v3/groups/7cc7b98bdbe14160a3ad049cf9aa4639` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:13.278638 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e380b3ab-5a61-400f-935a-5491bd53c76b admin admin] RBAC: Authorizing `identity:get_group(group_id=7cc7b98bdbe14160a3ad049cf9aa4639)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:13.280550 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e380b3ab-5a61-400f-935a-5491bd53c76b admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:13.282216 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 138/268] 10.222.0.58 () {56 vars in 1201 bytes} [Tue Oct 12 16:37:13 2021] GET /identity/v3/groups/7cc7b98bdbe14160a3ad049cf9aa4639 => generated 226 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:37:13.288582 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219b8c11-8e92-41c6-bead-a6be5309957e admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:13.302857 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219b8c11-8e92-41c6-bead-a6be5309957e admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:13.313587 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376289fe-414b-47b4-9e20-173519019792 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:13.314644 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376289fe-414b-47b4-9e20-173519019792 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:13.315131 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376289fe-414b-47b4-9e20-173519019792 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:13.315606 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376289fe-414b-47b4-9e20-173519019792 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:13.316853 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376289fe-414b-47b4-9e20-173519019792 admin admin] RBAC: Adding query filter params (group.id=7cc7b98bdbe14160a3ad049cf9aa4639, role.id=638eb220c5a346cb8cf0e7128f938c65, scope.project.id=2b6dd1730b03490493bf39ae8707f333) {{(pid=85205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:37:13.317457 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376289fe-414b-47b4-9e20-173519019792 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:13.319525 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376289fe-414b-47b4-9e20-173519019792 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:13.326345 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 131/269] 10.222.0.58 () {56 vars in 1397 bytes} [Tue Oct 12 16:37:13 2021] GET /identity/v3/role_assignments?group.id=7cc7b98bdbe14160a3ad049cf9aa4639&scope.project.id=2b6dd1730b03490493bf39ae8707f333&role.id=638eb220c5a346cb8cf0e7128f938c65 => generated 260 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:37:13.349503 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11f8601-1fe2-4674-a810-b3d0a6348970 None None] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:13.349790 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11f8601-1fe2-4674-a810-b3d0a6348970 None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:13.350293 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11f8601-1fe2-4674-a810-b3d0a6348970 None None] PATH_INFO: `/` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:13.352356 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 139/270] 10.222.0.58 () {54 vars in 926 bytes} [Tue Oct 12 16:37:13 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:37:13.359211 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0001696-24c8-4d3b-ad74-b0228bf14fb5 None None] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:13.359854 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0001696-24c8-4d3b-ad74-b0228bf14fb5 None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:13.360343 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0001696-24c8-4d3b-ad74-b0228bf14fb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:13.387067 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.auth.core [None req-f0001696-24c8-4d3b-ad74-b0228bf14fb5 None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:37:13.388663 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-f0001696-24c8-4d3b-ad74-b0228bf14fb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:37:13.396837 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 132/271] 10.222.0.58 () {58 vars in 1023 bytes} [Tue Oct 12 16:37:13 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:37:13.447452 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11f8601-1fe2-4674-a810-b3d0a6348970 None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:13.466758 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11f8601-1fe2-4674-a810-b3d0a6348970 None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:13.471249 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154b356f-538d-4df7-8dfe-b5a35061b482 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:13.472043 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154b356f-538d-4df7-8dfe-b5a35061b482 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:13.472326 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154b356f-538d-4df7-8dfe-b5a35061b482 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:13.472604 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154b356f-538d-4df7-8dfe-b5a35061b482 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:13.495683 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154b356f-538d-4df7-8dfe-b5a35061b482 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 16:37:13.508981 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: WARNING keystone.server.flask.application [None req-154b356f-538d-4df7-8dfe-b5a35061b482 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 16:37:13.510657 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 140/272] 10.222.0.58 () {56 vars in 1117 bytes} [Tue Oct 12 16:37:13 2021] GET /identity/v3/roles/admin => generated 83 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:37:13.518417 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0001696-24c8-4d3b-ad74-b0228bf14fb5 None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:13.536576 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0001696-24c8-4d3b-ad74-b0228bf14fb5 None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:13.546233 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f367eeb-b0ed-4ac8-b170-efca903cc2d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:13.547444 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f367eeb-b0ed-4ac8-b170-efca903cc2d1 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:13.547928 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f367eeb-b0ed-4ac8-b170-efca903cc2d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:13.548571 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f367eeb-b0ed-4ac8-b170-efca903cc2d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:13.550041 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f367eeb-b0ed-4ac8-b170-efca903cc2d1 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=85205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:37:13.550683 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f367eeb-b0ed-4ac8-b170-efca903cc2d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:13.552882 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f367eeb-b0ed-4ac8-b170-efca903cc2d1 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:13.569703 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 133/273] 10.222.0.58 () {56 vars in 1120 bytes} [Tue Oct 12 16:37:13 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:37:13.576887 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154b356f-538d-4df7-8dfe-b5a35061b482 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:13.587424 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154b356f-538d-4df7-8dfe-b5a35061b482 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:13.598028 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c9bd63-f11e-4a97-b6de-099a584d2ab3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:13.598695 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c9bd63-f11e-4a97-b6de-099a584d2ab3 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:13.598984 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c9bd63-f11e-4a97-b6de-099a584d2ab3 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:13.599262 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c9bd63-f11e-4a97-b6de-099a584d2ab3 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:13.614819 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c9bd63-f11e-4a97-b6de-099a584d2ab3 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:13.616570 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c9bd63-f11e-4a97-b6de-099a584d2ab3 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:13.625856 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 141/274] 10.222.0.58 () {58 vars in 1324 bytes} [Tue Oct 12 16:37:13 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:37:13.632075 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f367eeb-b0ed-4ac8-b170-efca903cc2d1 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:13.650317 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f367eeb-b0ed-4ac8-b170-efca903cc2d1 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:13.659852 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec31368-d695-45be-b21d-ae1dcd637a46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:13.661056 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec31368-d695-45be-b21d-ae1dcd637a46 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:13.661564 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec31368-d695-45be-b21d-ae1dcd637a46 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:13.662068 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec31368-d695-45be-b21d-ae1dcd637a46 admin admin] PATH_INFO: `/v3/projects/7ce3537317ae47bda54936a55a7d765e` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:13.663516 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec31368-d695-45be-b21d-ae1dcd637a46 admin admin] RBAC: Authorizing `identity:get_project(project_id=7ce3537317ae47bda54936a55a7d765e)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:13.665550 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec31368-d695-45be-b21d-ae1dcd637a46 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:13.667752 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 134/275] 10.222.0.58 () {56 vars in 1207 bytes} [Tue Oct 12 16:37:13 2021] GET /identity/v3/projects/7ce3537317ae47bda54936a55a7d765e => generated 344 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:37:13.673712 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c9bd63-f11e-4a97-b6de-099a584d2ab3 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:13.686929 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c9bd63-f11e-4a97-b6de-099a584d2ab3 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:13.694052 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fa5f38-7178-4b3c-9e9e-9af18cd8f8c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:13.694912 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fa5f38-7178-4b3c-9e9e-9af18cd8f8c6 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:13.695257 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fa5f38-7178-4b3c-9e9e-9af18cd8f8c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:13.696032 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fa5f38-7178-4b3c-9e9e-9af18cd8f8c6 admin admin] PATH_INFO: `/v3/groups/76b2026b4eff4a1cbccd99e70c63cd97` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:13.704334 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fa5f38-7178-4b3c-9e9e-9af18cd8f8c6 admin admin] RBAC: Authorizing `identity:get_group(group_id=76b2026b4eff4a1cbccd99e70c63cd97)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:13.706317 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fa5f38-7178-4b3c-9e9e-9af18cd8f8c6 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:13.707983 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 142/276] 10.222.0.58 () {56 vars in 1201 bytes} [Tue Oct 12 16:37:13 2021] GET /identity/v3/groups/76b2026b4eff4a1cbccd99e70c63cd97 => generated 229 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:37:13.715250 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec31368-d695-45be-b21d-ae1dcd637a46 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:13.731093 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec31368-d695-45be-b21d-ae1dcd637a46 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:13.741544 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca9b2dc-d763-4760-8670-7fcaddc7af9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:13.743072 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca9b2dc-d763-4760-8670-7fcaddc7af9a admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:13.743575 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca9b2dc-d763-4760-8670-7fcaddc7af9a admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:13.744050 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca9b2dc-d763-4760-8670-7fcaddc7af9a admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:13.745120 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca9b2dc-d763-4760-8670-7fcaddc7af9a admin admin] RBAC: Adding query filter params (group.id=76b2026b4eff4a1cbccd99e70c63cd97, role.id=610824e4f50f4fb8954610e98c1de784, scope.project.id=7ce3537317ae47bda54936a55a7d765e) {{(pid=85205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:37:13.745634 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca9b2dc-d763-4760-8670-7fcaddc7af9a admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:13.747683 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca9b2dc-d763-4760-8670-7fcaddc7af9a admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:13.754144 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 135/277] 10.222.0.58 () {56 vars in 1397 bytes} [Tue Oct 12 16:37:13 2021] GET /identity/v3/role_assignments?group.id=76b2026b4eff4a1cbccd99e70c63cd97&scope.project.id=7ce3537317ae47bda54936a55a7d765e&role.id=610824e4f50f4fb8954610e98c1de784 => generated 260 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:37:14.433832 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c645a4-26ec-4154-9311-10c48f82febc None None] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:14.434356 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c645a4-26ec-4154-9311-10c48f82febc None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:14.434431 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c645a4-26ec-4154-9311-10c48f82febc None None] PATH_INFO: `/` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:14.436522 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 143/278] 10.222.0.58 () {54 vars in 926 bytes} [Tue Oct 12 16:37:14 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:37:14.442782 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634c0895-12e8-40bb-abdb-6644613b8b0f None None] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:14.443653 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634c0895-12e8-40bb-abdb-6644613b8b0f None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:14.444129 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634c0895-12e8-40bb-abdb-6644613b8b0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:14.466014 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.auth.core [None req-634c0895-12e8-40bb-abdb-6644613b8b0f None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:37:14.467532 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-634c0895-12e8-40bb-abdb-6644613b8b0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:37:14.480303 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 136/279] 10.222.0.58 () {58 vars in 1023 bytes} [Tue Oct 12 16:37:14 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:37:14.525740 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c645a4-26ec-4154-9311-10c48f82febc None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:14.541546 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c645a4-26ec-4154-9311-10c48f82febc None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:14.546242 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc89dfc-de64-4abf-859a-39dec74a77ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:14.547276 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc89dfc-de64-4abf-859a-39dec74a77ab admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:14.547758 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc89dfc-de64-4abf-859a-39dec74a77ab admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:14.548251 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc89dfc-de64-4abf-859a-39dec74a77ab admin admin] PATH_INFO: `/v3/roles/member` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:14.563392 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc89dfc-de64-4abf-859a-39dec74a77ab admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 16:37:14.570687 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: WARNING keystone.server.flask.application [None req-efc89dfc-de64-4abf-859a-39dec74a77ab admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 12 16:37:14.572111 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 144/280] 10.222.0.58 () {56 vars in 1120 bytes} [Tue Oct 12 16:37:14 2021] GET /identity/v3/roles/member => generated 84 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:37:14.578910 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634c0895-12e8-40bb-abdb-6644613b8b0f None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:14.588993 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634c0895-12e8-40bb-abdb-6644613b8b0f None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:14.599973 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce6666e-bbe7-416c-b778-09e8d6307f43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:14.600656 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce6666e-bbe7-416c-b778-09e8d6307f43 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:14.600991 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce6666e-bbe7-416c-b778-09e8d6307f43 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:14.601825 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce6666e-bbe7-416c-b778-09e8d6307f43 admin admin] PATH_INFO: `/v3/roles` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:14.602699 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce6666e-bbe7-416c-b778-09e8d6307f43 admin admin] RBAC: Adding query filter params (name=member) {{(pid=85205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:37:14.603007 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce6666e-bbe7-416c-b778-09e8d6307f43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:14.604621 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce6666e-bbe7-416c-b778-09e8d6307f43 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:14.617957 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 137/281] 10.222.0.58 () {56 vars in 1122 bytes} [Tue Oct 12 16:37:14 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:37:14.619940 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc89dfc-de64-4abf-859a-39dec74a77ab admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:14.635159 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc89dfc-de64-4abf-859a-39dec74a77ab admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:14.645429 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221b8559-1a28-4952-920f-21057c750227 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:14.646652 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221b8559-1a28-4952-920f-21057c750227 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:14.647199 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221b8559-1a28-4952-920f-21057c750227 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:14.647696 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221b8559-1a28-4952-920f-21057c750227 admin admin] PATH_INFO: `/v3/groups/7cc7b98bdbe14160a3ad049cf9aa4639` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:14.649805 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221b8559-1a28-4952-920f-21057c750227 admin admin] RBAC: Authorizing `identity:get_group(group_id=7cc7b98bdbe14160a3ad049cf9aa4639)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:14.651959 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221b8559-1a28-4952-920f-21057c750227 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:14.654094 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 145/282] 10.222.0.58 () {56 vars in 1201 bytes} [Tue Oct 12 16:37:14 2021] GET /identity/v3/groups/7cc7b98bdbe14160a3ad049cf9aa4639 => generated 226 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:37:14.660720 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce6666e-bbe7-416c-b778-09e8d6307f43 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:14.671271 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce6666e-bbe7-416c-b778-09e8d6307f43 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:14.685298 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b7b410-d1da-41e2-be5a-b079c915163c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:14.686176 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b7b410-d1da-41e2-be5a-b079c915163c admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:14.686559 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b7b410-d1da-41e2-be5a-b079c915163c admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:14.686820 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b7b410-d1da-41e2-be5a-b079c915163c admin admin] PATH_INFO: `/v3/projects/78966be562ca4918a5e25eac86ccd8ab` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:14.688101 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b7b410-d1da-41e2-be5a-b079c915163c admin admin] RBAC: Authorizing `identity:get_project(project_id=78966be562ca4918a5e25eac86ccd8ab)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:14.690361 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b7b410-d1da-41e2-be5a-b079c915163c admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:14.692396 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 138/283] 10.222.0.58 () {56 vars in 1207 bytes} [Tue Oct 12 16:37:14 2021] GET /identity/v3/projects/78966be562ca4918a5e25eac86ccd8ab => generated 298 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 16:37:14.698465 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221b8559-1a28-4952-920f-21057c750227 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:14.708700 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221b8559-1a28-4952-920f-21057c750227 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:14.717999 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243170e1-b494-41a4-86b3-183b69068d52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:14.718884 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243170e1-b494-41a4-86b3-183b69068d52 admin admin] REQUEST_METHOD: `PUT` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:14.719165 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243170e1-b494-41a4-86b3-183b69068d52 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:14.719439 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243170e1-b494-41a4-86b3-183b69068d52 admin admin] PATH_INFO: `/v3/projects/78966be562ca4918a5e25eac86ccd8ab/groups/7cc7b98bdbe14160a3ad049cf9aa4639/roles/55ba49fe29884e64b57c3ad13188d554` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:14.724630 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243170e1-b494-41a4-86b3-183b69068d52 admin admin] RBAC: Authorizing `identity:create_grant(project_id=78966be562ca4918a5e25eac86ccd8ab, group_id=7cc7b98bdbe14160a3ad049cf9aa4639, role_id=55ba49fe29884e64b57c3ad13188d554)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:14.727839 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243170e1-b494-41a4-86b3-183b69068d52 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:14.747309 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 146/284] 10.222.0.58 () {58 vars in 1463 bytes} [Tue Oct 12 16:37:14 2021] PUT /identity/v3/projects/78966be562ca4918a5e25eac86ccd8ab/groups/7cc7b98bdbe14160a3ad049cf9aa4639/roles/55ba49fe29884e64b57c3ad13188d554 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:37:14.764496 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c8f014-164f-4653-9246-16fe77c02364 None None] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:14.764810 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c8f014-164f-4653-9246-16fe77c02364 None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:14.765152 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c8f014-164f-4653-9246-16fe77c02364 None None] PATH_INFO: `/` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:14.767217 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 139/285] 10.222.0.58 () {54 vars in 926 bytes} [Tue Oct 12 16:37:14 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:37:14.774392 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f402ccd-0c5a-4707-9767-2592b6f78ade None None] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:14.774685 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f402ccd-0c5a-4707-9767-2592b6f78ade None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:14.774961 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f402ccd-0c5a-4707-9767-2592b6f78ade None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:14.799038 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.auth.core [None req-9f402ccd-0c5a-4707-9767-2592b6f78ade None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:37:14.800259 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-9f402ccd-0c5a-4707-9767-2592b6f78ade None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:37:14.883392 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 147/286] 10.222.0.58 () {58 vars in 1023 bytes} [Tue Oct 12 16:37:14 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:37:14.915886 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c8f014-164f-4653-9246-16fe77c02364 None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:14.933447 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c8f014-164f-4653-9246-16fe77c02364 None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:14.940855 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08fad6f-5ca2-4f26-8a40-c62c5ac38cb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:14.941657 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08fad6f-5ca2-4f26-8a40-c62c5ac38cb4 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:14.941965 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08fad6f-5ca2-4f26-8a40-c62c5ac38cb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:14.942293 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08fad6f-5ca2-4f26-8a40-c62c5ac38cb4 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:14.960090 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08fad6f-5ca2-4f26-8a40-c62c5ac38cb4 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 16:37:14.968413 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: WARNING keystone.server.flask.application [None req-a08fad6f-5ca2-4f26-8a40-c62c5ac38cb4 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 12 16:37:14.969928 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 140/287] 10.222.0.58 () {56 vars in 1135 bytes} [Tue Oct 12 16:37:14 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:37:14.976641 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f402ccd-0c5a-4707-9767-2592b6f78ade None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:14.986035 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f402ccd-0c5a-4707-9767-2592b6f78ade None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:15.001364 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31463dad-6071-4489-9889-9a6e09ccd651 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:15.002086 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31463dad-6071-4489-9889-9a6e09ccd651 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:15.002367 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31463dad-6071-4489-9889-9a6e09ccd651 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:15.002636 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31463dad-6071-4489-9889-9a6e09ccd651 admin admin] PATH_INFO: `/v3/roles` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:15.003414 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31463dad-6071-4489-9889-9a6e09ccd651 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=85204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:37:15.003720 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31463dad-6071-4489-9889-9a6e09ccd651 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:15.005338 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31463dad-6071-4489-9889-9a6e09ccd651 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:15.021992 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 148/288] 10.222.0.58 () {56 vars in 1132 bytes} [Tue Oct 12 16:37:14 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:37:15.025410 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08fad6f-5ca2-4f26-8a40-c62c5ac38cb4 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:15.037979 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08fad6f-5ca2-4f26-8a40-c62c5ac38cb4 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:15.049984 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1a8df5-1ba0-4f84-a8f1-f13b701445e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:15.050854 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1a8df5-1ba0-4f84-a8f1-f13b701445e0 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:15.051133 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1a8df5-1ba0-4f84-a8f1-f13b701445e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:15.052750 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1a8df5-1ba0-4f84-a8f1-f13b701445e0 admin admin] PATH_INFO: `/v3/groups/7cc7b98bdbe14160a3ad049cf9aa4639` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:15.053806 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1a8df5-1ba0-4f84-a8f1-f13b701445e0 admin admin] RBAC: Authorizing `identity:get_group(group_id=7cc7b98bdbe14160a3ad049cf9aa4639)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:15.056073 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1a8df5-1ba0-4f84-a8f1-f13b701445e0 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:15.058264 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 141/289] 10.222.0.58 () {56 vars in 1201 bytes} [Tue Oct 12 16:37:15 2021] GET /identity/v3/groups/7cc7b98bdbe14160a3ad049cf9aa4639 => generated 226 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:37:15.064610 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31463dad-6071-4489-9889-9a6e09ccd651 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:15.075042 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31463dad-6071-4489-9889-9a6e09ccd651 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:15.085682 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4c3d29-f2fd-4254-b2f2-1c3ddcf16f1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:15.087589 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4c3d29-f2fd-4254-b2f2-1c3ddcf16f1d admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:15.088102 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4c3d29-f2fd-4254-b2f2-1c3ddcf16f1d admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:15.088594 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4c3d29-f2fd-4254-b2f2-1c3ddcf16f1d admin admin] PATH_INFO: `/v3/projects/78966be562ca4918a5e25eac86ccd8ab` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:15.090068 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4c3d29-f2fd-4254-b2f2-1c3ddcf16f1d admin admin] RBAC: Authorizing `identity:get_project(project_id=78966be562ca4918a5e25eac86ccd8ab)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:15.092301 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4c3d29-f2fd-4254-b2f2-1c3ddcf16f1d admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:15.094666 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 149/290] 10.222.0.58 () {56 vars in 1207 bytes} [Tue Oct 12 16:37:15 2021] GET /identity/v3/projects/78966be562ca4918a5e25eac86ccd8ab => generated 298 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:37:15.101206 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1a8df5-1ba0-4f84-a8f1-f13b701445e0 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:15.111360 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1a8df5-1ba0-4f84-a8f1-f13b701445e0 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:15.116221 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fe1350-13cf-4670-bcdc-1f32c3faf4f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:15.117407 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fe1350-13cf-4670-bcdc-1f32c3faf4f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:15.117966 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fe1350-13cf-4670-bcdc-1f32c3faf4f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:15.118532 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fe1350-13cf-4670-bcdc-1f32c3faf4f9 admin admin] PATH_INFO: `/v3/projects/78966be562ca4918a5e25eac86ccd8ab/groups/7cc7b98bdbe14160a3ad049cf9aa4639/roles/638eb220c5a346cb8cf0e7128f938c65` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:15.121291 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fe1350-13cf-4670-bcdc-1f32c3faf4f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=78966be562ca4918a5e25eac86ccd8ab, group_id=7cc7b98bdbe14160a3ad049cf9aa4639, role_id=638eb220c5a346cb8cf0e7128f938c65)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:15.124309 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fe1350-13cf-4670-bcdc-1f32c3faf4f9 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:15.140799 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 142/291] 10.222.0.58 () {58 vars in 1463 bytes} [Tue Oct 12 16:37:15 2021] PUT /identity/v3/projects/78966be562ca4918a5e25eac86ccd8ab/groups/7cc7b98bdbe14160a3ad049cf9aa4639/roles/638eb220c5a346cb8cf0e7128f938c65 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:37:15.505439 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2861d55f-e094-472b-9829-7964340a26f9 None None] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:15.506525 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2861d55f-e094-472b-9829-7964340a26f9 None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:15.507014 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2861d55f-e094-472b-9829-7964340a26f9 None None] PATH_INFO: `/` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:15.510141 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 150/292] 10.222.0.58 () {54 vars in 926 bytes} [Tue Oct 12 16:37:15 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:37:15.515845 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a5582e-0324-4f56-93b5-294e28d16aeb None None] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:15.516784 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a5582e-0324-4f56-93b5-294e28d16aeb None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:15.517258 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a5582e-0324-4f56-93b5-294e28d16aeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:15.541198 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.auth.core [None req-d9a5582e-0324-4f56-93b5-294e28d16aeb None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:37:15.542769 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-d9a5582e-0324-4f56-93b5-294e28d16aeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:37:15.609229 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 143/293] 10.222.0.58 () {58 vars in 1023 bytes} [Tue Oct 12 16:37:15 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:37:15.636727 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2861d55f-e094-472b-9829-7964340a26f9 None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:15.651236 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2861d55f-e094-472b-9829-7964340a26f9 None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:15.656640 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f246f14-f507-402e-af4a-07513db4eb4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:15.657438 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f246f14-f507-402e-af4a-07513db4eb4f admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:15.657776 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f246f14-f507-402e-af4a-07513db4eb4f admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:15.658083 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f246f14-f507-402e-af4a-07513db4eb4f admin admin] PATH_INFO: `/v3/roles/member` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:15.678840 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f246f14-f507-402e-af4a-07513db4eb4f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 16:37:15.686504 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: WARNING keystone.server.flask.application [None req-2f246f14-f507-402e-af4a-07513db4eb4f admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 12 16:37:15.688077 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 151/294] 10.222.0.58 () {56 vars in 1120 bytes} [Tue Oct 12 16:37:15 2021] GET /identity/v3/roles/member => generated 84 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:37:15.694444 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a5582e-0324-4f56-93b5-294e28d16aeb None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:15.703916 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a5582e-0324-4f56-93b5-294e28d16aeb None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:15.713055 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b159a91-106f-48b1-a1e1-049d7ab49f07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:15.714037 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b159a91-106f-48b1-a1e1-049d7ab49f07 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:15.714523 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b159a91-106f-48b1-a1e1-049d7ab49f07 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:15.714992 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b159a91-106f-48b1-a1e1-049d7ab49f07 admin admin] PATH_INFO: `/v3/roles` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:15.716039 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b159a91-106f-48b1-a1e1-049d7ab49f07 admin admin] RBAC: Adding query filter params (name=member) {{(pid=85205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:37:15.716546 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b159a91-106f-48b1-a1e1-049d7ab49f07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:15.718387 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b159a91-106f-48b1-a1e1-049d7ab49f07 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:15.732106 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 144/295] 10.222.0.58 () {56 vars in 1122 bytes} [Tue Oct 12 16:37:15 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:37:15.749626 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f246f14-f507-402e-af4a-07513db4eb4f admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:15.902483 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f246f14-f507-402e-af4a-07513db4eb4f admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:15.907577 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e525ee94-d399-4517-85cb-116f96378e75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:15.908419 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e525ee94-d399-4517-85cb-116f96378e75 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:15.908702 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e525ee94-d399-4517-85cb-116f96378e75 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:15.908980 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e525ee94-d399-4517-85cb-116f96378e75 admin admin] PATH_INFO: `/v3/groups/7cc7b98bdbe14160a3ad049cf9aa4639` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:15.910230 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e525ee94-d399-4517-85cb-116f96378e75 admin admin] RBAC: Authorizing `identity:get_group(group_id=7cc7b98bdbe14160a3ad049cf9aa4639)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:15.912070 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e525ee94-d399-4517-85cb-116f96378e75 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:15.914531 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 152/296] 10.222.0.58 () {56 vars in 1201 bytes} [Tue Oct 12 16:37:15 2021] GET /identity/v3/groups/7cc7b98bdbe14160a3ad049cf9aa4639 => generated 226 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:37:15.920649 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b159a91-106f-48b1-a1e1-049d7ab49f07 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:15.931070 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b159a91-106f-48b1-a1e1-049d7ab49f07 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:15.937436 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9027e308-fd8a-4083-ad2a-f69696d35487 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:15.938383 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9027e308-fd8a-4083-ad2a-f69696d35487 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:15.938665 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9027e308-fd8a-4083-ad2a-f69696d35487 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:15.938985 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9027e308-fd8a-4083-ad2a-f69696d35487 admin admin] PATH_INFO: `/v3/projects/2b6dd1730b03490493bf39ae8707f333` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:15.940364 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9027e308-fd8a-4083-ad2a-f69696d35487 admin admin] RBAC: Authorizing `identity:get_project(project_id=2b6dd1730b03490493bf39ae8707f333)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:15.942585 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9027e308-fd8a-4083-ad2a-f69696d35487 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:15.944288 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 145/297] 10.222.0.58 () {56 vars in 1207 bytes} [Tue Oct 12 16:37:15 2021] GET /identity/v3/projects/2b6dd1730b03490493bf39ae8707f333 => generated 302 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:37:15.950806 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e525ee94-d399-4517-85cb-116f96378e75 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:15.961472 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e525ee94-d399-4517-85cb-116f96378e75 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:15.966114 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df4c741-34d6-4bb0-9e37-be243da82b33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:15.967034 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df4c741-34d6-4bb0-9e37-be243da82b33 admin admin] REQUEST_METHOD: `PUT` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:15.967361 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df4c741-34d6-4bb0-9e37-be243da82b33 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:15.967649 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df4c741-34d6-4bb0-9e37-be243da82b33 admin admin] PATH_INFO: `/v3/projects/2b6dd1730b03490493bf39ae8707f333/groups/7cc7b98bdbe14160a3ad049cf9aa4639/roles/55ba49fe29884e64b57c3ad13188d554` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:15.969627 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df4c741-34d6-4bb0-9e37-be243da82b33 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b6dd1730b03490493bf39ae8707f333, group_id=7cc7b98bdbe14160a3ad049cf9aa4639, role_id=55ba49fe29884e64b57c3ad13188d554)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:15.972326 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df4c741-34d6-4bb0-9e37-be243da82b33 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:15.988234 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 153/298] 10.222.0.58 () {58 vars in 1463 bytes} [Tue Oct 12 16:37:15 2021] PUT /identity/v3/projects/2b6dd1730b03490493bf39ae8707f333/groups/7cc7b98bdbe14160a3ad049cf9aa4639/roles/55ba49fe29884e64b57c3ad13188d554 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:37:16.175168 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd7b7b4-f7ae-4ae4-90db-ad316e63cd70 None None] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:16.175513 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd7b7b4-f7ae-4ae4-90db-ad316e63cd70 None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:16.175735 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd7b7b4-f7ae-4ae4-90db-ad316e63cd70 None None] PATH_INFO: `/` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:16.177569 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 146/299] 10.222.0.58 () {54 vars in 926 bytes} [Tue Oct 12 16:37:16 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:37:16.185081 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b52537-770b-4450-a523-1a72e48fe264 None None] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:16.185381 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b52537-770b-4450-a523-1a72e48fe264 None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:16.185666 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b52537-770b-4450-a523-1a72e48fe264 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:16.218119 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.auth.core [None req-90b52537-770b-4450-a523-1a72e48fe264 None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:37:16.219388 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-90b52537-770b-4450-a523-1a72e48fe264 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:37:16.296226 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 154/300] 10.222.0.58 () {58 vars in 1023 bytes} [Tue Oct 12 16:37:16 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:37:16.322066 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd7b7b4-f7ae-4ae4-90db-ad316e63cd70 None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:16.337723 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd7b7b4-f7ae-4ae4-90db-ad316e63cd70 None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:16.342181 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be987a2a-d6f9-4039-96e7-591830a4ecce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:16.342981 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be987a2a-d6f9-4039-96e7-591830a4ecce admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:16.343265 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be987a2a-d6f9-4039-96e7-591830a4ecce admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:16.343539 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be987a2a-d6f9-4039-96e7-591830a4ecce admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:16.354175 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be987a2a-d6f9-4039-96e7-591830a4ecce admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 16:37:16.361552 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: WARNING keystone.server.flask.application [None req-be987a2a-d6f9-4039-96e7-591830a4ecce admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 12 16:37:16.362850 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 147/301] 10.222.0.58 () {56 vars in 1135 bytes} [Tue Oct 12 16:37:16 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:37:16.369362 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b52537-770b-4450-a523-1a72e48fe264 None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:16.378614 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b52537-770b-4450-a523-1a72e48fe264 None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:16.384762 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4034e6-ef86-46e8-a5d1-fb3e57cd4c47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:16.385436 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4034e6-ef86-46e8-a5d1-fb3e57cd4c47 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:16.385719 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4034e6-ef86-46e8-a5d1-fb3e57cd4c47 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:16.386021 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4034e6-ef86-46e8-a5d1-fb3e57cd4c47 admin admin] PATH_INFO: `/v3/roles` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:16.386792 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4034e6-ef86-46e8-a5d1-fb3e57cd4c47 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=85204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:37:16.387100 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4034e6-ef86-46e8-a5d1-fb3e57cd4c47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:16.388810 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4034e6-ef86-46e8-a5d1-fb3e57cd4c47 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:16.399734 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 155/302] 10.222.0.58 () {56 vars in 1132 bytes} [Tue Oct 12 16:37:16 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:37:16.406089 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be987a2a-d6f9-4039-96e7-591830a4ecce admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:16.416582 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be987a2a-d6f9-4039-96e7-591830a4ecce admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:16.421185 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a42740-fd71-4b92-a9a2-aa118ecbbc9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:16.422208 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a42740-fd71-4b92-a9a2-aa118ecbbc9b admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:16.422493 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a42740-fd71-4b92-a9a2-aa118ecbbc9b admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:16.422770 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a42740-fd71-4b92-a9a2-aa118ecbbc9b admin admin] PATH_INFO: `/v3/groups/7cc7b98bdbe14160a3ad049cf9aa4639` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:16.424042 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a42740-fd71-4b92-a9a2-aa118ecbbc9b admin admin] RBAC: Authorizing `identity:get_group(group_id=7cc7b98bdbe14160a3ad049cf9aa4639)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:16.426226 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a42740-fd71-4b92-a9a2-aa118ecbbc9b admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:16.428022 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 148/303] 10.222.0.58 () {56 vars in 1201 bytes} [Tue Oct 12 16:37:16 2021] GET /identity/v3/groups/7cc7b98bdbe14160a3ad049cf9aa4639 => generated 226 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:37:16.433989 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4034e6-ef86-46e8-a5d1-fb3e57cd4c47 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:16.444089 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4034e6-ef86-46e8-a5d1-fb3e57cd4c47 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:16.449448 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3ca6b7-c3e5-4248-a86c-88620a7ca0c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:16.450347 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3ca6b7-c3e5-4248-a86c-88620a7ca0c1 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:16.450679 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3ca6b7-c3e5-4248-a86c-88620a7ca0c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:16.450955 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3ca6b7-c3e5-4248-a86c-88620a7ca0c1 admin admin] PATH_INFO: `/v3/projects/2b6dd1730b03490493bf39ae8707f333` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:16.452230 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3ca6b7-c3e5-4248-a86c-88620a7ca0c1 admin admin] RBAC: Authorizing `identity:get_project(project_id=2b6dd1730b03490493bf39ae8707f333)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:16.461123 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3ca6b7-c3e5-4248-a86c-88620a7ca0c1 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:16.463064 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 156/304] 10.222.0.58 () {56 vars in 1207 bytes} [Tue Oct 12 16:37:16 2021] GET /identity/v3/projects/2b6dd1730b03490493bf39ae8707f333 => generated 302 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:37:16.469524 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a42740-fd71-4b92-a9a2-aa118ecbbc9b admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:16.483847 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a42740-fd71-4b92-a9a2-aa118ecbbc9b admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:16.488522 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edaf586-f3b7-4df2-9185-ab8da381c2bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:16.489500 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edaf586-f3b7-4df2-9185-ab8da381c2bc admin admin] REQUEST_METHOD: `PUT` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:16.489791 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edaf586-f3b7-4df2-9185-ab8da381c2bc admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:16.490094 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edaf586-f3b7-4df2-9185-ab8da381c2bc admin admin] PATH_INFO: `/v3/projects/2b6dd1730b03490493bf39ae8707f333/groups/7cc7b98bdbe14160a3ad049cf9aa4639/roles/638eb220c5a346cb8cf0e7128f938c65` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:16.492469 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edaf586-f3b7-4df2-9185-ab8da381c2bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b6dd1730b03490493bf39ae8707f333, group_id=7cc7b98bdbe14160a3ad049cf9aa4639, role_id=638eb220c5a346cb8cf0e7128f938c65)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:16.495351 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edaf586-f3b7-4df2-9185-ab8da381c2bc admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:16.512398 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 149/305] 10.222.0.58 () {58 vars in 1463 bytes} [Tue Oct 12 16:37:16 2021] PUT /identity/v3/projects/2b6dd1730b03490493bf39ae8707f333/groups/7cc7b98bdbe14160a3ad049cf9aa4639/roles/638eb220c5a346cb8cf0e7128f938c65 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:37:16.966738 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3aa1b2-fc96-4b8e-b198-f88eec5c4f39 None None] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:16.967426 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3aa1b2-fc96-4b8e-b198-f88eec5c4f39 None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:16.967426 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3aa1b2-fc96-4b8e-b198-f88eec5c4f39 None None] PATH_INFO: `/` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:16.969391 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 157/306] 10.222.0.58 () {54 vars in 926 bytes} [Tue Oct 12 16:37:16 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:37:16.974846 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9872f957-471b-485b-bda0-9a2b60fab26b None None] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:16.975355 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9872f957-471b-485b-bda0-9a2b60fab26b None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:16.975512 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9872f957-471b-485b-bda0-9a2b60fab26b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:16.997456 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.auth.core [None req-9872f957-471b-485b-bda0-9a2b60fab26b None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:37:16.998680 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-9872f957-471b-485b-bda0-9a2b60fab26b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:37:17.064463 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 150/307] 10.222.0.58 () {58 vars in 1023 bytes} [Tue Oct 12 16:37:16 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:37:17.108157 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3aa1b2-fc96-4b8e-b198-f88eec5c4f39 None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:17.121566 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3aa1b2-fc96-4b8e-b198-f88eec5c4f39 None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:17.132343 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c396e6af-91ec-48e6-bc24-db267882d893 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:17.133385 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c396e6af-91ec-48e6-bc24-db267882d893 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:17.133668 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c396e6af-91ec-48e6-bc24-db267882d893 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:17.133991 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c396e6af-91ec-48e6-bc24-db267882d893 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:17.147665 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c396e6af-91ec-48e6-bc24-db267882d893 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 16:37:17.154601 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: WARNING keystone.server.flask.application [None req-c396e6af-91ec-48e6-bc24-db267882d893 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 16:37:17.155780 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 158/308] 10.222.0.58 () {56 vars in 1117 bytes} [Tue Oct 12 16:37:17 2021] GET /identity/v3/roles/admin => generated 83 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:37:17.162269 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9872f957-471b-485b-bda0-9a2b60fab26b None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:17.171908 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9872f957-471b-485b-bda0-9a2b60fab26b None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:17.176457 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f81c2bc-ce3b-43cb-9529-b986a9df2189 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:17.177112 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f81c2bc-ce3b-43cb-9529-b986a9df2189 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:17.177394 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f81c2bc-ce3b-43cb-9529-b986a9df2189 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:17.177668 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f81c2bc-ce3b-43cb-9529-b986a9df2189 admin admin] PATH_INFO: `/v3/roles` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:17.178521 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f81c2bc-ce3b-43cb-9529-b986a9df2189 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=85205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:37:17.179506 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f81c2bc-ce3b-43cb-9529-b986a9df2189 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:17.181106 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f81c2bc-ce3b-43cb-9529-b986a9df2189 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:17.189865 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 151/309] 10.222.0.58 () {56 vars in 1120 bytes} [Tue Oct 12 16:37:17 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:37:17.195772 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c396e6af-91ec-48e6-bc24-db267882d893 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:17.209948 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c396e6af-91ec-48e6-bc24-db267882d893 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:17.217832 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16353ce7-0741-4b35-89e2-5b9786d9d6b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:17.218716 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16353ce7-0741-4b35-89e2-5b9786d9d6b7 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:17.219005 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16353ce7-0741-4b35-89e2-5b9786d9d6b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:17.219286 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16353ce7-0741-4b35-89e2-5b9786d9d6b7 admin admin] PATH_INFO: `/v3/groups/76b2026b4eff4a1cbccd99e70c63cd97` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:17.220504 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16353ce7-0741-4b35-89e2-5b9786d9d6b7 admin admin] RBAC: Authorizing `identity:get_group(group_id=76b2026b4eff4a1cbccd99e70c63cd97)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:17.222431 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16353ce7-0741-4b35-89e2-5b9786d9d6b7 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:17.224158 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 159/310] 10.222.0.58 () {56 vars in 1201 bytes} [Tue Oct 12 16:37:17 2021] GET /identity/v3/groups/76b2026b4eff4a1cbccd99e70c63cd97 => generated 229 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:37:17.230933 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f81c2bc-ce3b-43cb-9529-b986a9df2189 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:17.240994 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f81c2bc-ce3b-43cb-9529-b986a9df2189 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:17.250096 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1517e3f-f4f2-4912-a438-62d9341b0f86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:17.251014 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1517e3f-f4f2-4912-a438-62d9341b0f86 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:17.251299 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1517e3f-f4f2-4912-a438-62d9341b0f86 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:17.251577 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1517e3f-f4f2-4912-a438-62d9341b0f86 admin admin] PATH_INFO: `/v3/projects/7ce3537317ae47bda54936a55a7d765e` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:17.252859 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1517e3f-f4f2-4912-a438-62d9341b0f86 admin admin] RBAC: Authorizing `identity:get_project(project_id=7ce3537317ae47bda54936a55a7d765e)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:17.254791 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1517e3f-f4f2-4912-a438-62d9341b0f86 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:17.256589 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 152/311] 10.222.0.58 () {56 vars in 1207 bytes} [Tue Oct 12 16:37:17 2021] GET /identity/v3/projects/7ce3537317ae47bda54936a55a7d765e => generated 344 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:37:17.263018 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16353ce7-0741-4b35-89e2-5b9786d9d6b7 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:17.273860 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16353ce7-0741-4b35-89e2-5b9786d9d6b7 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:17.281384 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17d6195-a7c5-4006-9f75-c800eb0e8f5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:17.282390 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17d6195-a7c5-4006-9f75-c800eb0e8f5d admin admin] REQUEST_METHOD: `PUT` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:17.282677 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17d6195-a7c5-4006-9f75-c800eb0e8f5d admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:17.282957 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17d6195-a7c5-4006-9f75-c800eb0e8f5d admin admin] PATH_INFO: `/v3/projects/7ce3537317ae47bda54936a55a7d765e/groups/76b2026b4eff4a1cbccd99e70c63cd97/roles/610824e4f50f4fb8954610e98c1de784` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:17.285069 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17d6195-a7c5-4006-9f75-c800eb0e8f5d admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ce3537317ae47bda54936a55a7d765e, group_id=76b2026b4eff4a1cbccd99e70c63cd97, role_id=610824e4f50f4fb8954610e98c1de784)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:17.287861 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17d6195-a7c5-4006-9f75-c800eb0e8f5d admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:17.310402 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 160/312] 10.222.0.58 () {58 vars in 1463 bytes} [Tue Oct 12 16:37:17 2021] PUT /identity/v3/projects/7ce3537317ae47bda54936a55a7d765e/groups/76b2026b4eff4a1cbccd99e70c63cd97/roles/610824e4f50f4fb8954610e98c1de784 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:37:17.920498 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf0ed74-e96f-4874-a869-dc27311f40fa None None] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:17.921139 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf0ed74-e96f-4874-a869-dc27311f40fa None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:17.921730 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf0ed74-e96f-4874-a869-dc27311f40fa None None] PATH_INFO: `/` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:17.923740 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 153/313] 10.222.0.58 () {54 vars in 926 bytes} [Tue Oct 12 16:37:17 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:37:17.932342 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc03bdb5-efb8-49ba-9b13-f3ed4d9263b7 None None] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:17.932888 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc03bdb5-efb8-49ba-9b13-f3ed4d9263b7 None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:17.933370 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc03bdb5-efb8-49ba-9b13-f3ed4d9263b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:17.958869 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.auth.core [None req-fc03bdb5-efb8-49ba-9b13-f3ed4d9263b7 None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:37:17.960981 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-fc03bdb5-efb8-49ba-9b13-f3ed4d9263b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:37:18.036647 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 161/314] 10.222.0.58 () {58 vars in 1023 bytes} [Tue Oct 12 16:37:17 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:37:18.074999 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf0ed74-e96f-4874-a869-dc27311f40fa None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:18.091435 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf0ed74-e96f-4874-a869-dc27311f40fa None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:18.096233 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01055e7-86ce-42e6-bd7c-61cc8bd13c4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:18.097264 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01055e7-86ce-42e6-bd7c-61cc8bd13c4a admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:18.097749 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01055e7-86ce-42e6-bd7c-61cc8bd13c4a admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:18.098260 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01055e7-86ce-42e6-bd7c-61cc8bd13c4a admin admin] PATH_INFO: `/v3/roles/member` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:18.111995 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01055e7-86ce-42e6-bd7c-61cc8bd13c4a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 16:37:18.119261 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: WARNING keystone.server.flask.application [None req-f01055e7-86ce-42e6-bd7c-61cc8bd13c4a admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 12 16:37:18.120976 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 154/315] 10.222.0.58 () {56 vars in 1120 bytes} [Tue Oct 12 16:37:18 2021] GET /identity/v3/roles/member => generated 84 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:37:18.127229 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc03bdb5-efb8-49ba-9b13-f3ed4d9263b7 None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:18.137285 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc03bdb5-efb8-49ba-9b13-f3ed4d9263b7 None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:18.145135 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827568fc-d4ae-40e5-b0fa-edb1e8031ff5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:18.146110 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827568fc-d4ae-40e5-b0fa-edb1e8031ff5 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:18.146598 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827568fc-d4ae-40e5-b0fa-edb1e8031ff5 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:18.147072 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827568fc-d4ae-40e5-b0fa-edb1e8031ff5 admin admin] PATH_INFO: `/v3/roles` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:18.148650 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827568fc-d4ae-40e5-b0fa-edb1e8031ff5 admin admin] RBAC: Adding query filter params (name=member) {{(pid=85204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:37:18.149161 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827568fc-d4ae-40e5-b0fa-edb1e8031ff5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:18.151037 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827568fc-d4ae-40e5-b0fa-edb1e8031ff5 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:18.166690 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 162/316] 10.222.0.58 () {56 vars in 1122 bytes} [Tue Oct 12 16:37:18 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:37:18.172724 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01055e7-86ce-42e6-bd7c-61cc8bd13c4a admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:18.184489 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01055e7-86ce-42e6-bd7c-61cc8bd13c4a admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:18.195432 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9c2882-cc70-49fb-9353-ebea2a52d8bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:18.196493 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9c2882-cc70-49fb-9353-ebea2a52d8bf admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:18.196982 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9c2882-cc70-49fb-9353-ebea2a52d8bf admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:18.197461 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9c2882-cc70-49fb-9353-ebea2a52d8bf admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:18.210730 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9c2882-cc70-49fb-9353-ebea2a52d8bf admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:18.212874 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9c2882-cc70-49fb-9353-ebea2a52d8bf admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:18.227489 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 155/317] 10.222.0.58 () {58 vars in 1324 bytes} [Tue Oct 12 16:37:18 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 12 16:37:18.234187 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827568fc-d4ae-40e5-b0fa-edb1e8031ff5 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:18.244192 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827568fc-d4ae-40e5-b0fa-edb1e8031ff5 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:18.256307 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ff77f7-4400-4e9e-9163-8a9589a49303 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:18.257720 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ff77f7-4400-4e9e-9163-8a9589a49303 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:18.258250 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ff77f7-4400-4e9e-9163-8a9589a49303 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:18.258726 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ff77f7-4400-4e9e-9163-8a9589a49303 admin admin] PATH_INFO: `/v3/projects/78966be562ca4918a5e25eac86ccd8ab` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:18.262617 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ff77f7-4400-4e9e-9163-8a9589a49303 admin admin] RBAC: Authorizing `identity:get_project(project_id=78966be562ca4918a5e25eac86ccd8ab)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:18.264877 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ff77f7-4400-4e9e-9163-8a9589a49303 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:18.267124 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 163/318] 10.222.0.58 () {56 vars in 1207 bytes} [Tue Oct 12 16:37:18 2021] GET /identity/v3/projects/78966be562ca4918a5e25eac86ccd8ab => generated 298 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:37:18.273626 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9c2882-cc70-49fb-9353-ebea2a52d8bf admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:18.282972 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9c2882-cc70-49fb-9353-ebea2a52d8bf admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:18.293995 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16f7983-7395-410e-a476-fb4411b9850f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:18.295101 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16f7983-7395-410e-a476-fb4411b9850f admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:18.295586 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16f7983-7395-410e-a476-fb4411b9850f admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:18.296099 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16f7983-7395-410e-a476-fb4411b9850f admin admin] PATH_INFO: `/v3/groups/7cc7b98bdbe14160a3ad049cf9aa4639` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:18.297499 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16f7983-7395-410e-a476-fb4411b9850f admin admin] RBAC: Authorizing `identity:get_group(group_id=7cc7b98bdbe14160a3ad049cf9aa4639)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:18.299677 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16f7983-7395-410e-a476-fb4411b9850f admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:18.301790 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 156/319] 10.222.0.58 () {56 vars in 1201 bytes} [Tue Oct 12 16:37:18 2021] GET /identity/v3/groups/7cc7b98bdbe14160a3ad049cf9aa4639 => generated 226 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:37:18.308315 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ff77f7-4400-4e9e-9163-8a9589a49303 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:18.318584 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ff77f7-4400-4e9e-9163-8a9589a49303 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:18.326024 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64e56ee-39b6-4de9-8e9a-815ef64f9d35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:18.326930 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64e56ee-39b6-4de9-8e9a-815ef64f9d35 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:18.327419 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64e56ee-39b6-4de9-8e9a-815ef64f9d35 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:18.327916 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64e56ee-39b6-4de9-8e9a-815ef64f9d35 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:18.328976 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64e56ee-39b6-4de9-8e9a-815ef64f9d35 admin admin] RBAC: Adding query filter params (group.id=7cc7b98bdbe14160a3ad049cf9aa4639, role.id=55ba49fe29884e64b57c3ad13188d554, scope.project.id=78966be562ca4918a5e25eac86ccd8ab) {{(pid=85204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:37:18.329495 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64e56ee-39b6-4de9-8e9a-815ef64f9d35 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:18.331552 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64e56ee-39b6-4de9-8e9a-815ef64f9d35 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:18.342801 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 164/320] 10.222.0.58 () {56 vars in 1397 bytes} [Tue Oct 12 16:37:18 2021] GET /identity/v3/role_assignments?group.id=7cc7b98bdbe14160a3ad049cf9aa4639&scope.project.id=78966be562ca4918a5e25eac86ccd8ab&role.id=55ba49fe29884e64b57c3ad13188d554 => generated 611 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:37:18.357351 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43a59b2-1af4-4f61-a18a-e82f5fb48e72 None None] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:18.358007 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43a59b2-1af4-4f61-a18a-e82f5fb48e72 None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:18.358491 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43a59b2-1af4-4f61-a18a-e82f5fb48e72 None None] PATH_INFO: `/` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:18.360597 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 157/321] 10.222.0.58 () {54 vars in 926 bytes} [Tue Oct 12 16:37:18 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:37:18.367181 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3512ddd-4c09-4ea6-ad4b-313ce823aded None None] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:18.367794 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3512ddd-4c09-4ea6-ad4b-313ce823aded None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:18.368302 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3512ddd-4c09-4ea6-ad4b-313ce823aded None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:18.399125 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.auth.core [None req-d3512ddd-4c09-4ea6-ad4b-313ce823aded None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:37:18.400698 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-d3512ddd-4c09-4ea6-ad4b-313ce823aded None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:37:18.408928 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 165/322] 10.222.0.58 () {58 vars in 1023 bytes} [Tue Oct 12 16:37:18 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:37:18.453838 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43a59b2-1af4-4f61-a18a-e82f5fb48e72 None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:18.470967 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43a59b2-1af4-4f61-a18a-e82f5fb48e72 None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:18.476529 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd946e15-b2de-48bd-babe-8e06aba13d9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:18.477698 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd946e15-b2de-48bd-babe-8e06aba13d9b admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:18.478218 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd946e15-b2de-48bd-babe-8e06aba13d9b admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:18.478719 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd946e15-b2de-48bd-babe-8e06aba13d9b admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:18.500063 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd946e15-b2de-48bd-babe-8e06aba13d9b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 16:37:18.508363 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: WARNING keystone.server.flask.application [None req-fd946e15-b2de-48bd-babe-8e06aba13d9b admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 12 16:37:18.510397 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 158/323] 10.222.0.58 () {56 vars in 1135 bytes} [Tue Oct 12 16:37:18 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:37:18.516681 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3512ddd-4c09-4ea6-ad4b-313ce823aded None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:18.527058 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3512ddd-4c09-4ea6-ad4b-313ce823aded None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:18.541782 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ac8cc0-57eb-4c11-bae4-140b32e70582 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:18.542611 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ac8cc0-57eb-4c11-bae4-140b32e70582 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:18.542898 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ac8cc0-57eb-4c11-bae4-140b32e70582 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:18.545374 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ac8cc0-57eb-4c11-bae4-140b32e70582 admin admin] PATH_INFO: `/v3/roles` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:18.545374 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ac8cc0-57eb-4c11-bae4-140b32e70582 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=85204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:37:18.545374 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ac8cc0-57eb-4c11-bae4-140b32e70582 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:18.549940 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ac8cc0-57eb-4c11-bae4-140b32e70582 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:18.574349 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 166/324] 10.222.0.58 () {56 vars in 1132 bytes} [Tue Oct 12 16:37:18 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:37:18.580088 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd946e15-b2de-48bd-babe-8e06aba13d9b admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:18.591079 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd946e15-b2de-48bd-babe-8e06aba13d9b admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:18.603803 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0936892-2694-4aad-a232-e7e869c5afb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:18.604848 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0936892-2694-4aad-a232-e7e869c5afb2 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:18.605340 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0936892-2694-4aad-a232-e7e869c5afb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:18.605819 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0936892-2694-4aad-a232-e7e869c5afb2 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:18.618617 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0936892-2694-4aad-a232-e7e869c5afb2 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:18.620628 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0936892-2694-4aad-a232-e7e869c5afb2 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:18.630108 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 159/325] 10.222.0.58 () {58 vars in 1324 bytes} [Tue Oct 12 16:37:18 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:37:18.637311 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ac8cc0-57eb-4c11-bae4-140b32e70582 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:18.651567 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ac8cc0-57eb-4c11-bae4-140b32e70582 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:18.658636 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42617bf8-a1e2-4797-b0f9-1a8fb0027493 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:18.659495 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42617bf8-a1e2-4797-b0f9-1a8fb0027493 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:18.659773 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42617bf8-a1e2-4797-b0f9-1a8fb0027493 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:18.660045 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42617bf8-a1e2-4797-b0f9-1a8fb0027493 admin admin] PATH_INFO: `/v3/projects/78966be562ca4918a5e25eac86ccd8ab` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:18.669905 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42617bf8-a1e2-4797-b0f9-1a8fb0027493 admin admin] RBAC: Authorizing `identity:get_project(project_id=78966be562ca4918a5e25eac86ccd8ab)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:18.669905 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42617bf8-a1e2-4797-b0f9-1a8fb0027493 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:18.670989 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 167/326] 10.222.0.58 () {56 vars in 1207 bytes} [Tue Oct 12 16:37:18 2021] GET /identity/v3/projects/78966be562ca4918a5e25eac86ccd8ab => generated 298 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:37:18.677316 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0936892-2694-4aad-a232-e7e869c5afb2 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:18.686488 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0936892-2694-4aad-a232-e7e869c5afb2 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:18.690956 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21f235b-31db-48b1-8e20-0033fd68f255 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:18.691790 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21f235b-31db-48b1-8e20-0033fd68f255 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:18.692087 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21f235b-31db-48b1-8e20-0033fd68f255 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:18.692342 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21f235b-31db-48b1-8e20-0033fd68f255 admin admin] PATH_INFO: `/v3/groups/7cc7b98bdbe14160a3ad049cf9aa4639` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:18.695219 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21f235b-31db-48b1-8e20-0033fd68f255 admin admin] RBAC: Authorizing `identity:get_group(group_id=7cc7b98bdbe14160a3ad049cf9aa4639)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:18.697115 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21f235b-31db-48b1-8e20-0033fd68f255 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:18.698784 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 160/327] 10.222.0.58 () {56 vars in 1201 bytes} [Tue Oct 12 16:37:18 2021] GET /identity/v3/groups/7cc7b98bdbe14160a3ad049cf9aa4639 => generated 226 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:37:18.705239 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42617bf8-a1e2-4797-b0f9-1a8fb0027493 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:18.715678 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42617bf8-a1e2-4797-b0f9-1a8fb0027493 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:18.720171 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08225ddc-b5e3-43b0-8bfb-abd992ed4015 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:18.720818 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08225ddc-b5e3-43b0-8bfb-abd992ed4015 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:18.721105 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08225ddc-b5e3-43b0-8bfb-abd992ed4015 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:18.721385 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08225ddc-b5e3-43b0-8bfb-abd992ed4015 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:18.722303 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08225ddc-b5e3-43b0-8bfb-abd992ed4015 admin admin] RBAC: Adding query filter params (group.id=7cc7b98bdbe14160a3ad049cf9aa4639, role.id=638eb220c5a346cb8cf0e7128f938c65, scope.project.id=78966be562ca4918a5e25eac86ccd8ab) {{(pid=85204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:37:18.722619 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08225ddc-b5e3-43b0-8bfb-abd992ed4015 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:18.724440 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08225ddc-b5e3-43b0-8bfb-abd992ed4015 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:18.731082 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 168/328] 10.222.0.58 () {56 vars in 1397 bytes} [Tue Oct 12 16:37:18 2021] GET /identity/v3/role_assignments?group.id=7cc7b98bdbe14160a3ad049cf9aa4639&scope.project.id=78966be562ca4918a5e25eac86ccd8ab&role.id=638eb220c5a346cb8cf0e7128f938c65 => generated 611 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:37:19.032380 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da985d9-06ec-4280-8ab9-4b1ae27c8147 None None] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:19.032753 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da985d9-06ec-4280-8ab9-4b1ae27c8147 None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:19.032944 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da985d9-06ec-4280-8ab9-4b1ae27c8147 None None] PATH_INFO: `/` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:19.034765 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 161/329] 10.222.0.58 () {54 vars in 926 bytes} [Tue Oct 12 16:37:19 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:37:19.041852 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a19302-45a8-4804-b39a-60e62de50205 None None] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:19.042339 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a19302-45a8-4804-b39a-60e62de50205 None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:19.042530 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a19302-45a8-4804-b39a-60e62de50205 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:19.061414 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.auth.core [None req-37a19302-45a8-4804-b39a-60e62de50205 None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:37:19.062667 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-37a19302-45a8-4804-b39a-60e62de50205 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:37:19.072422 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 169/330] 10.222.0.58 () {58 vars in 1023 bytes} [Tue Oct 12 16:37:19 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:37:19.097289 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da985d9-06ec-4280-8ab9-4b1ae27c8147 None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:19.110030 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da985d9-06ec-4280-8ab9-4b1ae27c8147 None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:19.115012 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29e1fd0-f05a-4b04-abd5-074225cbd8ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:19.116333 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29e1fd0-f05a-4b04-abd5-074225cbd8ea admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:19.116624 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29e1fd0-f05a-4b04-abd5-074225cbd8ea admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:19.116895 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29e1fd0-f05a-4b04-abd5-074225cbd8ea admin admin] PATH_INFO: `/v3/roles/member` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:19.127834 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29e1fd0-f05a-4b04-abd5-074225cbd8ea admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 16:37:19.135825 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: WARNING keystone.server.flask.application [None req-a29e1fd0-f05a-4b04-abd5-074225cbd8ea admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 12 16:37:19.137037 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 162/331] 10.222.0.58 () {56 vars in 1120 bytes} [Tue Oct 12 16:37:19 2021] GET /identity/v3/roles/member => generated 84 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:37:19.143821 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a19302-45a8-4804-b39a-60e62de50205 None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:19.153807 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a19302-45a8-4804-b39a-60e62de50205 None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:19.158323 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88968fb-d223-4f60-8578-405c8d08588b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:19.158988 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88968fb-d223-4f60-8578-405c8d08588b admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:19.159271 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88968fb-d223-4f60-8578-405c8d08588b admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:19.159548 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88968fb-d223-4f60-8578-405c8d08588b admin admin] PATH_INFO: `/v3/roles` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:19.160315 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88968fb-d223-4f60-8578-405c8d08588b admin admin] RBAC: Adding query filter params (name=member) {{(pid=85204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:37:19.160622 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88968fb-d223-4f60-8578-405c8d08588b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:19.162242 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88968fb-d223-4f60-8578-405c8d08588b admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:19.172885 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 170/332] 10.222.0.58 () {56 vars in 1122 bytes} [Tue Oct 12 16:37:19 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:37:19.179440 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29e1fd0-f05a-4b04-abd5-074225cbd8ea admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:19.189498 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29e1fd0-f05a-4b04-abd5-074225cbd8ea admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:19.194644 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97094b0-21a5-457a-8db3-09ba098a8383 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:19.195286 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97094b0-21a5-457a-8db3-09ba098a8383 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:19.195570 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97094b0-21a5-457a-8db3-09ba098a8383 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:19.195844 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97094b0-21a5-457a-8db3-09ba098a8383 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:19.204583 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97094b0-21a5-457a-8db3-09ba098a8383 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:19.206351 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97094b0-21a5-457a-8db3-09ba098a8383 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:19.215454 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 163/333] 10.222.0.58 () {58 vars in 1324 bytes} [Tue Oct 12 16:37:19 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:37:19.221439 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88968fb-d223-4f60-8578-405c8d08588b admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:19.232190 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88968fb-d223-4f60-8578-405c8d08588b admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:19.236888 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461d5e73-e2b4-44bb-a4a4-2643f905d2ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:19.237792 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461d5e73-e2b4-44bb-a4a4-2643f905d2ec admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:19.238170 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461d5e73-e2b4-44bb-a4a4-2643f905d2ec admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:19.238450 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461d5e73-e2b4-44bb-a4a4-2643f905d2ec admin admin] PATH_INFO: `/v3/projects/2b6dd1730b03490493bf39ae8707f333` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:19.239660 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461d5e73-e2b4-44bb-a4a4-2643f905d2ec admin admin] RBAC: Authorizing `identity:get_project(project_id=2b6dd1730b03490493bf39ae8707f333)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:19.242310 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461d5e73-e2b4-44bb-a4a4-2643f905d2ec admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:19.247495 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 171/334] 10.222.0.58 () {56 vars in 1207 bytes} [Tue Oct 12 16:37:19 2021] GET /identity/v3/projects/2b6dd1730b03490493bf39ae8707f333 => generated 302 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:37:19.250363 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97094b0-21a5-457a-8db3-09ba098a8383 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:19.261073 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97094b0-21a5-457a-8db3-09ba098a8383 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:19.265629 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8928fb57-1868-4103-ba22-782bb43f873b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:19.266592 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8928fb57-1868-4103-ba22-782bb43f873b admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:19.266872 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8928fb57-1868-4103-ba22-782bb43f873b admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:19.267141 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8928fb57-1868-4103-ba22-782bb43f873b admin admin] PATH_INFO: `/v3/groups/7cc7b98bdbe14160a3ad049cf9aa4639` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:19.268392 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8928fb57-1868-4103-ba22-782bb43f873b admin admin] RBAC: Authorizing `identity:get_group(group_id=7cc7b98bdbe14160a3ad049cf9aa4639)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:19.270346 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8928fb57-1868-4103-ba22-782bb43f873b admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:19.272259 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 164/335] 10.222.0.58 () {56 vars in 1201 bytes} [Tue Oct 12 16:37:19 2021] GET /identity/v3/groups/7cc7b98bdbe14160a3ad049cf9aa4639 => generated 226 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:37:19.278862 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461d5e73-e2b4-44bb-a4a4-2643f905d2ec admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:19.289803 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461d5e73-e2b4-44bb-a4a4-2643f905d2ec admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:19.294773 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c6ba42-3602-4704-92ab-b9f0255dfa2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:19.295458 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c6ba42-3602-4704-92ab-b9f0255dfa2f admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:19.295791 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c6ba42-3602-4704-92ab-b9f0255dfa2f admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:19.296121 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c6ba42-3602-4704-92ab-b9f0255dfa2f admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:19.297066 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c6ba42-3602-4704-92ab-b9f0255dfa2f admin admin] RBAC: Adding query filter params (group.id=7cc7b98bdbe14160a3ad049cf9aa4639, role.id=55ba49fe29884e64b57c3ad13188d554, scope.project.id=2b6dd1730b03490493bf39ae8707f333) {{(pid=85204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:37:19.297436 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c6ba42-3602-4704-92ab-b9f0255dfa2f admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:19.299564 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c6ba42-3602-4704-92ab-b9f0255dfa2f admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:19.307582 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 172/336] 10.222.0.58 () {56 vars in 1397 bytes} [Tue Oct 12 16:37:19 2021] GET /identity/v3/role_assignments?group.id=7cc7b98bdbe14160a3ad049cf9aa4639&scope.project.id=2b6dd1730b03490493bf39ae8707f333&role.id=55ba49fe29884e64b57c3ad13188d554 => generated 611 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 16:37:19.444921 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27633c15-3d02-43d0-a539-20dca2a298a4 None None] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:19.445325 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27633c15-3d02-43d0-a539-20dca2a298a4 None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:19.445521 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27633c15-3d02-43d0-a539-20dca2a298a4 None None] PATH_INFO: `/` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:19.447458 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 165/337] 10.222.0.58 () {54 vars in 926 bytes} [Tue Oct 12 16:37:19 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:37:19.453531 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfd9c9c-4af3-49af-a28a-b12d193c1a9e None None] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:19.453826 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfd9c9c-4af3-49af-a28a-b12d193c1a9e None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:19.454129 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfd9c9c-4af3-49af-a28a-b12d193c1a9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:19.472534 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.auth.core [None req-3cfd9c9c-4af3-49af-a28a-b12d193c1a9e None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:37:19.473756 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-3cfd9c9c-4af3-49af-a28a-b12d193c1a9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:37:19.482203 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 173/338] 10.222.0.58 () {58 vars in 1023 bytes} [Tue Oct 12 16:37:19 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:37:19.506749 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27633c15-3d02-43d0-a539-20dca2a298a4 None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:19.519969 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27633c15-3d02-43d0-a539-20dca2a298a4 None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:19.524514 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4073e2a8-71fa-48c0-8244-b9d2805242f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:19.525304 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4073e2a8-71fa-48c0-8244-b9d2805242f7 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:19.525587 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4073e2a8-71fa-48c0-8244-b9d2805242f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:19.525866 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4073e2a8-71fa-48c0-8244-b9d2805242f7 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:19.536251 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4073e2a8-71fa-48c0-8244-b9d2805242f7 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 16:37:19.544126 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: WARNING keystone.server.flask.application [None req-4073e2a8-71fa-48c0-8244-b9d2805242f7 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 12 16:37:19.545277 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 166/339] 10.222.0.58 () {56 vars in 1135 bytes} [Tue Oct 12 16:37:19 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:37:19.551880 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfd9c9c-4af3-49af-a28a-b12d193c1a9e None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:19.561802 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfd9c9c-4af3-49af-a28a-b12d193c1a9e None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:19.568442 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48918a3f-00b3-4b2c-a68f-9e4998d72c63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:19.569146 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48918a3f-00b3-4b2c-a68f-9e4998d72c63 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:19.569428 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48918a3f-00b3-4b2c-a68f-9e4998d72c63 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:19.569704 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48918a3f-00b3-4b2c-a68f-9e4998d72c63 admin admin] PATH_INFO: `/v3/roles` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:19.570522 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48918a3f-00b3-4b2c-a68f-9e4998d72c63 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=85204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:37:19.570829 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48918a3f-00b3-4b2c-a68f-9e4998d72c63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:19.572413 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48918a3f-00b3-4b2c-a68f-9e4998d72c63 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:19.581087 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 174/340] 10.222.0.58 () {56 vars in 1132 bytes} [Tue Oct 12 16:37:19 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:37:19.587492 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4073e2a8-71fa-48c0-8244-b9d2805242f7 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:19.599215 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4073e2a8-71fa-48c0-8244-b9d2805242f7 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:19.604503 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d888216-d254-4332-90ed-383263f446d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:19.605141 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d888216-d254-4332-90ed-383263f446d9 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:19.605422 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d888216-d254-4332-90ed-383263f446d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:19.605696 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d888216-d254-4332-90ed-383263f446d9 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:19.614324 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d888216-d254-4332-90ed-383263f446d9 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:19.616590 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d888216-d254-4332-90ed-383263f446d9 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:19.625565 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 167/341] 10.222.0.58 () {58 vars in 1324 bytes} [Tue Oct 12 16:37:19 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 12 16:37:19.631895 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48918a3f-00b3-4b2c-a68f-9e4998d72c63 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:19.641912 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48918a3f-00b3-4b2c-a68f-9e4998d72c63 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:19.646356 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c34e4e6-b7e6-437f-b6d6-662d63a3f2fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:19.647244 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c34e4e6-b7e6-437f-b6d6-662d63a3f2fa admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:19.647526 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c34e4e6-b7e6-437f-b6d6-662d63a3f2fa admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:19.647802 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c34e4e6-b7e6-437f-b6d6-662d63a3f2fa admin admin] PATH_INFO: `/v3/projects/2b6dd1730b03490493bf39ae8707f333` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:19.648998 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c34e4e6-b7e6-437f-b6d6-662d63a3f2fa admin admin] RBAC: Authorizing `identity:get_project(project_id=2b6dd1730b03490493bf39ae8707f333)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:19.651090 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c34e4e6-b7e6-437f-b6d6-662d63a3f2fa admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:19.652939 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 175/342] 10.222.0.58 () {56 vars in 1207 bytes} [Tue Oct 12 16:37:19 2021] GET /identity/v3/projects/2b6dd1730b03490493bf39ae8707f333 => generated 302 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:37:19.658866 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d888216-d254-4332-90ed-383263f446d9 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:19.668488 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d888216-d254-4332-90ed-383263f446d9 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:19.673045 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d80f326-4b29-4d15-9382-24ab9fd9c649 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:19.674011 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d80f326-4b29-4d15-9382-24ab9fd9c649 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:19.674293 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d80f326-4b29-4d15-9382-24ab9fd9c649 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:19.674564 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d80f326-4b29-4d15-9382-24ab9fd9c649 admin admin] PATH_INFO: `/v3/groups/7cc7b98bdbe14160a3ad049cf9aa4639` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:19.675762 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d80f326-4b29-4d15-9382-24ab9fd9c649 admin admin] RBAC: Authorizing `identity:get_group(group_id=7cc7b98bdbe14160a3ad049cf9aa4639)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:19.677723 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d80f326-4b29-4d15-9382-24ab9fd9c649 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:19.680123 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 168/343] 10.222.0.58 () {56 vars in 1201 bytes} [Tue Oct 12 16:37:19 2021] GET /identity/v3/groups/7cc7b98bdbe14160a3ad049cf9aa4639 => generated 226 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:37:19.686411 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c34e4e6-b7e6-437f-b6d6-662d63a3f2fa admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:19.696449 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c34e4e6-b7e6-437f-b6d6-662d63a3f2fa admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:19.701858 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff46eb2c-5cb8-456e-8855-782dfc454045 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:19.702588 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff46eb2c-5cb8-456e-8855-782dfc454045 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:19.702874 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff46eb2c-5cb8-456e-8855-782dfc454045 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:19.703150 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff46eb2c-5cb8-456e-8855-782dfc454045 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:19.703994 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff46eb2c-5cb8-456e-8855-782dfc454045 admin admin] RBAC: Adding query filter params (group.id=7cc7b98bdbe14160a3ad049cf9aa4639, role.id=638eb220c5a346cb8cf0e7128f938c65, scope.project.id=2b6dd1730b03490493bf39ae8707f333) {{(pid=85204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:37:19.704308 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff46eb2c-5cb8-456e-8855-782dfc454045 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:19.706174 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff46eb2c-5cb8-456e-8855-782dfc454045 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:19.713120 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 176/344] 10.222.0.58 () {56 vars in 1397 bytes} [Tue Oct 12 16:37:19 2021] GET /identity/v3/role_assignments?group.id=7cc7b98bdbe14160a3ad049cf9aa4639&scope.project.id=2b6dd1730b03490493bf39ae8707f333&role.id=638eb220c5a346cb8cf0e7128f938c65 => generated 611 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:37:20.045655 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c1957c-5366-462c-9b9b-c5a5e9d14260 None None] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:20.045975 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c1957c-5366-462c-9b9b-c5a5e9d14260 None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:20.046259 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c1957c-5366-462c-9b9b-c5a5e9d14260 None None] PATH_INFO: `/` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:20.048037 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 169/345] 10.222.0.58 () {54 vars in 926 bytes} [Tue Oct 12 16:37:20 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:37:20.054087 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821e47ae-e95d-48d5-93a3-1dddcfc42a63 None None] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:20.054549 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821e47ae-e95d-48d5-93a3-1dddcfc42a63 None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:20.054639 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821e47ae-e95d-48d5-93a3-1dddcfc42a63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:20.072867 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.auth.core [None req-821e47ae-e95d-48d5-93a3-1dddcfc42a63 None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:37:20.074063 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-821e47ae-e95d-48d5-93a3-1dddcfc42a63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:37:20.081601 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 177/346] 10.222.0.58 () {58 vars in 1023 bytes} [Tue Oct 12 16:37:20 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:37:20.106168 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c1957c-5366-462c-9b9b-c5a5e9d14260 None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:20.118085 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c1957c-5366-462c-9b9b-c5a5e9d14260 None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:20.122274 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7542c324-1d7e-4958-99f0-06cb37f55b52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:20.123038 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7542c324-1d7e-4958-99f0-06cb37f55b52 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:20.123316 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7542c324-1d7e-4958-99f0-06cb37f55b52 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:20.123584 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7542c324-1d7e-4958-99f0-06cb37f55b52 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:20.134000 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7542c324-1d7e-4958-99f0-06cb37f55b52 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 16:37:20.140747 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: WARNING keystone.server.flask.application [None req-7542c324-1d7e-4958-99f0-06cb37f55b52 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 16:37:20.141861 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 170/347] 10.222.0.58 () {56 vars in 1117 bytes} [Tue Oct 12 16:37:20 2021] GET /identity/v3/roles/admin => generated 83 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 16:37:20.148532 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821e47ae-e95d-48d5-93a3-1dddcfc42a63 None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:20.157275 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821e47ae-e95d-48d5-93a3-1dddcfc42a63 None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:20.161540 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45b13b8-db72-4042-a579-fd4db0b3e001 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:20.162232 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45b13b8-db72-4042-a579-fd4db0b3e001 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:20.162516 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45b13b8-db72-4042-a579-fd4db0b3e001 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:20.162791 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45b13b8-db72-4042-a579-fd4db0b3e001 admin admin] PATH_INFO: `/v3/roles` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:20.163553 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45b13b8-db72-4042-a579-fd4db0b3e001 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=85204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:37:20.163857 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45b13b8-db72-4042-a579-fd4db0b3e001 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:20.165424 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45b13b8-db72-4042-a579-fd4db0b3e001 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:20.173378 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 178/348] 10.222.0.58 () {56 vars in 1120 bytes} [Tue Oct 12 16:37:20 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:37:20.179308 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7542c324-1d7e-4958-99f0-06cb37f55b52 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:20.188437 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7542c324-1d7e-4958-99f0-06cb37f55b52 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:20.192649 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4033bd35-9489-42d9-a61c-c0a598f2ddf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:20.193256 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4033bd35-9489-42d9-a61c-c0a598f2ddf5 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:20.193536 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4033bd35-9489-42d9-a61c-c0a598f2ddf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:20.194361 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4033bd35-9489-42d9-a61c-c0a598f2ddf5 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:20.202254 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4033bd35-9489-42d9-a61c-c0a598f2ddf5 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:20.203946 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4033bd35-9489-42d9-a61c-c0a598f2ddf5 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:20.213901 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 171/349] 10.222.0.58 () {58 vars in 1324 bytes} [Tue Oct 12 16:37:20 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:37:20.219651 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45b13b8-db72-4042-a579-fd4db0b3e001 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:20.228732 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45b13b8-db72-4042-a579-fd4db0b3e001 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:20.232995 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae2cc74-17a5-4473-9dbe-2cb1e82b2524 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:20.233810 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae2cc74-17a5-4473-9dbe-2cb1e82b2524 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:20.234122 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae2cc74-17a5-4473-9dbe-2cb1e82b2524 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:20.234396 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae2cc74-17a5-4473-9dbe-2cb1e82b2524 admin admin] PATH_INFO: `/v3/projects/7ce3537317ae47bda54936a55a7d765e` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:20.235566 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae2cc74-17a5-4473-9dbe-2cb1e82b2524 admin admin] RBAC: Authorizing `identity:get_project(project_id=7ce3537317ae47bda54936a55a7d765e)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:20.237303 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae2cc74-17a5-4473-9dbe-2cb1e82b2524 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:20.238929 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 179/350] 10.222.0.58 () {56 vars in 1207 bytes} [Tue Oct 12 16:37:20 2021] GET /identity/v3/projects/7ce3537317ae47bda54936a55a7d765e => generated 344 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 16:37:20.244318 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4033bd35-9489-42d9-a61c-c0a598f2ddf5 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:20.252549 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4033bd35-9489-42d9-a61c-c0a598f2ddf5 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:20.257540 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407c3570-4d79-41f2-ab23-f404e499c770 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:20.258373 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407c3570-4d79-41f2-ab23-f404e499c770 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:20.258648 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407c3570-4d79-41f2-ab23-f404e499c770 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:20.258914 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407c3570-4d79-41f2-ab23-f404e499c770 admin admin] PATH_INFO: `/v3/groups/76b2026b4eff4a1cbccd99e70c63cd97` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:20.260067 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407c3570-4d79-41f2-ab23-f404e499c770 admin admin] RBAC: Authorizing `identity:get_group(group_id=76b2026b4eff4a1cbccd99e70c63cd97)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:20.262160 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407c3570-4d79-41f2-ab23-f404e499c770 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:20.263760 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 172/351] 10.222.0.58 () {56 vars in 1201 bytes} [Tue Oct 12 16:37:20 2021] GET /identity/v3/groups/76b2026b4eff4a1cbccd99e70c63cd97 => generated 229 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 16:37:20.269471 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae2cc74-17a5-4473-9dbe-2cb1e82b2524 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:20.279213 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae2cc74-17a5-4473-9dbe-2cb1e82b2524 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:20.283458 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ecdaa1-a8ed-4443-a708-53794ffd273a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:20.284063 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ecdaa1-a8ed-4443-a708-53794ffd273a admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:20.284346 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ecdaa1-a8ed-4443-a708-53794ffd273a admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:20.284625 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ecdaa1-a8ed-4443-a708-53794ffd273a admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:20.285449 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ecdaa1-a8ed-4443-a708-53794ffd273a admin admin] RBAC: Adding query filter params (group.id=76b2026b4eff4a1cbccd99e70c63cd97, role.id=610824e4f50f4fb8954610e98c1de784, scope.project.id=7ce3537317ae47bda54936a55a7d765e) {{(pid=85204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:37:20.285761 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ecdaa1-a8ed-4443-a708-53794ffd273a admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:20.287562 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ecdaa1-a8ed-4443-a708-53794ffd273a admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:20.293070 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 180/352] 10.222.0.58 () {56 vars in 1397 bytes} [Tue Oct 12 16:37:20 2021] GET /identity/v3/role_assignments?group.id=76b2026b4eff4a1cbccd99e70c63cd97&scope.project.id=7ce3537317ae47bda54936a55a7d765e&role.id=610824e4f50f4fb8954610e98c1de784 => generated 611 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:37:23.148020 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d112193-170a-4cdb-b3c9-f090902521ee None None] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:23.148506 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d112193-170a-4cdb-b3c9-f090902521ee None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:23.148506 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d112193-170a-4cdb-b3c9-f090902521ee None None] PATH_INFO: `/` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:23.150498 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 173/353] 10.222.0.58 () {54 vars in 926 bytes} [Tue Oct 12 16:37:23 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:37:23.157264 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd2fcdb-fd5e-4c51-baf2-478370173153 None None] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:23.157684 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd2fcdb-fd5e-4c51-baf2-478370173153 None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:23.157859 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd2fcdb-fd5e-4c51-baf2-478370173153 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:23.183061 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.auth.core [None req-9fd2fcdb-fd5e-4c51-baf2-478370173153 None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:37:23.184372 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-9fd2fcdb-fd5e-4c51-baf2-478370173153 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:37:23.192885 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 181/354] 10.222.0.58 () {58 vars in 1023 bytes} [Tue Oct 12 16:37:23 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:37:23.220621 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d112193-170a-4cdb-b3c9-f090902521ee None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:23.239758 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d112193-170a-4cdb-b3c9-f090902521ee None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:23.249911 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9ff77d-7c50-4d09-a0ca-f8d3f247af32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:23.250698 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9ff77d-7c50-4d09-a0ca-f8d3f247af32 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:23.250978 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9ff77d-7c50-4d09-a0ca-f8d3f247af32 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:23.251250 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9ff77d-7c50-4d09-a0ca-f8d3f247af32 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:23.267946 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9ff77d-7c50-4d09-a0ca-f8d3f247af32 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:23.269944 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9ff77d-7c50-4d09-a0ca-f8d3f247af32 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:23.295212 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: WARNING keystone.server.flask.application [None req-4d9ff77d-7c50-4d09-a0ca-f8d3f247af32 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 16:37:23.296478 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 174/355] 10.222.0.58 () {56 vars in 1129 bytes} [Tue Oct 12 16:37:23 2021] GET /identity/v3/domains/Default => generated 87 bytes in 76 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:37:23.303774 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd2fcdb-fd5e-4c51-baf2-478370173153 None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:23.319723 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd2fcdb-fd5e-4c51-baf2-478370173153 None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:23.334597 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7ca7b6-c98c-426c-a2c1-dafccdcfd1c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:23.335293 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7ca7b6-c98c-426c-a2c1-dafccdcfd1c9 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:23.335576 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7ca7b6-c98c-426c-a2c1-dafccdcfd1c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:23.335854 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7ca7b6-c98c-426c-a2c1-dafccdcfd1c9 admin admin] PATH_INFO: `/v3/domains` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:23.336611 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7ca7b6-c98c-426c-a2c1-dafccdcfd1c9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:37:23.337089 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7ca7b6-c98c-426c-a2c1-dafccdcfd1c9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:23.338136 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: WARNING py.warnings [None req-df7ca7b6-c98c-426c-a2c1-dafccdcfd1c9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:list_domains failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 12 16:37:23.338136 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: warnings.warn(msg) Oct 12 16:37:23.338136 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: Oct 12 16:37:23.339016 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7ca7b6-c98c-426c-a2c1-dafccdcfd1c9 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:23.369403 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 182/356] 10.222.0.58 () {56 vars in 1130 bytes} [Tue Oct 12 16:37:23 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:37:23.375088 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9ff77d-7c50-4d09-a0ca-f8d3f247af32 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:23.379297 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf86bde-74e6-4a0d-8a4e-36c83647f7dd None None] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:23.379588 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf86bde-74e6-4a0d-8a4e-36c83647f7dd None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:23.379866 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf86bde-74e6-4a0d-8a4e-36c83647f7dd None None] PATH_INFO: `/` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:23.381970 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 183/357] 10.222.0.58 () {54 vars in 926 bytes} [Tue Oct 12 16:37:23 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 12 16:37:23.389188 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3c8ef8-2a3b-4e41-a565-5423ab6a3312 None None] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:23.389475 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3c8ef8-2a3b-4e41-a565-5423ab6a3312 None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:23.389665 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9ff77d-7c50-4d09-a0ca-f8d3f247af32 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:23.389835 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3c8ef8-2a3b-4e41-a565-5423ab6a3312 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:23.402692 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b2165b-920d-49d7-8e97-4a9b45af2c37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:23.403307 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b2165b-920d-49d7-8e97-4a9b45af2c37 admin admin] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:23.403591 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b2165b-920d-49d7-8e97-4a9b45af2c37 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:23.403867 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b2165b-920d-49d7-8e97-4a9b45af2c37 admin admin] PATH_INFO: `/v3/users` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:23.404613 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b2165b-920d-49d7-8e97-4a9b45af2c37 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:23.413182 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b2165b-920d-49d7-8e97-4a9b45af2c37 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:23.421747 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.auth.core [None req-bf3c8ef8-2a3b-4e41-a565-5423ab6a3312 None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:37:23.422987 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-bf3c8ef8-2a3b-4e41-a565-5423ab6a3312 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:37:23.439834 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 175/358] 10.222.0.58 () {60 vars in 1153 bytes} [Tue Oct 12 16:37:23 2021] POST /identity/v3/users => generated 246 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:37:23.442645 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 184/359] 10.222.0.58 () {58 vars in 1023 bytes} [Tue Oct 12 16:37:23 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:37:23.452330 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eee4f09-2d82-4568-af0d-eb02f49d4644 None None] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:23.452911 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eee4f09-2d82-4568-af0d-eb02f49d4644 None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:23.453367 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eee4f09-2d82-4568-af0d-eb02f49d4644 None None] PATH_INFO: `/` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:23.455930 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 176/360] 10.222.0.58 () {54 vars in 926 bytes} [Tue Oct 12 16:37:23 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:37:23.462474 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c63aa2-0bca-4f1f-b339-ca98170944d1 None None] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:23.462762 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c63aa2-0bca-4f1f-b339-ca98170944d1 None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:23.463039 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c63aa2-0bca-4f1f-b339-ca98170944d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:23.478159 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eee4f09-2d82-4568-af0d-eb02f49d4644 None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:23.491209 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eee4f09-2d82-4568-af0d-eb02f49d4644 None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:23.492618 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.auth.core [None req-c1c63aa2-0bca-4f1f-b339-ca98170944d1 None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:37:23.493833 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-c1c63aa2-0bca-4f1f-b339-ca98170944d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:37:23.496612 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f4af85-1865-4a20-a1a6-59d4089888e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:23.497763 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f4af85-1865-4a20-a1a6-59d4089888e9 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:23.498266 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f4af85-1865-4a20-a1a6-59d4089888e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:23.498733 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f4af85-1865-4a20-a1a6-59d4089888e9 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:23.513904 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 185/361] 10.222.0.58 () {58 vars in 1023 bytes} [Tue Oct 12 16:37:23 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:37:23.517981 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f4af85-1865-4a20-a1a6-59d4089888e9 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:23.520265 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f4af85-1865-4a20-a1a6-59d4089888e9 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:23.542742 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: WARNING keystone.server.flask.application [None req-82f4af85-1865-4a20-a1a6-59d4089888e9 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 16:37:23.544677 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 177/362] 10.222.0.58 () {56 vars in 1129 bytes} [Tue Oct 12 16:37:23 2021] GET /identity/v3/domains/Default => generated 87 bytes in 67 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:37:23.551716 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c63aa2-0bca-4f1f-b339-ca98170944d1 None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:23.566603 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c63aa2-0bca-4f1f-b339-ca98170944d1 None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:23.574223 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f4af85-1865-4a20-a1a6-59d4089888e9 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:23.575595 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d82d30-b0fc-46c1-8304-88a90aa7f42b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:23.576283 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d82d30-b0fc-46c1-8304-88a90aa7f42b admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:23.576562 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d82d30-b0fc-46c1-8304-88a90aa7f42b admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:23.576829 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d82d30-b0fc-46c1-8304-88a90aa7f42b admin admin] PATH_INFO: `/v3/domains` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:23.577589 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d82d30-b0fc-46c1-8304-88a90aa7f42b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:37:23.577912 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d82d30-b0fc-46c1-8304-88a90aa7f42b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:23.579529 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d82d30-b0fc-46c1-8304-88a90aa7f42b admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:23.592582 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f4af85-1865-4a20-a1a6-59d4089888e9 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:23.602328 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 186/363] 10.222.0.58 () {56 vars in 1130 bytes} [Tue Oct 12 16:37:23 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:37:23.603977 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de47b3fb-04d4-439b-8c87-78ed4541b9e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:23.604803 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de47b3fb-04d4-439b-8c87-78ed4541b9e5 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:23.605154 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de47b3fb-04d4-439b-8c87-78ed4541b9e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:23.605439 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de47b3fb-04d4-439b-8c87-78ed4541b9e5 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:23.610525 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d82d30-b0fc-46c1-8304-88a90aa7f42b admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:23.632696 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d82d30-b0fc-46c1-8304-88a90aa7f42b admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:23.640852 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab88972d-13e8-4a7a-aa81-e4a99abd8f4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:23.641553 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab88972d-13e8-4a7a-aa81-e4a99abd8f4a admin admin] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:23.641838 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab88972d-13e8-4a7a-aa81-e4a99abd8f4a admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:23.642145 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab88972d-13e8-4a7a-aa81-e4a99abd8f4a admin admin] PATH_INFO: `/v3/users` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:23.642889 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab88972d-13e8-4a7a-aa81-e4a99abd8f4a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:23.643943 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: WARNING py.warnings [None req-ab88972d-13e8-4a7a-aa81-e4a99abd8f4a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:create_user failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 12 16:37:23.643943 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: warnings.warn(msg) Oct 12 16:37:23.643943 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: Oct 12 16:37:23.645155 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab88972d-13e8-4a7a-aa81-e4a99abd8f4a admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:23.701903 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 187/364] 10.222.0.58 () {60 vars in 1153 bytes} [Tue Oct 12 16:37:23 2021] POST /identity/v3/users => generated 248 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 16:37:23.750648 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de47b3fb-04d4-439b-8c87-78ed4541b9e5 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:23.752609 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de47b3fb-04d4-439b-8c87-78ed4541b9e5 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:23.776786 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: WARNING keystone.server.flask.application [None req-de47b3fb-04d4-439b-8c87-78ed4541b9e5 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 16:37:23.778055 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 178/365] 10.222.0.58 () {56 vars in 1129 bytes} [Tue Oct 12 16:37:23 2021] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 16:37:23.784573 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab88972d-13e8-4a7a-aa81-e4a99abd8f4a admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:23.799420 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab88972d-13e8-4a7a-aa81-e4a99abd8f4a admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:23.815905 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db44e4a2-e0e4-424e-8635-c70bfc1d602c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:23.815905 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db44e4a2-e0e4-424e-8635-c70bfc1d602c admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:23.815905 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db44e4a2-e0e4-424e-8635-c70bfc1d602c admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:23.815905 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db44e4a2-e0e4-424e-8635-c70bfc1d602c admin admin] PATH_INFO: `/v3/domains` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:23.816297 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db44e4a2-e0e4-424e-8635-c70bfc1d602c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:37:23.816297 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db44e4a2-e0e4-424e-8635-c70bfc1d602c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:23.816297 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db44e4a2-e0e4-424e-8635-c70bfc1d602c admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:23.838656 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 188/366] 10.222.0.58 () {56 vars in 1130 bytes} [Tue Oct 12 16:37:23 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:37:23.846140 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de47b3fb-04d4-439b-8c87-78ed4541b9e5 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:23.859717 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de47b3fb-04d4-439b-8c87-78ed4541b9e5 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:23.865220 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d11e934-b1b4-44a0-89ec-2abbb143658c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:23.866288 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d11e934-b1b4-44a0-89ec-2abbb143658c admin admin] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:23.866787 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d11e934-b1b4-44a0-89ec-2abbb143658c admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:23.867279 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d11e934-b1b4-44a0-89ec-2abbb143658c admin admin] PATH_INFO: `/v3/users` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:23.868308 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d11e934-b1b4-44a0-89ec-2abbb143658c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:23.870549 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d11e934-b1b4-44a0-89ec-2abbb143658c admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:23.905869 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 179/367] 10.222.0.58 () {60 vars in 1153 bytes} [Tue Oct 12 16:37:23 2021] POST /identity/v3/users => generated 248 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:37:23.909582 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa153800-b83b-4ca7-9518-7078a5778540 None None] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:23.909869 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa153800-b83b-4ca7-9518-7078a5778540 None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:23.910180 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa153800-b83b-4ca7-9518-7078a5778540 None None] PATH_INFO: `/` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:23.913319 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 189/368] 10.222.0.58 () {54 vars in 926 bytes} [Tue Oct 12 16:37:23 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:37:23.921626 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb4d641-9243-4049-aee9-12b34493fb59 None None] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:23.922315 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb4d641-9243-4049-aee9-12b34493fb59 None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:23.922795 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb4d641-9243-4049-aee9-12b34493fb59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:23.950602 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.auth.core [None req-2eb4d641-9243-4049-aee9-12b34493fb59 None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:37:23.952347 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-2eb4d641-9243-4049-aee9-12b34493fb59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:37:23.970381 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 180/369] 10.222.0.58 () {58 vars in 1023 bytes} [Tue Oct 12 16:37:23 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:37:23.995867 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa153800-b83b-4ca7-9518-7078a5778540 None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:24.013598 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa153800-b83b-4ca7-9518-7078a5778540 None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:24.019493 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ee74df-ee3e-459a-b9e1-277e2e420c05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:24.020295 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ee74df-ee3e-459a-b9e1-277e2e420c05 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:24.020574 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ee74df-ee3e-459a-b9e1-277e2e420c05 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:24.020850 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ee74df-ee3e-459a-b9e1-277e2e420c05 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:24.037148 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ee74df-ee3e-459a-b9e1-277e2e420c05 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:24.039077 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ee74df-ee3e-459a-b9e1-277e2e420c05 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:24.060611 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: WARNING keystone.server.flask.application [None req-09ee74df-ee3e-459a-b9e1-277e2e420c05 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 16:37:24.061866 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 190/370] 10.222.0.58 () {56 vars in 1129 bytes} [Tue Oct 12 16:37:23 2021] GET /identity/v3/domains/Default => generated 87 bytes in 67 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 16:37:24.069428 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb4d641-9243-4049-aee9-12b34493fb59 None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:24.081951 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb4d641-9243-4049-aee9-12b34493fb59 None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:24.091436 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3a0617-a574-40bf-a85d-4ff63a2d3b7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:24.092573 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3a0617-a574-40bf-a85d-4ff63a2d3b7d admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:24.093058 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3a0617-a574-40bf-a85d-4ff63a2d3b7d admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:24.093572 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3a0617-a574-40bf-a85d-4ff63a2d3b7d admin admin] PATH_INFO: `/v3/domains` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:24.094612 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3a0617-a574-40bf-a85d-4ff63a2d3b7d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:37:24.095143 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3a0617-a574-40bf-a85d-4ff63a2d3b7d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:24.097019 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3a0617-a574-40bf-a85d-4ff63a2d3b7d admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:24.116659 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 181/371] 10.222.0.58 () {56 vars in 1130 bytes} [Tue Oct 12 16:37:24 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:37:24.122850 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ee74df-ee3e-459a-b9e1-277e2e420c05 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:24.137171 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ee74df-ee3e-459a-b9e1-277e2e420c05 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:24.145505 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928ea2b9-af5e-4661-8484-e68bfaf95a97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:24.147182 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928ea2b9-af5e-4661-8484-e68bfaf95a97 admin admin] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:24.147621 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928ea2b9-af5e-4661-8484-e68bfaf95a97 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:24.147906 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928ea2b9-af5e-4661-8484-e68bfaf95a97 admin admin] PATH_INFO: `/v3/users` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:24.148781 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928ea2b9-af5e-4661-8484-e68bfaf95a97 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:24.150911 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928ea2b9-af5e-4661-8484-e68bfaf95a97 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:24.181762 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 191/372] 10.222.0.58 () {60 vars in 1153 bytes} [Tue Oct 12 16:37:24 2021] POST /identity/v3/users => generated 249 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:37:24.867012 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4995ae3-ce60-44ab-84d9-7c184ec5a51d None None] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:24.867012 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4995ae3-ce60-44ab-84d9-7c184ec5a51d None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:24.867012 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4995ae3-ce60-44ab-84d9-7c184ec5a51d None None] PATH_INFO: `/` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:24.868578 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 182/373] 10.222.0.58 () {54 vars in 926 bytes} [Tue Oct 12 16:37:24 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:37:24.875160 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5390984c-f33a-4801-99c2-4fec05756195 None None] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:24.875449 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5390984c-f33a-4801-99c2-4fec05756195 None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:24.875725 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5390984c-f33a-4801-99c2-4fec05756195 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:24.898889 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.auth.core [None req-5390984c-f33a-4801-99c2-4fec05756195 None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:37:24.900161 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-5390984c-f33a-4801-99c2-4fec05756195 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:37:24.911372 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 192/374] 10.222.0.58 () {58 vars in 1023 bytes} [Tue Oct 12 16:37:24 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:37:24.938851 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4995ae3-ce60-44ab-84d9-7c184ec5a51d None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:24.955650 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4995ae3-ce60-44ab-84d9-7c184ec5a51d None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:24.960640 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd127cb-241e-4b33-8a6c-6edef707871b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:24.961292 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd127cb-241e-4b33-8a6c-6edef707871b admin admin] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:24.961575 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd127cb-241e-4b33-8a6c-6edef707871b admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:24.961851 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd127cb-241e-4b33-8a6c-6edef707871b admin admin] PATH_INFO: `/v3/roles` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:24.962649 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd127cb-241e-4b33-8a6c-6edef707871b admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:24.964223 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd127cb-241e-4b33-8a6c-6edef707871b admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:24.978407 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.sql.core [None req-3fd127cb-241e-4b33-8a6c-6edef707871b admin admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Oct 12 16:37:24.978407 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Oct 12 16:37:24.978407 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [parameters: {'id': '68e20c7ca2e3481597c309233af6bf4f', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Oct 12 16:37:24.978407 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=85205) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 12 16:37:24.993031 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: WARNING keystone.server.flask.application [None req-3fd127cb-241e-4b33-8a6c-6edef707871b admin admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Oct 12 16:37:24.998826 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 183/375] 10.222.0.58 () {60 vars in 1152 bytes} [Tue Oct 12 16:37:24 2021] POST /identity/v3/roles => generated 144 bytes in 60 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:37:25.005070 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5390984c-f33a-4801-99c2-4fec05756195 None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:25.014630 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5390984c-f33a-4801-99c2-4fec05756195 None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:25.022912 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20ce7da-aa4b-4d70-b3a9-cd01ba1bd9a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:25.023827 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20ce7da-aa4b-4d70-b3a9-cd01ba1bd9a2 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:25.024117 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20ce7da-aa4b-4d70-b3a9-cd01ba1bd9a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:25.024441 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20ce7da-aa4b-4d70-b3a9-cd01ba1bd9a2 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:25.038263 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20ce7da-aa4b-4d70-b3a9-cd01ba1bd9a2 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 16:37:25.045793 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: WARNING keystone.server.flask.application [None req-d20ce7da-aa4b-4d70-b3a9-cd01ba1bd9a2 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 12 16:37:25.047134 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 193/376] 10.222.0.58 () {56 vars in 1135 bytes} [Tue Oct 12 16:37:25 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:37:25.053578 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd127cb-241e-4b33-8a6c-6edef707871b admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:25.067488 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd127cb-241e-4b33-8a6c-6edef707871b admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:25.075939 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdb3b62-353a-4007-a857-6aa47892719f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:25.076614 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdb3b62-353a-4007-a857-6aa47892719f admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:25.076895 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdb3b62-353a-4007-a857-6aa47892719f admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:25.077171 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdb3b62-353a-4007-a857-6aa47892719f admin admin] PATH_INFO: `/v3/roles` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:25.077974 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdb3b62-353a-4007-a857-6aa47892719f admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=85205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:37:25.078286 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdb3b62-353a-4007-a857-6aa47892719f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:25.079944 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdb3b62-353a-4007-a857-6aa47892719f admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:25.090422 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 184/377] 10.222.0.58 () {56 vars in 1132 bytes} [Tue Oct 12 16:37:25 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:37:26.343313 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4437a8-e1e8-45ec-96b9-6659619561cf None None] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:26.343823 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4437a8-e1e8-45ec-96b9-6659619561cf None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:26.343899 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4437a8-e1e8-45ec-96b9-6659619561cf None None] PATH_INFO: `/` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:26.345910 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 194/378] 10.222.0.58 () {54 vars in 926 bytes} [Tue Oct 12 16:37:26 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:37:26.352013 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf850b3-55f6-4a47-8257-afa1e280565a None None] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:26.352440 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf850b3-55f6-4a47-8257-afa1e280565a None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:26.352609 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf850b3-55f6-4a47-8257-afa1e280565a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:26.378841 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.auth.core [None req-acf850b3-55f6-4a47-8257-afa1e280565a None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:37:26.380601 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-acf850b3-55f6-4a47-8257-afa1e280565a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:37:26.397501 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 185/379] 10.222.0.58 () {58 vars in 1023 bytes} [Tue Oct 12 16:37:26 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:37:26.422027 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4437a8-e1e8-45ec-96b9-6659619561cf None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:26.435114 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4437a8-e1e8-45ec-96b9-6659619561cf None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:26.439611 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8690996d-2a76-4718-922b-d7969980c435 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:26.440397 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8690996d-2a76-4718-922b-d7969980c435 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:26.440679 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8690996d-2a76-4718-922b-d7969980c435 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:26.440953 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8690996d-2a76-4718-922b-d7969980c435 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:26.452596 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8690996d-2a76-4718-922b-d7969980c435 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 16:37:26.459565 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: WARNING keystone.server.flask.application [None req-8690996d-2a76-4718-922b-d7969980c435 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 12 16:37:26.461033 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 195/380] 10.222.0.58 () {56 vars in 1123 bytes} [Tue Oct 12 16:37:26 2021] GET /identity/v3/roles/service => generated 85 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:37:26.467373 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf850b3-55f6-4a47-8257-afa1e280565a None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:26.476434 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf850b3-55f6-4a47-8257-afa1e280565a None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:26.480949 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a7c1a1-f6eb-4c0f-be15-dd31ed09fcbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:26.481606 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a7c1a1-f6eb-4c0f-be15-dd31ed09fcbf admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:26.481903 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a7c1a1-f6eb-4c0f-be15-dd31ed09fcbf admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:26.482187 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a7c1a1-f6eb-4c0f-be15-dd31ed09fcbf admin admin] PATH_INFO: `/v3/roles` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:26.482948 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a7c1a1-f6eb-4c0f-be15-dd31ed09fcbf admin admin] RBAC: Adding query filter params (name=service) {{(pid=85205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:37:26.483254 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a7c1a1-f6eb-4c0f-be15-dd31ed09fcbf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:26.484832 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a7c1a1-f6eb-4c0f-be15-dd31ed09fcbf admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:26.494130 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 186/381] 10.222.0.58 () {56 vars in 1124 bytes} [Tue Oct 12 16:37:26 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:37:26.500444 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8690996d-2a76-4718-922b-d7969980c435 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:26.511660 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8690996d-2a76-4718-922b-d7969980c435 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:26.516389 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bf609f-5612-4f44-a0f2-a36c147d725e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:26.517199 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bf609f-5612-4f44-a0f2-a36c147d725e admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:26.517480 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bf609f-5612-4f44-a0f2-a36c147d725e admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:26.517753 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bf609f-5612-4f44-a0f2-a36c147d725e admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:26.530653 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bf609f-5612-4f44-a0f2-a36c147d725e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:26.532541 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bf609f-5612-4f44-a0f2-a36c147d725e admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:26.549957 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: WARNING keystone.server.flask.application [None req-10bf609f-5612-4f44-a0f2-a36c147d725e admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 16:37:26.551460 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 196/382] 10.222.0.58 () {56 vars in 1129 bytes} [Tue Oct 12 16:37:26 2021] GET /identity/v3/domains/Default => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:37:26.558188 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a7c1a1-f6eb-4c0f-be15-dd31ed09fcbf admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:26.568417 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a7c1a1-f6eb-4c0f-be15-dd31ed09fcbf admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:26.572927 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36065a7-59a3-4bf9-86ad-f91cd7cb1e89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:26.573576 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36065a7-59a3-4bf9-86ad-f91cd7cb1e89 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:26.573859 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36065a7-59a3-4bf9-86ad-f91cd7cb1e89 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:26.574162 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36065a7-59a3-4bf9-86ad-f91cd7cb1e89 admin admin] PATH_INFO: `/v3/domains` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:26.574900 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36065a7-59a3-4bf9-86ad-f91cd7cb1e89 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:37:26.575208 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36065a7-59a3-4bf9-86ad-f91cd7cb1e89 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:26.576785 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36065a7-59a3-4bf9-86ad-f91cd7cb1e89 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:26.588954 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 187/383] 10.222.0.58 () {56 vars in 1130 bytes} [Tue Oct 12 16:37:26 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:37:26.594887 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bf609f-5612-4f44-a0f2-a36c147d725e admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:26.610958 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bf609f-5612-4f44-a0f2-a36c147d725e admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:26.619878 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593dc6c1-13a0-4ac9-b160-277660ca6429 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:26.620676 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593dc6c1-13a0-4ac9-b160-277660ca6429 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:26.620958 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593dc6c1-13a0-4ac9-b160-277660ca6429 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:26.621228 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593dc6c1-13a0-4ac9-b160-277660ca6429 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:26.632818 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593dc6c1-13a0-4ac9-b160-277660ca6429 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:26.634976 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593dc6c1-13a0-4ac9-b160-277660ca6429 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:26.653432 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: WARNING keystone.server.flask.application [None req-593dc6c1-13a0-4ac9-b160-277660ca6429 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 12 16:37:26.656018 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9769797-cfaa-42ce-b819-162b0d8ab132 None None] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:26.656305 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9769797-cfaa-42ce-b819-162b0d8ab132 None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:26.656580 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9769797-cfaa-42ce-b819-162b0d8ab132 None None] PATH_INFO: `/` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:26.658363 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 188/384] 10.222.0.58 () {54 vars in 926 bytes} [Tue Oct 12 16:37:26 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 12 16:37:26.658703 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 197/385] 10.222.0.58 () {56 vars in 1114 bytes} [Tue Oct 12 16:37:26 2021] GET /identity/v3/users/nova => generated 82 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:37:26.666512 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eeeb6cd-a97b-48c8-b239-2ef25ed2400b None None] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:26.666512 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eeeb6cd-a97b-48c8-b239-2ef25ed2400b None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:26.666512 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eeeb6cd-a97b-48c8-b239-2ef25ed2400b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:26.667038 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593dc6c1-13a0-4ac9-b160-277660ca6429 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:26.681130 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593dc6c1-13a0-4ac9-b160-277660ca6429 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:26.685638 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a519e581-d856-4d9b-9f7b-809d46cdbdc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:26.686330 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a519e581-d856-4d9b-9f7b-809d46cdbdc7 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:26.686609 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a519e581-d856-4d9b-9f7b-809d46cdbdc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:26.686881 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a519e581-d856-4d9b-9f7b-809d46cdbdc7 admin admin] PATH_INFO: `/v3/users` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:26.687732 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a519e581-d856-4d9b-9f7b-809d46cdbdc7 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=85204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:37:26.688043 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a519e581-d856-4d9b-9f7b-809d46cdbdc7 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:26.689053 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: WARNING py.warnings [None req-a519e581-d856-4d9b-9f7b-809d46cdbdc7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:list_users failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 12 16:37:26.689053 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: warnings.warn(msg) Oct 12 16:37:26.689053 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: Oct 12 16:37:26.690216 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a519e581-d856-4d9b-9f7b-809d46cdbdc7 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:26.692464 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.auth.core [None req-3eeeb6cd-a97b-48c8-b239-2ef25ed2400b None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:37:26.694425 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-3eeeb6cd-a97b-48c8-b239-2ef25ed2400b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:37:26.702513 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 189/386] 10.222.0.58 () {58 vars in 1023 bytes} [Tue Oct 12 16:37:26 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:37:26.711563 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415cb24b-09bc-4a62-9da6-f5889ad607b5 None None] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:26.712076 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415cb24b-09bc-4a62-9da6-f5889ad607b5 None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:26.712554 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415cb24b-09bc-4a62-9da6-f5889ad607b5 None None] PATH_INFO: `/` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:26.714520 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 190/387] 10.222.0.58 () {54 vars in 926 bytes} [Tue Oct 12 16:37:26 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:37:26.724381 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0789dd3d-08e9-44bb-bb71-f45a3d443338 None None] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:26.724659 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0789dd3d-08e9-44bb-bb71-f45a3d443338 None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:26.724934 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0789dd3d-08e9-44bb-bb71-f45a3d443338 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:26.728409 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 198/388] 10.222.0.58 () {56 vars in 1154 bytes} [Tue Oct 12 16:37:26 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:37:26.734909 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a519e581-d856-4d9b-9f7b-809d46cdbdc7 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:26.751486 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a519e581-d856-4d9b-9f7b-809d46cdbdc7 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:26.757229 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.auth.core [None req-0789dd3d-08e9-44bb-bb71-f45a3d443338 None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:37:26.758723 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-0789dd3d-08e9-44bb-bb71-f45a3d443338 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:37:26.759099 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5cc314-3270-4b1c-b5db-34d5b08613aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:26.759904 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5cc314-3270-4b1c-b5db-34d5b08613aa admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:26.760315 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5cc314-3270-4b1c-b5db-34d5b08613aa admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:26.760697 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5cc314-3270-4b1c-b5db-34d5b08613aa admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:26.767611 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 191/389] 10.222.0.58 () {58 vars in 1023 bytes} [Tue Oct 12 16:37:26 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Oct 12 16:37:26.768615 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0789dd3d-08e9-44bb-bb71-f45a3d443338 None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:26.776085 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5cc314-3270-4b1c-b5db-34d5b08613aa admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:26.777953 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5cc314-3270-4b1c-b5db-34d5b08613aa admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:26.778395 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0789dd3d-08e9-44bb-bb71-f45a3d443338 None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:26.783088 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec3c4f6-782f-46be-9953-a5cd0d03b7a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:26.784085 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec3c4f6-782f-46be-9953-a5cd0d03b7a1 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:26.784565 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec3c4f6-782f-46be-9953-a5cd0d03b7a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:26.785037 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec3c4f6-782f-46be-9953-a5cd0d03b7a1 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:26.795674 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 199/390] 10.222.0.58 () {58 vars in 1324 bytes} [Tue Oct 12 16:37:26 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 12 16:37:26.802905 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5cc314-3270-4b1c-b5db-34d5b08613aa admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:26.807668 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec3c4f6-782f-46be-9953-a5cd0d03b7a1 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 16:37:26.814941 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: WARNING keystone.server.flask.application [None req-7ec3c4f6-782f-46be-9953-a5cd0d03b7a1 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 12 16:37:26.816309 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 192/391] 10.222.0.58 () {56 vars in 1123 bytes} [Tue Oct 12 16:37:26 2021] GET /identity/v3/roles/service => generated 85 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:37:26.820842 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec3c4f6-782f-46be-9953-a5cd0d03b7a1 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:26.829478 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5cc314-3270-4b1c-b5db-34d5b08613aa admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:26.831491 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec3c4f6-782f-46be-9953-a5cd0d03b7a1 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:26.834241 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0420d04-899b-4703-a545-943da14ecbfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:26.835028 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0420d04-899b-4703-a545-943da14ecbfd admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:26.835318 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0420d04-899b-4703-a545-943da14ecbfd admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:26.835586 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0420d04-899b-4703-a545-943da14ecbfd admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:26.837706 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b99fe8c-817e-4062-b5d0-043be9402c59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:26.838732 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b99fe8c-817e-4062-b5d0-043be9402c59 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:26.839212 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b99fe8c-817e-4062-b5d0-043be9402c59 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:26.839678 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b99fe8c-817e-4062-b5d0-043be9402c59 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:26.847816 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0420d04-899b-4703-a545-943da14ecbfd admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:26.850655 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0420d04-899b-4703-a545-943da14ecbfd admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:26.852311 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b99fe8c-817e-4062-b5d0-043be9402c59 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 16:37:26.859752 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: WARNING keystone.server.flask.application [None req-4b99fe8c-817e-4062-b5d0-043be9402c59 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 12 16:37:26.861227 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 193/392] 10.222.0.58 () {56 vars in 1123 bytes} [Tue Oct 12 16:37:26 2021] GET /identity/v3/roles/service => generated 85 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:37:26.862252 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b99fe8c-817e-4062-b5d0-043be9402c59 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:26.872800 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b99fe8c-817e-4062-b5d0-043be9402c59 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:26.877543 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: WARNING keystone.server.flask.application [None req-f0420d04-899b-4703-a545-943da14ecbfd admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 16:37:26.878009 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d83b52f-9eea-45f0-8320-a91a9e285104 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:26.878792 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 200/393] 10.222.0.58 () {56 vars in 1129 bytes} [Tue Oct 12 16:37:26 2021] GET /identity/v3/domains/Default => generated 87 bytes in 77 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 16:37:26.879168 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d83b52f-9eea-45f0-8320-a91a9e285104 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:26.879574 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0420d04-899b-4703-a545-943da14ecbfd admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:26.879951 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d83b52f-9eea-45f0-8320-a91a9e285104 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:26.880517 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d83b52f-9eea-45f0-8320-a91a9e285104 admin admin] PATH_INFO: `/v3/roles` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:26.881782 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d83b52f-9eea-45f0-8320-a91a9e285104 admin admin] RBAC: Adding query filter params (name=service) {{(pid=85205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:37:26.882313 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d83b52f-9eea-45f0-8320-a91a9e285104 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:26.884241 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d83b52f-9eea-45f0-8320-a91a9e285104 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:26.890794 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0420d04-899b-4703-a545-943da14ecbfd admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:26.893861 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 194/394] 10.222.0.58 () {56 vars in 1124 bytes} [Tue Oct 12 16:37:26 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:37:26.895032 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d83b52f-9eea-45f0-8320-a91a9e285104 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:26.901036 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600f7060-05b1-43df-8db3-6726d054490b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:26.901719 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600f7060-05b1-43df-8db3-6726d054490b admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:26.902050 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600f7060-05b1-43df-8db3-6726d054490b admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:26.902325 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600f7060-05b1-43df-8db3-6726d054490b admin admin] PATH_INFO: `/v3/roles` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:26.903683 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600f7060-05b1-43df-8db3-6726d054490b admin admin] RBAC: Adding query filter params (name=service) {{(pid=85204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:37:26.903999 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600f7060-05b1-43df-8db3-6726d054490b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:26.905937 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600f7060-05b1-43df-8db3-6726d054490b admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:26.907699 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d83b52f-9eea-45f0-8320-a91a9e285104 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:26.913241 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8145e33-8e09-47ee-8d0b-de763d08eb6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:26.914216 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8145e33-8e09-47ee-8d0b-de763d08eb6c admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:26.914701 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8145e33-8e09-47ee-8d0b-de763d08eb6c admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:26.915172 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8145e33-8e09-47ee-8d0b-de763d08eb6c admin admin] PATH_INFO: `/v3/domains` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:26.915311 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 201/395] 10.222.0.58 () {56 vars in 1124 bytes} [Tue Oct 12 16:37:26 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:37:26.916025 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600f7060-05b1-43df-8db3-6726d054490b admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:26.916604 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8145e33-8e09-47ee-8d0b-de763d08eb6c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:37:26.917149 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8145e33-8e09-47ee-8d0b-de763d08eb6c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:26.919094 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8145e33-8e09-47ee-8d0b-de763d08eb6c admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:26.932756 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600f7060-05b1-43df-8db3-6726d054490b admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:26.933678 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 195/396] 10.222.0.58 () {56 vars in 1130 bytes} [Tue Oct 12 16:37:26 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:37:26.934921 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8145e33-8e09-47ee-8d0b-de763d08eb6c admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:26.937438 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8f6687-35fb-4f3f-b0ec-c434705e44cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:26.938255 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8f6687-35fb-4f3f-b0ec-c434705e44cb admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:26.938687 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8f6687-35fb-4f3f-b0ec-c434705e44cb admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:26.938895 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8f6687-35fb-4f3f-b0ec-c434705e44cb admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:26.946624 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8145e33-8e09-47ee-8d0b-de763d08eb6c admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:26.951454 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8f6687-35fb-4f3f-b0ec-c434705e44cb admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:26.952198 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3418cc-256d-4db0-a901-76e9db3c960d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:26.953279 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3418cc-256d-4db0-a901-76e9db3c960d admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:26.953388 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8f6687-35fb-4f3f-b0ec-c434705e44cb admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:26.954061 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3418cc-256d-4db0-a901-76e9db3c960d admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:26.954594 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3418cc-256d-4db0-a901-76e9db3c960d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:26.966337 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3418cc-256d-4db0-a901-76e9db3c960d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:26.968648 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3418cc-256d-4db0-a901-76e9db3c960d admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:26.974095 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: WARNING keystone.server.flask.application [None req-ee8f6687-35fb-4f3f-b0ec-c434705e44cb admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 16:37:26.975510 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 202/397] 10.222.0.58 () {56 vars in 1129 bytes} [Tue Oct 12 16:37:26 2021] GET /identity/v3/domains/Default => generated 87 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:37:26.976114 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8f6687-35fb-4f3f-b0ec-c434705e44cb admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:26.992029 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8f6687-35fb-4f3f-b0ec-c434705e44cb admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:26.992897 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: WARNING keystone.server.flask.application [None req-be3418cc-256d-4db0-a901-76e9db3c960d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 16:37:26.994566 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 196/398] 10.222.0.58 () {56 vars in 1129 bytes} [Tue Oct 12 16:37:26 2021] GET /identity/v3/domains/Default => generated 87 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:37:26.995580 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3418cc-256d-4db0-a901-76e9db3c960d admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:27.001793 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f396d81-c63c-4490-9028-4a8cb09296fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:27.003136 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f396d81-c63c-4490-9028-4a8cb09296fc admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:27.003426 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f396d81-c63c-4490-9028-4a8cb09296fc admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:27.003702 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f396d81-c63c-4490-9028-4a8cb09296fc admin admin] PATH_INFO: `/v3/projects/service` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:27.007198 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3418cc-256d-4db0-a901-76e9db3c960d admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:27.011485 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f396d81-c63c-4490-9028-4a8cb09296fc admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:27.012301 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd432a56-2101-4806-a8c3-9f19700007cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:27.013253 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd432a56-2101-4806-a8c3-9f19700007cf admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:27.013506 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f396d81-c63c-4490-9028-4a8cb09296fc admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:27.014157 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd432a56-2101-4806-a8c3-9f19700007cf admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:27.014666 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd432a56-2101-4806-a8c3-9f19700007cf admin admin] PATH_INFO: `/v3/domains` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:27.015640 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd432a56-2101-4806-a8c3-9f19700007cf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:37:27.016192 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd432a56-2101-4806-a8c3-9f19700007cf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:27.018122 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd432a56-2101-4806-a8c3-9f19700007cf admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:27.028990 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: WARNING keystone.server.flask.application [None req-6f396d81-c63c-4490-9028-4a8cb09296fc admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 16:37:27.030394 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 203/399] 10.222.0.58 () {56 vars in 1132 bytes} [Tue Oct 12 16:37:26 2021] GET /identity/v3/projects/service => generated 88 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:37:27.031016 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f396d81-c63c-4490-9028-4a8cb09296fc admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:27.031955 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 197/400] 10.222.0.58 () {56 vars in 1130 bytes} [Tue Oct 12 16:37:26 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:37:27.037579 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd432a56-2101-4806-a8c3-9f19700007cf admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:27.041463 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f396d81-c63c-4490-9028-4a8cb09296fc admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:27.046743 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b65cf8a-3b3d-4ba4-86b8-9968c6675c83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:27.047665 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b65cf8a-3b3d-4ba4-86b8-9968c6675c83 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:27.047956 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b65cf8a-3b3d-4ba4-86b8-9968c6675c83 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:27.048234 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b65cf8a-3b3d-4ba4-86b8-9968c6675c83 admin admin] PATH_INFO: `/v3/domains` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:27.048977 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b65cf8a-3b3d-4ba4-86b8-9968c6675c83 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:37:27.049288 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b65cf8a-3b3d-4ba4-86b8-9968c6675c83 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:27.050682 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd432a56-2101-4806-a8c3-9f19700007cf admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:27.051324 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b65cf8a-3b3d-4ba4-86b8-9968c6675c83 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:27.056534 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d508315b-ae9a-4126-9832-3b9572e76b73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:27.057476 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d508315b-ae9a-4126-9832-3b9572e76b73 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:27.057991 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d508315b-ae9a-4126-9832-3b9572e76b73 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:27.058552 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d508315b-ae9a-4126-9832-3b9572e76b73 admin admin] PATH_INFO: `/v3/projects` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:27.059599 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d508315b-ae9a-4126-9832-3b9572e76b73 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=85205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:37:27.060156 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d508315b-ae9a-4126-9832-3b9572e76b73 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:27.061439 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: WARNING py.warnings [None req-d508315b-ae9a-4126-9832-3b9572e76b73 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:list_projects failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 12 16:37:27.061439 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: warnings.warn(msg) Oct 12 16:37:27.061439 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: Oct 12 16:37:27.062937 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d508315b-ae9a-4126-9832-3b9572e76b73 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:27.063781 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 204/401] 10.222.0.58 () {56 vars in 1130 bytes} [Tue Oct 12 16:37:27 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:37:27.064581 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b65cf8a-3b3d-4ba4-86b8-9968c6675c83 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:27.080860 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b65cf8a-3b3d-4ba4-86b8-9968c6675c83 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:27.085778 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f32bbb-1574-4476-8ed0-ee7ccdd0bdaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:27.086829 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f32bbb-1574-4476-8ed0-ee7ccdd0bdaa admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:27.087334 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f32bbb-1574-4476-8ed0-ee7ccdd0bdaa admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:27.087807 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f32bbb-1574-4476-8ed0-ee7ccdd0bdaa admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:27.092016 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 198/402] 10.222.0.58 () {56 vars in 1169 bytes} [Tue Oct 12 16:37:27 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:37:27.092951 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d508315b-ae9a-4126-9832-3b9572e76b73 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:27.096860 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f32bbb-1574-4476-8ed0-ee7ccdd0bdaa admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:27.099957 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f32bbb-1574-4476-8ed0-ee7ccdd0bdaa admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:27.104346 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d508315b-ae9a-4126-9832-3b9572e76b73 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:27.109360 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9baaf843-17e7-458a-a3dd-9365e4c4c7ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:27.110283 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baaf843-17e7-458a-a3dd-9365e4c4c7ea admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:27.110566 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baaf843-17e7-458a-a3dd-9365e4c4c7ea admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:27.110842 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baaf843-17e7-458a-a3dd-9365e4c4c7ea admin admin] PATH_INFO: `/v3/users/glance` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:27.115921 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: WARNING keystone.server.flask.application [None req-20f32bbb-1574-4476-8ed0-ee7ccdd0bdaa admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 12 16:37:27.117346 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 205/403] 10.222.0.58 () {56 vars in 1120 bytes} [Tue Oct 12 16:37:27 2021] GET /identity/v3/users/cinder => generated 84 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:37:27.122814 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9baaf843-17e7-458a-a3dd-9365e4c4c7ea admin admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:27.122814 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9baaf843-17e7-458a-a3dd-9365e4c4c7ea admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:27.123013 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f32bbb-1574-4476-8ed0-ee7ccdd0bdaa admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:27.141462 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f32bbb-1574-4476-8ed0-ee7ccdd0bdaa admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:27.141791 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: WARNING keystone.server.flask.application [None req-9baaf843-17e7-458a-a3dd-9365e4c4c7ea admin admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Oct 12 16:37:27.143175 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 199/404] 10.222.0.58 () {56 vars in 1120 bytes} [Tue Oct 12 16:37:27 2021] GET /identity/v3/users/glance => generated 84 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:37:27.143778 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9baaf843-17e7-458a-a3dd-9365e4c4c7ea admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:27.147452 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451eb897-9118-474c-973e-3b910bd9b46f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:27.148372 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451eb897-9118-474c-973e-3b910bd9b46f admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:27.148867 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451eb897-9118-474c-973e-3b910bd9b46f admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:27.149855 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451eb897-9118-474c-973e-3b910bd9b46f admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:27.151519 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451eb897-9118-474c-973e-3b910bd9b46f admin admin] RBAC: Adding query filter params (role.id=dea461b7131b413590d73da4994002ca, scope.project.id=f3531f242eaa43b69562d70bca5ec5a8, user.id=29d30b574eec4ad3990d77d235c8b424) {{(pid=85204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:37:27.152321 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451eb897-9118-474c-973e-3b910bd9b46f admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:27.155791 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451eb897-9118-474c-973e-3b910bd9b46f admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:27.158585 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9baaf843-17e7-458a-a3dd-9365e4c4c7ea admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:27.164283 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 206/405] 10.222.0.58 () {56 vars in 1395 bytes} [Tue Oct 12 16:37:27 2021] GET /identity/v3/role_assignments?user.id=29d30b574eec4ad3990d77d235c8b424&scope.project.id=f3531f242eaa43b69562d70bca5ec5a8&role.id=dea461b7131b413590d73da4994002ca => generated 259 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:37:27.164464 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa04eba-0df8-4597-8aab-f5a8d5732959 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:27.165183 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa04eba-0df8-4597-8aab-f5a8d5732959 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:27.165523 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa04eba-0df8-4597-8aab-f5a8d5732959 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:27.165805 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa04eba-0df8-4597-8aab-f5a8d5732959 admin admin] PATH_INFO: `/v3/users` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:27.166326 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451eb897-9118-474c-973e-3b910bd9b46f admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:27.166809 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa04eba-0df8-4597-8aab-f5a8d5732959 admin admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=85205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:37:27.167143 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa04eba-0df8-4597-8aab-f5a8d5732959 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:27.168286 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: WARNING py.warnings [None req-4aa04eba-0df8-4597-8aab-f5a8d5732959 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:list_users failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 12 16:37:27.168286 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: warnings.warn(msg) Oct 12 16:37:27.168286 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: Oct 12 16:37:27.169512 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa04eba-0df8-4597-8aab-f5a8d5732959 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:27.178528 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451eb897-9118-474c-973e-3b910bd9b46f admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:27.184880 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9953e0ac-d4e3-4996-aa3c-836eb981f60f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:27.185990 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9953e0ac-d4e3-4996-aa3c-836eb981f60f admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:27.186479 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9953e0ac-d4e3-4996-aa3c-836eb981f60f admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:27.186952 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9953e0ac-d4e3-4996-aa3c-836eb981f60f admin admin] PATH_INFO: `/v3/users` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:27.188404 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9953e0ac-d4e3-4996-aa3c-836eb981f60f admin admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=85204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:37:27.188965 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9953e0ac-d4e3-4996-aa3c-836eb981f60f admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:27.191325 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9953e0ac-d4e3-4996-aa3c-836eb981f60f admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:27.212675 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 200/406] 10.222.0.58 () {56 vars in 1158 bytes} [Tue Oct 12 16:37:27 2021] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:37:27.220315 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 207/407] 10.222.0.58 () {56 vars in 1158 bytes} [Tue Oct 12 16:37:27 2021] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:37:27.221102 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa04eba-0df8-4597-8aab-f5a8d5732959 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:27.234265 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9953e0ac-d4e3-4996-aa3c-836eb981f60f admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:27.239526 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa04eba-0df8-4597-8aab-f5a8d5732959 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:27.245450 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9953e0ac-d4e3-4996-aa3c-836eb981f60f admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:27.250043 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b55011-0284-4c62-9934-da6fa6f47f5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:27.250722 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b55011-0284-4c62-9934-da6fa6f47f5d admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:27.250989 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b55011-0284-4c62-9934-da6fa6f47f5d admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:27.251319 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b55011-0284-4c62-9934-da6fa6f47f5d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:27.251982 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f7e461-4cc7-4080-aca8-90b5670184a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:27.252865 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f7e461-4cc7-4080-aca8-90b5670184a8 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:27.253361 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f7e461-4cc7-4080-aca8-90b5670184a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:27.253834 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f7e461-4cc7-4080-aca8-90b5670184a8 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:27.265262 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f7e461-4cc7-4080-aca8-90b5670184a8 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:27.268322 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f7e461-4cc7-4080-aca8-90b5670184a8 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:27.271403 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b55011-0284-4c62-9934-da6fa6f47f5d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:27.273382 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b55011-0284-4c62-9934-da6fa6f47f5d admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:27.280529 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 208/408] 10.222.0.58 () {58 vars in 1324 bytes} [Tue Oct 12 16:37:27 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 12 16:37:27.292173 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f7e461-4cc7-4080-aca8-90b5670184a8 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:27.298034 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 201/409] 10.222.0.58 () {58 vars in 1324 bytes} [Tue Oct 12 16:37:27 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:37:27.304891 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b55011-0284-4c62-9934-da6fa6f47f5d admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:27.311385 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f7e461-4cc7-4080-aca8-90b5670184a8 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:27.315865 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b55011-0284-4c62-9934-da6fa6f47f5d admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:27.321160 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662440ca-00ac-48c5-894c-aaa19c336cb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:27.321318 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd39b076-14f5-4b2d-a88c-ce217fcd0fe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:27.322157 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd39b076-14f5-4b2d-a88c-ce217fcd0fe9 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:27.322492 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd39b076-14f5-4b2d-a88c-ce217fcd0fe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:27.322771 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd39b076-14f5-4b2d-a88c-ce217fcd0fe9 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:27.323027 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662440ca-00ac-48c5-894c-aaa19c336cb5 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:27.323580 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662440ca-00ac-48c5-894c-aaa19c336cb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:27.324070 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662440ca-00ac-48c5-894c-aaa19c336cb5 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:27.337107 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662440ca-00ac-48c5-894c-aaa19c336cb5 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:27.337821 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd39b076-14f5-4b2d-a88c-ce217fcd0fe9 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:27.339590 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662440ca-00ac-48c5-894c-aaa19c336cb5 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:27.339705 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd39b076-14f5-4b2d-a88c-ce217fcd0fe9 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:27.359079 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: WARNING keystone.server.flask.application [None req-662440ca-00ac-48c5-894c-aaa19c336cb5 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 16:37:27.361337 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 202/410] 10.222.0.58 () {56 vars in 1129 bytes} [Tue Oct 12 16:37:27 2021] GET /identity/v3/domains/Default => generated 87 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:37:27.367374 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5f83e1-a4e3-4646-bc70-1fc6df29d2eb None None] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:27.367984 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5f83e1-a4e3-4646-bc70-1fc6df29d2eb None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:27.368460 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5f83e1-a4e3-4646-bc70-1fc6df29d2eb None None] PATH_INFO: `/` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:27.369344 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: WARNING keystone.server.flask.application [None req-fd39b076-14f5-4b2d-a88c-ce217fcd0fe9 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 16:37:27.370625 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 209/411] 10.222.0.58 () {56 vars in 1129 bytes} [Tue Oct 12 16:37:27 2021] GET /identity/v3/domains/Default => generated 87 bytes in 80 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:37:27.371344 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 203/412] 10.222.0.58 () {54 vars in 926 bytes} [Tue Oct 12 16:37:27 2021] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:37:27.374833 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd39b076-14f5-4b2d-a88c-ce217fcd0fe9 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:27.376484 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5f83e1-a4e3-4646-bc70-1fc6df29d2eb None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:27.386865 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd39b076-14f5-4b2d-a88c-ce217fcd0fe9 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:27.391027 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5f83e1-a4e3-4646-bc70-1fc6df29d2eb None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:27.392000 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de3afd0-8269-4c7d-8581-0d880b4670e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:27.392665 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de3afd0-8269-4c7d-8581-0d880b4670e0 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:27.393018 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de3afd0-8269-4c7d-8581-0d880b4670e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:27.393362 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de3afd0-8269-4c7d-8581-0d880b4670e0 admin admin] PATH_INFO: `/v3/domains` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:27.394233 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de3afd0-8269-4c7d-8581-0d880b4670e0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:37:27.394615 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de3afd0-8269-4c7d-8581-0d880b4670e0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:27.396839 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de3afd0-8269-4c7d-8581-0d880b4670e0 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:27.398066 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c224b0-0d0c-44a9-953a-86d923022328 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:27.398994 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c224b0-0d0c-44a9-953a-86d923022328 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:27.399562 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c224b0-0d0c-44a9-953a-86d923022328 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:27.400044 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c224b0-0d0c-44a9-953a-86d923022328 admin admin] PATH_INFO: `/v3/domains` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:27.401101 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c224b0-0d0c-44a9-953a-86d923022328 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:37:27.401666 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c224b0-0d0c-44a9-953a-86d923022328 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:27.403649 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c224b0-0d0c-44a9-953a-86d923022328 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:27.410552 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 210/413] 10.222.0.58 () {56 vars in 1130 bytes} [Tue Oct 12 16:37:27 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:37:27.417426 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8eb9245-1a27-4c1a-a0aa-c89e3514172b None None] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:27.417739 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8eb9245-1a27-4c1a-a0aa-c89e3514172b None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:27.418038 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8eb9245-1a27-4c1a-a0aa-c89e3514172b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:27.419453 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 204/414] 10.222.0.58 () {56 vars in 1130 bytes} [Tue Oct 12 16:37:27 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:37:27.420807 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c224b0-0d0c-44a9-953a-86d923022328 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:27.431428 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c224b0-0d0c-44a9-953a-86d923022328 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:27.436806 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d11f61-7614-4149-b7ba-9d249731fff8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:27.437459 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.auth.core [None req-d8eb9245-1a27-4c1a-a0aa-c89e3514172b None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:37:27.438377 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d11f61-7614-4149-b7ba-9d249731fff8 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:27.438963 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d11f61-7614-4149-b7ba-9d249731fff8 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:27.439178 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-d8eb9245-1a27-4c1a-a0aa-c89e3514172b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:37:27.439640 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d11f61-7614-4149-b7ba-9d249731fff8 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:27.453000 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 211/415] 10.222.0.58 () {58 vars in 1023 bytes} [Tue Oct 12 16:37:27 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:37:27.455123 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d11f61-7614-4149-b7ba-9d249731fff8 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:27.457375 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d11f61-7614-4149-b7ba-9d249731fff8 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:27.459333 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8eb9245-1a27-4c1a-a0aa-c89e3514172b None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:27.473300 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8eb9245-1a27-4c1a-a0aa-c89e3514172b None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:27.475297 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: WARNING keystone.server.flask.application [None req-02d11f61-7614-4149-b7ba-9d249731fff8 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 16:37:27.476845 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 205/416] 10.222.0.58 () {56 vars in 1132 bytes} [Tue Oct 12 16:37:27 2021] GET /identity/v3/projects/service => generated 88 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 16:37:27.480257 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fedde4e-581f-4e4b-9f6b-c4f2e431eda0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:27.481045 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fedde4e-581f-4e4b-9f6b-c4f2e431eda0 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:27.481330 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fedde4e-581f-4e4b-9f6b-c4f2e431eda0 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:27.481607 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fedde4e-581f-4e4b-9f6b-c4f2e431eda0 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:27.488263 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d11f61-7614-4149-b7ba-9d249731fff8 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:27.489161 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fedde4e-581f-4e4b-9f6b-c4f2e431eda0 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:27.491159 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fedde4e-581f-4e4b-9f6b-c4f2e431eda0 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:27.498666 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d11f61-7614-4149-b7ba-9d249731fff8 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:27.503692 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd13ca8-5849-4ace-8b21-2202c0ac8329 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:27.504384 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd13ca8-5849-4ace-8b21-2202c0ac8329 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:27.504661 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: WARNING keystone.server.flask.application [None req-1fedde4e-581f-4e4b-9f6b-c4f2e431eda0 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 16:37:27.504780 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd13ca8-5849-4ace-8b21-2202c0ac8329 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:27.505100 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd13ca8-5849-4ace-8b21-2202c0ac8329 admin admin] PATH_INFO: `/v3/projects` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:27.506205 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd13ca8-5849-4ace-8b21-2202c0ac8329 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=85205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:37:27.506470 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 212/417] 10.222.0.58 () {56 vars in 1132 bytes} [Tue Oct 12 16:37:27 2021] GET /identity/v3/projects/service => generated 88 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:37:27.506651 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd13ca8-5849-4ace-8b21-2202c0ac8329 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:27.507255 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fedde4e-581f-4e4b-9f6b-c4f2e431eda0 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:27.508607 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd13ca8-5849-4ace-8b21-2202c0ac8329 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:27.523067 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fedde4e-581f-4e4b-9f6b-c4f2e431eda0 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:27.525964 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 206/418] 10.222.0.58 () {56 vars in 1169 bytes} [Tue Oct 12 16:37:27 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:37:27.526824 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd13ca8-5849-4ace-8b21-2202c0ac8329 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:27.532834 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac6467d-2acd-4635-bf86-f39d2b57e56f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:27.533721 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac6467d-2acd-4635-bf86-f39d2b57e56f admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:27.534055 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac6467d-2acd-4635-bf86-f39d2b57e56f admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:27.534786 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac6467d-2acd-4635-bf86-f39d2b57e56f admin admin] PATH_INFO: `/v3/roles/service` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:27.538754 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd13ca8-5849-4ace-8b21-2202c0ac8329 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:27.543768 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12fc306-c9b6-42b0-8aad-0177a4b75718 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:27.544414 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12fc306-c9b6-42b0-8aad-0177a4b75718 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:27.544753 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12fc306-c9b6-42b0-8aad-0177a4b75718 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:27.545083 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12fc306-c9b6-42b0-8aad-0177a4b75718 admin admin] PATH_INFO: `/v3/projects` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:27.545796 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac6467d-2acd-4635-bf86-f39d2b57e56f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 16:37:27.545945 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12fc306-c9b6-42b0-8aad-0177a4b75718 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=85205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:37:27.546309 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12fc306-c9b6-42b0-8aad-0177a4b75718 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:27.548308 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12fc306-c9b6-42b0-8aad-0177a4b75718 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:27.553211 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: WARNING keystone.server.flask.application [None req-4ac6467d-2acd-4635-bf86-f39d2b57e56f admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 12 16:37:27.554746 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 213/419] 10.222.0.58 () {56 vars in 1123 bytes} [Tue Oct 12 16:37:27 2021] GET /identity/v3/roles/service => generated 85 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:37:27.555524 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac6467d-2acd-4635-bf86-f39d2b57e56f admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:27.562628 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 207/420] 10.222.0.58 () {56 vars in 1169 bytes} [Tue Oct 12 16:37:27 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:37:27.565105 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac6467d-2acd-4635-bf86-f39d2b57e56f admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:27.568380 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12fc306-c9b6-42b0-8aad-0177a4b75718 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:27.570610 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca5c638-92d1-42f1-9908-a157993c863e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:27.571247 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca5c638-92d1-42f1-9908-a157993c863e admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:27.571530 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca5c638-92d1-42f1-9908-a157993c863e admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:27.571803 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca5c638-92d1-42f1-9908-a157993c863e admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:27.572642 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca5c638-92d1-42f1-9908-a157993c863e admin admin] RBAC: Adding query filter params (role.id=dea461b7131b413590d73da4994002ca, scope.project.id=f3531f242eaa43b69562d70bca5ec5a8, user.id=04704222b3d64a33a6c092fc641ccbb0) {{(pid=85204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:37:27.572949 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca5c638-92d1-42f1-9908-a157993c863e admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:27.574808 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca5c638-92d1-42f1-9908-a157993c863e admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:27.579511 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12fc306-c9b6-42b0-8aad-0177a4b75718 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:27.580813 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 214/421] 10.222.0.58 () {56 vars in 1395 bytes} [Tue Oct 12 16:37:27 2021] GET /identity/v3/role_assignments?user.id=04704222b3d64a33a6c092fc641ccbb0&scope.project.id=f3531f242eaa43b69562d70bca5ec5a8&role.id=dea461b7131b413590d73da4994002ca => generated 259 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:37:27.581693 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca5c638-92d1-42f1-9908-a157993c863e admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:27.591677 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900e81ff-09ec-4b77-9a8a-70c7e2b5e910 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:27.592223 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca5c638-92d1-42f1-9908-a157993c863e admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:27.592401 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900e81ff-09ec-4b77-9a8a-70c7e2b5e910 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:27.592672 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900e81ff-09ec-4b77-9a8a-70c7e2b5e910 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:27.592941 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900e81ff-09ec-4b77-9a8a-70c7e2b5e910 admin admin] PATH_INFO: `/v3/roles` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:27.593811 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900e81ff-09ec-4b77-9a8a-70c7e2b5e910 admin admin] RBAC: Adding query filter params (name=service) {{(pid=85205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:37:27.594225 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900e81ff-09ec-4b77-9a8a-70c7e2b5e910 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:27.595906 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900e81ff-09ec-4b77-9a8a-70c7e2b5e910 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:27.596775 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84299f8d-50e4-413d-b9e7-999630b87189 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:27.597477 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84299f8d-50e4-413d-b9e7-999630b87189 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:27.597668 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84299f8d-50e4-413d-b9e7-999630b87189 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:27.597995 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84299f8d-50e4-413d-b9e7-999630b87189 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:27.598880 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84299f8d-50e4-413d-b9e7-999630b87189 admin admin] RBAC: Adding query filter params (role.id=dea461b7131b413590d73da4994002ca, scope.project.id=f3531f242eaa43b69562d70bca5ec5a8, user.id=8ff84015069041f2bf33e3fd55b92e44) {{(pid=85204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:37:27.599192 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84299f8d-50e4-413d-b9e7-999630b87189 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:27.601140 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84299f8d-50e4-413d-b9e7-999630b87189 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:27.607547 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 215/422] 10.222.0.58 () {56 vars in 1395 bytes} [Tue Oct 12 16:37:27 2021] GET /identity/v3/role_assignments?user.id=8ff84015069041f2bf33e3fd55b92e44&scope.project.id=f3531f242eaa43b69562d70bca5ec5a8&role.id=dea461b7131b413590d73da4994002ca => generated 259 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:37:27.614682 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 208/423] 10.222.0.58 () {56 vars in 1124 bytes} [Tue Oct 12 16:37:27 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:37:27.621292 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84299f8d-50e4-413d-b9e7-999630b87189 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:27.637323 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84299f8d-50e4-413d-b9e7-999630b87189 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:27.651081 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b5ba4d-d486-450a-b19c-c5af2902d625 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:27.652055 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b5ba4d-d486-450a-b19c-c5af2902d625 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:27.652436 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b5ba4d-d486-450a-b19c-c5af2902d625 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:27.652807 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b5ba4d-d486-450a-b19c-c5af2902d625 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:27.670294 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b5ba4d-d486-450a-b19c-c5af2902d625 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:27.672324 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b5ba4d-d486-450a-b19c-c5af2902d625 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:27.699506 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: WARNING keystone.server.flask.application [None req-02b5ba4d-d486-450a-b19c-c5af2902d625 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 16:37:27.700937 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 216/424] 10.222.0.58 () {56 vars in 1129 bytes} [Tue Oct 12 16:37:27 2021] GET /identity/v3/domains/Default => generated 87 bytes in 80 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:37:27.707466 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900e81ff-09ec-4b77-9a8a-70c7e2b5e910 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:27.730174 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900e81ff-09ec-4b77-9a8a-70c7e2b5e910 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:27.739612 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6badf3-4f4b-4a57-800f-8a9d965b8dcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:27.740442 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6badf3-4f4b-4a57-800f-8a9d965b8dcd admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:27.740827 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6badf3-4f4b-4a57-800f-8a9d965b8dcd admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:27.741198 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6badf3-4f4b-4a57-800f-8a9d965b8dcd admin admin] PATH_INFO: `/v3/domains` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:27.742073 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6badf3-4f4b-4a57-800f-8a9d965b8dcd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:37:27.742481 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6badf3-4f4b-4a57-800f-8a9d965b8dcd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:27.744241 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6badf3-4f4b-4a57-800f-8a9d965b8dcd admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:27.765532 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 209/425] 10.222.0.58 () {56 vars in 1130 bytes} [Tue Oct 12 16:37:27 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:37:27.772622 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b5ba4d-d486-450a-b19c-c5af2902d625 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:27.787546 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b5ba4d-d486-450a-b19c-c5af2902d625 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:27.792313 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2892f7e-bf3e-4cba-93cb-887ade58d7fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:27.793314 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2892f7e-bf3e-4cba-93cb-887ade58d7fd admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:27.793694 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2892f7e-bf3e-4cba-93cb-887ade58d7fd admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:27.794088 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2892f7e-bf3e-4cba-93cb-887ade58d7fd admin admin] PATH_INFO: `/v3/users/neutron` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:27.803367 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2892f7e-bf3e-4cba-93cb-887ade58d7fd admin admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:27.805557 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2892f7e-bf3e-4cba-93cb-887ade58d7fd admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:27.825008 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: WARNING keystone.server.flask.application [None req-c2892f7e-bf3e-4cba-93cb-887ade58d7fd admin admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Oct 12 16:37:27.831357 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 217/426] 10.222.0.58 () {56 vars in 1123 bytes} [Tue Oct 12 16:37:27 2021] GET /identity/v3/users/neutron => generated 85 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:37:27.838559 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6badf3-4f4b-4a57-800f-8a9d965b8dcd admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:27.851196 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6badf3-4f4b-4a57-800f-8a9d965b8dcd admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:27.857398 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05a0c8f-a639-402e-b8de-34d6d35b40d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:27.858120 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05a0c8f-a639-402e-b8de-34d6d35b40d9 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:27.858455 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05a0c8f-a639-402e-b8de-34d6d35b40d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:27.858734 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05a0c8f-a639-402e-b8de-34d6d35b40d9 admin admin] PATH_INFO: `/v3/users` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:27.859662 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05a0c8f-a639-402e-b8de-34d6d35b40d9 admin admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=85205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:37:27.860034 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05a0c8f-a639-402e-b8de-34d6d35b40d9 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:27.861934 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05a0c8f-a639-402e-b8de-34d6d35b40d9 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:27.885541 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 210/427] 10.222.0.58 () {56 vars in 1160 bytes} [Tue Oct 12 16:37:27 2021] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:37:27.891709 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2892f7e-bf3e-4cba-93cb-887ade58d7fd admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:27.902618 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2892f7e-bf3e-4cba-93cb-887ade58d7fd admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:27.907262 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8785cb2d-e882-4a26-b3d1-50ed89426921 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:27.907995 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8785cb2d-e882-4a26-b3d1-50ed89426921 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:27.908399 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8785cb2d-e882-4a26-b3d1-50ed89426921 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:27.908749 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8785cb2d-e882-4a26-b3d1-50ed89426921 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:27.918179 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8785cb2d-e882-4a26-b3d1-50ed89426921 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:27.920150 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8785cb2d-e882-4a26-b3d1-50ed89426921 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:27.934578 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 218/428] 10.222.0.58 () {58 vars in 1324 bytes} [Tue Oct 12 16:37:27 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 12 16:37:27.941387 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05a0c8f-a639-402e-b8de-34d6d35b40d9 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:27.959320 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05a0c8f-a639-402e-b8de-34d6d35b40d9 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:27.966007 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79c76f9-af43-4f51-90ca-018c41c29e0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:27.966912 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79c76f9-af43-4f51-90ca-018c41c29e0e admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:27.967271 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79c76f9-af43-4f51-90ca-018c41c29e0e admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:27.967615 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79c76f9-af43-4f51-90ca-018c41c29e0e admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:27.979391 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79c76f9-af43-4f51-90ca-018c41c29e0e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:27.981316 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79c76f9-af43-4f51-90ca-018c41c29e0e admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:27.999750 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: WARNING keystone.server.flask.application [None req-f79c76f9-af43-4f51-90ca-018c41c29e0e admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 16:37:28.001407 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 211/429] 10.222.0.58 () {56 vars in 1129 bytes} [Tue Oct 12 16:37:27 2021] GET /identity/v3/domains/Default => generated 87 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:37:28.009095 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8785cb2d-e882-4a26-b3d1-50ed89426921 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:28.023412 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8785cb2d-e882-4a26-b3d1-50ed89426921 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:28.028483 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964805f9-bd42-47da-ac6f-6ec8995c098c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:28.029214 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964805f9-bd42-47da-ac6f-6ec8995c098c admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:28.029570 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964805f9-bd42-47da-ac6f-6ec8995c098c admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:28.029968 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964805f9-bd42-47da-ac6f-6ec8995c098c admin admin] PATH_INFO: `/v3/domains` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:28.030784 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964805f9-bd42-47da-ac6f-6ec8995c098c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:37:28.031203 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964805f9-bd42-47da-ac6f-6ec8995c098c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:28.032858 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964805f9-bd42-47da-ac6f-6ec8995c098c admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:28.049218 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 219/430] 10.222.0.58 () {56 vars in 1130 bytes} [Tue Oct 12 16:37:28 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:37:28.056048 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79c76f9-af43-4f51-90ca-018c41c29e0e admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:28.066907 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79c76f9-af43-4f51-90ca-018c41c29e0e admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:28.074553 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b422e467-ce18-47e2-a290-658d50718d1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:28.075441 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b422e467-ce18-47e2-a290-658d50718d1f admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:28.075796 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b422e467-ce18-47e2-a290-658d50718d1f admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:28.076143 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b422e467-ce18-47e2-a290-658d50718d1f admin admin] PATH_INFO: `/v3/projects/service` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:28.087804 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b422e467-ce18-47e2-a290-658d50718d1f admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:28.089900 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b422e467-ce18-47e2-a290-658d50718d1f admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:28.093691 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ea40b1-b00e-45b2-902f-f320ffbbca52 None None] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:28.094084 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ea40b1-b00e-45b2-902f-f320ffbbca52 None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:28.094440 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ea40b1-b00e-45b2-902f-f320ffbbca52 None None] PATH_INFO: `/` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:28.096302 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 220/431] 10.222.0.58 () {54 vars in 926 bytes} [Tue Oct 12 16:37:28 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:37:28.110494 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: WARNING keystone.server.flask.application [None req-b422e467-ce18-47e2-a290-658d50718d1f admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 16:37:28.111230 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc3cdb3-bee4-44f8-a6ce-c564ee7694a1 None None] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:28.111590 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc3cdb3-bee4-44f8-a6ce-c564ee7694a1 None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:28.111935 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc3cdb3-bee4-44f8-a6ce-c564ee7694a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:28.112404 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 212/432] 10.222.0.58 () {56 vars in 1132 bytes} [Tue Oct 12 16:37:28 2021] GET /identity/v3/projects/service => generated 88 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:37:28.118890 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b422e467-ce18-47e2-a290-658d50718d1f admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:28.131780 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b422e467-ce18-47e2-a290-658d50718d1f admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:28.136614 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.auth.core [None req-efc3cdb3-bee4-44f8-a6ce-c564ee7694a1 None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:37:28.137028 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99f37e9-f722-494d-a580-12c200d794b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:28.137849 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99f37e9-f722-494d-a580-12c200d794b8 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:28.138300 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-efc3cdb3-bee4-44f8-a6ce-c564ee7694a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:37:28.138415 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99f37e9-f722-494d-a580-12c200d794b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:28.138803 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99f37e9-f722-494d-a580-12c200d794b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:28.139830 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99f37e9-f722-494d-a580-12c200d794b8 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=85205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:37:28.140283 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99f37e9-f722-494d-a580-12c200d794b8 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:28.142471 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99f37e9-f722-494d-a580-12c200d794b8 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:28.148036 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 221/433] 10.222.0.58 () {58 vars in 1023 bytes} [Tue Oct 12 16:37:28 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:37:28.155674 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 213/434] 10.222.0.58 () {56 vars in 1169 bytes} [Tue Oct 12 16:37:28 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 16:37:28.162073 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc3cdb3-bee4-44f8-a6ce-c564ee7694a1 None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:28.171833 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc3cdb3-bee4-44f8-a6ce-c564ee7694a1 None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:28.177155 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2620d62b-1818-40bf-a3b3-8495296950ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:28.178025 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2620d62b-1818-40bf-a3b3-8495296950ff admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:28.178406 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2620d62b-1818-40bf-a3b3-8495296950ff admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:28.178808 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2620d62b-1818-40bf-a3b3-8495296950ff admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:28.179782 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2620d62b-1818-40bf-a3b3-8495296950ff admin admin] RBAC: Adding query filter params (role.id=dea461b7131b413590d73da4994002ca, scope.project.id=f3531f242eaa43b69562d70bca5ec5a8, user.id=6e65f6d0598e4c539134292b86fb43d2) {{(pid=85204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:37:28.181038 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99f37e9-f722-494d-a580-12c200d794b8 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:28.187378 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2620d62b-1818-40bf-a3b3-8495296950ff admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:28.190529 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2620d62b-1818-40bf-a3b3-8495296950ff admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:28.193499 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99f37e9-f722-494d-a580-12c200d794b8 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:28.203174 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5df8676-1c1e-4148-8fef-632e9a46fa34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:28.204116 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5df8676-1c1e-4148-8fef-632e9a46fa34 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:28.204496 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5df8676-1c1e-4148-8fef-632e9a46fa34 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:28.205434 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5df8676-1c1e-4148-8fef-632e9a46fa34 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:28.206412 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 222/435] 10.222.0.58 () {56 vars in 1395 bytes} [Tue Oct 12 16:37:28 2021] GET /identity/v3/role_assignments?user.id=6e65f6d0598e4c539134292b86fb43d2&scope.project.id=f3531f242eaa43b69562d70bca5ec5a8&role.id=dea461b7131b413590d73da4994002ca => generated 259 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:37:28.230321 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5df8676-1c1e-4148-8fef-632e9a46fa34 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:28.232473 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5df8676-1c1e-4148-8fef-632e9a46fa34 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:28.257824 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: WARNING keystone.server.flask.application [None req-e5df8676-1c1e-4148-8fef-632e9a46fa34 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 16:37:28.259749 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 214/436] 10.222.0.58 () {56 vars in 1129 bytes} [Tue Oct 12 16:37:28 2021] GET /identity/v3/domains/Default => generated 87 bytes in 79 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 16:37:28.266492 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2620d62b-1818-40bf-a3b3-8495296950ff admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:28.279678 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2620d62b-1818-40bf-a3b3-8495296950ff admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:28.284602 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f460c5bb-fb92-463a-9dca-dc0677f3f913 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:28.285567 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f460c5bb-fb92-463a-9dca-dc0677f3f913 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:28.286102 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f460c5bb-fb92-463a-9dca-dc0677f3f913 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:28.286595 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f460c5bb-fb92-463a-9dca-dc0677f3f913 admin admin] PATH_INFO: `/v3/domains` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:28.287574 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f460c5bb-fb92-463a-9dca-dc0677f3f913 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:37:28.288100 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f460c5bb-fb92-463a-9dca-dc0677f3f913 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:28.289956 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f460c5bb-fb92-463a-9dca-dc0677f3f913 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:28.303896 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 223/437] 10.222.0.58 () {56 vars in 1130 bytes} [Tue Oct 12 16:37:28 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:37:28.310526 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5df8676-1c1e-4148-8fef-632e9a46fa34 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:28.325616 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5df8676-1c1e-4148-8fef-632e9a46fa34 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:28.330636 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2deab558-8d36-40f2-8743-0a7df1721e87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:28.331662 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2deab558-8d36-40f2-8743-0a7df1721e87 admin admin] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:28.332140 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2deab558-8d36-40f2-8743-0a7df1721e87 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:28.332606 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2deab558-8d36-40f2-8743-0a7df1721e87 admin admin] PATH_INFO: `/v3/users` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:28.333621 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2deab558-8d36-40f2-8743-0a7df1721e87 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:28.335799 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2deab558-8d36-40f2-8743-0a7df1721e87 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:28.365558 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 215/438] 10.222.0.58 () {60 vars in 1153 bytes} [Tue Oct 12 16:37:28 2021] POST /identity/v3/users => generated 247 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:37:29.938282 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9324c67-0625-4176-b99c-1cf683bd87fb None None] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:29.938796 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9324c67-0625-4176-b99c-1cf683bd87fb None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:29.938876 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9324c67-0625-4176-b99c-1cf683bd87fb None None] PATH_INFO: `/` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:29.940870 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 224/439] 10.222.0.58 () {54 vars in 926 bytes} [Tue Oct 12 16:37:29 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:37:29.947459 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc5ff9b-c8bf-4a68-b620-49084deef661 None None] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:29.947941 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc5ff9b-c8bf-4a68-b620-49084deef661 None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:29.948050 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc5ff9b-c8bf-4a68-b620-49084deef661 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:29.977541 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.auth.core [None req-6bc5ff9b-c8bf-4a68-b620-49084deef661 None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:37:29.978780 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-6bc5ff9b-c8bf-4a68-b620-49084deef661 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:37:29.989263 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 216/440] 10.222.0.58 () {58 vars in 1023 bytes} [Tue Oct 12 16:37:29 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:37:30.031791 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9324c67-0625-4176-b99c-1cf683bd87fb None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:30.044037 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9324c67-0625-4176-b99c-1cf683bd87fb None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:30.048412 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82346bba-1163-4062-a6a4-89e6f88f9db5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:30.049191 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82346bba-1163-4062-a6a4-89e6f88f9db5 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:30.049471 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82346bba-1163-4062-a6a4-89e6f88f9db5 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:30.049740 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82346bba-1163-4062-a6a4-89e6f88f9db5 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:30.061385 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82346bba-1163-4062-a6a4-89e6f88f9db5 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 16:37:30.068817 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: WARNING keystone.server.flask.application [None req-82346bba-1163-4062-a6a4-89e6f88f9db5 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 12 16:37:30.070338 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 225/441] 10.222.0.58 () {56 vars in 1123 bytes} [Tue Oct 12 16:37:30 2021] GET /identity/v3/roles/service => generated 85 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:37:30.076652 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc5ff9b-c8bf-4a68-b620-49084deef661 None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:30.090773 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc5ff9b-c8bf-4a68-b620-49084deef661 None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:30.097980 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86db05f5-21e5-4527-8dc2-82a5a4ee64d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:30.098655 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86db05f5-21e5-4527-8dc2-82a5a4ee64d3 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:30.098942 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86db05f5-21e5-4527-8dc2-82a5a4ee64d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:30.099213 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86db05f5-21e5-4527-8dc2-82a5a4ee64d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:30.099976 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86db05f5-21e5-4527-8dc2-82a5a4ee64d3 admin admin] RBAC: Adding query filter params (name=service) {{(pid=85205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:37:30.100281 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86db05f5-21e5-4527-8dc2-82a5a4ee64d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:30.101861 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86db05f5-21e5-4527-8dc2-82a5a4ee64d3 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:30.117106 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 217/442] 10.222.0.58 () {56 vars in 1124 bytes} [Tue Oct 12 16:37:30 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:37:30.123310 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82346bba-1163-4062-a6a4-89e6f88f9db5 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:30.138937 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82346bba-1163-4062-a6a4-89e6f88f9db5 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:30.150487 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016d4234-61cc-4c6e-850e-ef5d9daa2d93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:30.151287 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016d4234-61cc-4c6e-850e-ef5d9daa2d93 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:30.151575 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016d4234-61cc-4c6e-850e-ef5d9daa2d93 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:30.151859 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016d4234-61cc-4c6e-850e-ef5d9daa2d93 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:30.162462 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016d4234-61cc-4c6e-850e-ef5d9daa2d93 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:30.164294 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016d4234-61cc-4c6e-850e-ef5d9daa2d93 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:30.181833 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: WARNING keystone.server.flask.application [None req-016d4234-61cc-4c6e-850e-ef5d9daa2d93 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 16:37:30.183338 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 226/443] 10.222.0.58 () {56 vars in 1129 bytes} [Tue Oct 12 16:37:30 2021] GET /identity/v3/domains/Default => generated 87 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:37:30.191142 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86db05f5-21e5-4527-8dc2-82a5a4ee64d3 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:30.207200 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86db05f5-21e5-4527-8dc2-82a5a4ee64d3 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:30.222906 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb7934a-cd82-406a-aefe-bee91e00985b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:30.223628 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb7934a-cd82-406a-aefe-bee91e00985b admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:30.223911 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb7934a-cd82-406a-aefe-bee91e00985b admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:30.224184 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb7934a-cd82-406a-aefe-bee91e00985b admin admin] PATH_INFO: `/v3/domains` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:30.224943 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb7934a-cd82-406a-aefe-bee91e00985b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:37:30.225251 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb7934a-cd82-406a-aefe-bee91e00985b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:30.226914 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb7934a-cd82-406a-aefe-bee91e00985b admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:30.244537 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 218/444] 10.222.0.58 () {56 vars in 1130 bytes} [Tue Oct 12 16:37:30 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:37:30.250534 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016d4234-61cc-4c6e-850e-ef5d9daa2d93 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:30.266268 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016d4234-61cc-4c6e-850e-ef5d9daa2d93 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:30.273541 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e65373-1c37-4dfa-886a-6209467b048a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:30.274466 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e65373-1c37-4dfa-886a-6209467b048a admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:30.274850 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e65373-1c37-4dfa-886a-6209467b048a admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:30.275224 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e65373-1c37-4dfa-886a-6209467b048a admin admin] PATH_INFO: `/v3/users/nova` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:30.294718 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e65373-1c37-4dfa-886a-6209467b048a admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:30.296890 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e65373-1c37-4dfa-886a-6209467b048a admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:30.318123 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: WARNING keystone.server.flask.application [None req-69e65373-1c37-4dfa-886a-6209467b048a admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 12 16:37:30.319707 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 227/445] 10.222.0.58 () {56 vars in 1114 bytes} [Tue Oct 12 16:37:30 2021] GET /identity/v3/users/nova => generated 82 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:37:30.325829 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb7934a-cd82-406a-aefe-bee91e00985b admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:30.342994 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb7934a-cd82-406a-aefe-bee91e00985b admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:30.355904 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5424756f-2bf3-4ec9-aa73-b405c51452d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:30.356579 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5424756f-2bf3-4ec9-aa73-b405c51452d0 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:30.356858 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5424756f-2bf3-4ec9-aa73-b405c51452d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:30.357132 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5424756f-2bf3-4ec9-aa73-b405c51452d0 admin admin] PATH_INFO: `/v3/users` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:30.358008 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5424756f-2bf3-4ec9-aa73-b405c51452d0 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=85205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:37:30.358317 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5424756f-2bf3-4ec9-aa73-b405c51452d0 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:30.360144 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5424756f-2bf3-4ec9-aa73-b405c51452d0 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:30.389575 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 219/446] 10.222.0.58 () {56 vars in 1154 bytes} [Tue Oct 12 16:37:30 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:37:30.395896 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e65373-1c37-4dfa-886a-6209467b048a admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:30.403682 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d179aea-ad03-4158-8817-e35b4045d837 None None] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:30.403682 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d179aea-ad03-4158-8817-e35b4045d837 None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:30.403682 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d179aea-ad03-4158-8817-e35b4045d837 None None] PATH_INFO: `/` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:30.403682 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 220/447] 10.222.0.58 () {54 vars in 926 bytes} [Tue Oct 12 16:37:30 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 12 16:37:30.409573 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e65373-1c37-4dfa-886a-6209467b048a admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:30.417490 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50841435-51f8-48f9-a084-a7ca61350701 None None] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:30.417780 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50841435-51f8-48f9-a084-a7ca61350701 None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:30.418086 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50841435-51f8-48f9-a084-a7ca61350701 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:30.420437 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63c0dc5-f1e2-4ecc-951b-8769ed424730 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:30.421514 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63c0dc5-f1e2-4ecc-951b-8769ed424730 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:30.422065 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63c0dc5-f1e2-4ecc-951b-8769ed424730 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:30.422493 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63c0dc5-f1e2-4ecc-951b-8769ed424730 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:30.436219 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63c0dc5-f1e2-4ecc-951b-8769ed424730 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:30.438449 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63c0dc5-f1e2-4ecc-951b-8769ed424730 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:30.457706 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: WARNING keystone.server.flask.application [None req-b63c0dc5-f1e2-4ecc-951b-8769ed424730 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 16:37:30.459544 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 228/448] 10.222.0.58 () {56 vars in 1129 bytes} [Tue Oct 12 16:37:30 2021] GET /identity/v3/domains/Default => generated 87 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:37:30.465566 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.auth.core [None req-50841435-51f8-48f9-a084-a7ca61350701 None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:37:30.465841 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63c0dc5-f1e2-4ecc-951b-8769ed424730 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:30.466785 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-50841435-51f8-48f9-a084-a7ca61350701 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:37:30.476757 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63c0dc5-f1e2-4ecc-951b-8769ed424730 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:30.481644 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962dbad5-6ced-4b99-a92d-a4760fb0fc9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:30.482514 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962dbad5-6ced-4b99-a92d-a4760fb0fc9f admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:30.482960 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962dbad5-6ced-4b99-a92d-a4760fb0fc9f admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:30.483443 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962dbad5-6ced-4b99-a92d-a4760fb0fc9f admin admin] PATH_INFO: `/v3/domains` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:30.484344 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962dbad5-6ced-4b99-a92d-a4760fb0fc9f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:37:30.484817 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962dbad5-6ced-4b99-a92d-a4760fb0fc9f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:30.486737 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962dbad5-6ced-4b99-a92d-a4760fb0fc9f admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:30.488046 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 221/449] 10.222.0.58 () {58 vars in 1023 bytes} [Tue Oct 12 16:37:30 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:37:30.499772 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 229/450] 10.222.0.58 () {56 vars in 1130 bytes} [Tue Oct 12 16:37:30 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 16:37:30.506815 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50841435-51f8-48f9-a084-a7ca61350701 None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:30.517077 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962dbad5-6ced-4b99-a92d-a4760fb0fc9f admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:30.521004 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50841435-51f8-48f9-a084-a7ca61350701 None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:30.527775 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962dbad5-6ced-4b99-a92d-a4760fb0fc9f admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:30.532816 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f10c3b-56cb-453b-bb0b-971f21d57251 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:30.534497 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f10c3b-56cb-453b-bb0b-971f21d57251 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:30.535713 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f10c3b-56cb-453b-bb0b-971f21d57251 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:30.536357 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f10c3b-56cb-453b-bb0b-971f21d57251 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:30.536978 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73503ec-cce2-4ffa-9d1e-f4ecac3f9091 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:30.538548 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73503ec-cce2-4ffa-9d1e-f4ecac3f9091 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:30.540469 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73503ec-cce2-4ffa-9d1e-f4ecac3f9091 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:30.540965 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73503ec-cce2-4ffa-9d1e-f4ecac3f9091 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:30.553379 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f10c3b-56cb-453b-bb0b-971f21d57251 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:30.555956 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f10c3b-56cb-453b-bb0b-971f21d57251 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:30.558943 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73503ec-cce2-4ffa-9d1e-f4ecac3f9091 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 16:37:30.567498 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: WARNING keystone.server.flask.application [None req-d73503ec-cce2-4ffa-9d1e-f4ecac3f9091 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 12 16:37:30.569080 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 230/451] 10.222.0.58 () {56 vars in 1123 bytes} [Tue Oct 12 16:37:30 2021] GET /identity/v3/roles/service => generated 85 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 16:37:30.570328 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293b68a1-7ed6-49a6-a30f-f0fa807ede91 None None] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:30.570671 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293b68a1-7ed6-49a6-a30f-f0fa807ede91 None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:30.571532 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: WARNING keystone.server.flask.application [None req-c6f10c3b-56cb-453b-bb0b-971f21d57251 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 16:37:30.571711 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293b68a1-7ed6-49a6-a30f-f0fa807ede91 None None] PATH_INFO: `/` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:30.573375 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 231/453] 10.222.0.58 () {54 vars in 926 bytes} [Tue Oct 12 16:37:30 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:37:30.573482 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 222/453] 10.222.0.58 () {56 vars in 1132 bytes} [Tue Oct 12 16:37:30 2021] GET /identity/v3/projects/service => generated 88 bytes in 67 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:37:30.580924 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293b68a1-7ed6-49a6-a30f-f0fa807ede91 None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:30.583167 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a1e4d1-13c4-4d3b-bef3-567614557a44 None None] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:30.583741 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a1e4d1-13c4-4d3b-bef3-567614557a44 None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:30.584292 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a1e4d1-13c4-4d3b-bef3-567614557a44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:30.594161 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293b68a1-7ed6-49a6-a30f-f0fa807ede91 None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:30.599125 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44e8310-515b-4212-a1e5-74a6e52c42ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:30.599791 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44e8310-515b-4212-a1e5-74a6e52c42ac admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:30.600079 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44e8310-515b-4212-a1e5-74a6e52c42ac admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:30.600360 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44e8310-515b-4212-a1e5-74a6e52c42ac admin admin] PATH_INFO: `/v3/roles` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:30.601121 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44e8310-515b-4212-a1e5-74a6e52c42ac admin admin] RBAC: Adding query filter params (name=service) {{(pid=85204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:37:30.601440 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44e8310-515b-4212-a1e5-74a6e52c42ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:30.603052 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44e8310-515b-4212-a1e5-74a6e52c42ac admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:30.605914 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.auth.core [None req-f5a1e4d1-13c4-4d3b-bef3-567614557a44 None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:37:30.607402 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-f5a1e4d1-13c4-4d3b-bef3-567614557a44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:37:30.611884 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 232/454] 10.222.0.58 () {56 vars in 1124 bytes} [Tue Oct 12 16:37:30 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:37:30.612688 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44e8310-515b-4212-a1e5-74a6e52c42ac admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:30.617343 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 223/455] 10.222.0.58 () {58 vars in 1023 bytes} [Tue Oct 12 16:37:30 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:37:30.622932 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44e8310-515b-4212-a1e5-74a6e52c42ac admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:30.623934 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a1e4d1-13c4-4d3b-bef3-567614557a44 None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:30.627450 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3a5ccf-ac65-4ac1-ac97-d30929b38645 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:30.628101 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3a5ccf-ac65-4ac1-ac97-d30929b38645 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:30.628386 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3a5ccf-ac65-4ac1-ac97-d30929b38645 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:30.628665 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3a5ccf-ac65-4ac1-ac97-d30929b38645 admin admin] PATH_INFO: `/v3/projects` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:30.629501 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3a5ccf-ac65-4ac1-ac97-d30929b38645 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=85204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:37:30.629815 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3a5ccf-ac65-4ac1-ac97-d30929b38645 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:30.631202 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: WARNING py.warnings [None req-8a3a5ccf-ac65-4ac1-ac97-d30929b38645 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:list_projects failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 12 16:37:30.631202 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: warnings.warn(msg) Oct 12 16:37:30.631202 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: Oct 12 16:37:30.632326 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3a5ccf-ac65-4ac1-ac97-d30929b38645 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:30.643150 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a1e4d1-13c4-4d3b-bef3-567614557a44 None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:30.650680 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 233/456] 10.222.0.58 () {56 vars in 1169 bytes} [Tue Oct 12 16:37:30 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:37:30.657259 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3a5ccf-ac65-4ac1-ac97-d30929b38645 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:30.657935 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b0e14e-7667-46af-a0d0-465ea9aca197 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:30.659044 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b0e14e-7667-46af-a0d0-465ea9aca197 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:30.659527 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b0e14e-7667-46af-a0d0-465ea9aca197 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:30.659985 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b0e14e-7667-46af-a0d0-465ea9aca197 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:30.668305 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3a5ccf-ac65-4ac1-ac97-d30929b38645 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:30.672934 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff820ad-d5ef-4cf4-8d65-2f862beefbf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:30.673921 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff820ad-d5ef-4cf4-8d65-2f862beefbf8 admin admin] REQUEST_METHOD: `PUT` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:30.674268 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff820ad-d5ef-4cf4-8d65-2f862beefbf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:30.674622 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff820ad-d5ef-4cf4-8d65-2f862beefbf8 admin admin] PATH_INFO: `/v3/projects/f3531f242eaa43b69562d70bca5ec5a8/users/29d30b574eec4ad3990d77d235c8b424/roles/dea461b7131b413590d73da4994002ca` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:30.675374 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b0e14e-7667-46af-a0d0-465ea9aca197 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:30.678356 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b0e14e-7667-46af-a0d0-465ea9aca197 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:30.690763 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff820ad-d5ef-4cf4-8d65-2f862beefbf8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3531f242eaa43b69562d70bca5ec5a8, user_id=29d30b574eec4ad3990d77d235c8b424, role_id=dea461b7131b413590d73da4994002ca)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:30.693526 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff820ad-d5ef-4cf4-8d65-2f862beefbf8 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:30.698092 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: WARNING keystone.server.flask.application [None req-94b0e14e-7667-46af-a0d0-465ea9aca197 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 16:37:30.699862 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 224/457] 10.222.0.58 () {56 vars in 1129 bytes} [Tue Oct 12 16:37:30 2021] GET /identity/v3/domains/Default => generated 87 bytes in 81 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:37:30.700549 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b0e14e-7667-46af-a0d0-465ea9aca197 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:30.709226 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 234/458] 10.222.0.58 () {58 vars in 1460 bytes} [Tue Oct 12 16:37:30 2021] PUT /identity/v3/projects/f3531f242eaa43b69562d70bca5ec5a8/users/29d30b574eec4ad3990d77d235c8b424/roles/dea461b7131b413590d73da4994002ca => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 16:37:30.718133 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b0e14e-7667-46af-a0d0-465ea9aca197 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:30.718347 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff820ad-d5ef-4cf4-8d65-2f862beefbf8 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:30.837410 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b075a26f-467a-4350-8379-e328a131f5c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:30.838162 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b075a26f-467a-4350-8379-e328a131f5c3 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:30.838437 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b075a26f-467a-4350-8379-e328a131f5c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:30.838716 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b075a26f-467a-4350-8379-e328a131f5c3 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:30.848909 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff820ad-d5ef-4cf4-8d65-2f862beefbf8 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:30.860671 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b075a26f-467a-4350-8379-e328a131f5c3 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 16:37:30.866434 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb71f7c5-2cbf-4738-a581-e93942733431 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:30.867164 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb71f7c5-2cbf-4738-a581-e93942733431 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:30.867444 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb71f7c5-2cbf-4738-a581-e93942733431 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:30.867717 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb71f7c5-2cbf-4738-a581-e93942733431 admin admin] PATH_INFO: `/v3/domains` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:30.868534 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb71f7c5-2cbf-4738-a581-e93942733431 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:37:30.868849 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb71f7c5-2cbf-4738-a581-e93942733431 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:30.870511 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb71f7c5-2cbf-4738-a581-e93942733431 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:30.879079 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: WARNING keystone.server.flask.application [None req-b075a26f-467a-4350-8379-e328a131f5c3 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 12 16:37:30.886980 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 225/459] 10.222.0.58 () {56 vars in 1123 bytes} [Tue Oct 12 16:37:30 2021] GET /identity/v3/roles/service => generated 85 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:37:30.893144 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 235/460] 10.222.0.58 () {56 vars in 1130 bytes} [Tue Oct 12 16:37:30 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:37:30.894848 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b075a26f-467a-4350-8379-e328a131f5c3 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:30.900797 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb71f7c5-2cbf-4738-a581-e93942733431 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:30.912136 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b075a26f-467a-4350-8379-e328a131f5c3 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:30.920387 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb71f7c5-2cbf-4738-a581-e93942733431 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:30.920960 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f3192d-1d78-4167-a9ca-e25b492a8b0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:30.921650 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f3192d-1d78-4167-a9ca-e25b492a8b0d admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:30.921953 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f3192d-1d78-4167-a9ca-e25b492a8b0d admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:30.922226 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f3192d-1d78-4167-a9ca-e25b492a8b0d admin admin] PATH_INFO: `/v3/roles` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:30.923007 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f3192d-1d78-4167-a9ca-e25b492a8b0d admin admin] RBAC: Adding query filter params (name=service) {{(pid=85205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:37:30.923312 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f3192d-1d78-4167-a9ca-e25b492a8b0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:30.927602 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f3192d-1d78-4167-a9ca-e25b492a8b0d admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:30.931673 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af1d632-2e45-44c9-b81d-a549319b66ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:30.932537 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af1d632-2e45-44c9-b81d-a549319b66ea admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:30.932876 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af1d632-2e45-44c9-b81d-a549319b66ea admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:30.933146 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af1d632-2e45-44c9-b81d-a549319b66ea admin admin] PATH_INFO: `/v3/users/glance` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:30.948038 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 226/461] 10.222.0.58 () {56 vars in 1124 bytes} [Tue Oct 12 16:37:30 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:37:30.954820 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f3192d-1d78-4167-a9ca-e25b492a8b0d admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:30.956037 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af1d632-2e45-44c9-b81d-a549319b66ea admin admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:30.961920 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af1d632-2e45-44c9-b81d-a549319b66ea admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:30.968444 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f3192d-1d78-4167-a9ca-e25b492a8b0d admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:30.977517 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12830e20-c44f-4f4d-8012-ca6b78ae129e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:30.978471 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12830e20-c44f-4f4d-8012-ca6b78ae129e admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:30.979149 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12830e20-c44f-4f4d-8012-ca6b78ae129e admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:30.979531 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12830e20-c44f-4f4d-8012-ca6b78ae129e admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:30.981106 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: WARNING keystone.server.flask.application [None req-3af1d632-2e45-44c9-b81d-a549319b66ea admin admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Oct 12 16:37:30.982814 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 236/462] 10.222.0.58 () {56 vars in 1120 bytes} [Tue Oct 12 16:37:30 2021] GET /identity/v3/users/glance => generated 84 bytes in 82 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:37:30.984204 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117c5e38-8a27-47eb-9729-cb884c1b305e None None] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:30.984637 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117c5e38-8a27-47eb-9729-cb884c1b305e None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:30.985056 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117c5e38-8a27-47eb-9729-cb884c1b305e None None] PATH_INFO: `/` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:30.987189 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 237/463] 10.222.0.58 () {54 vars in 926 bytes} [Tue Oct 12 16:37:30 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:37:30.989804 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117c5e38-8a27-47eb-9729-cb884c1b305e None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:30.992351 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12830e20-c44f-4f4d-8012-ca6b78ae129e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:30.994410 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12830e20-c44f-4f4d-8012-ca6b78ae129e admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:31.003427 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117c5e38-8a27-47eb-9729-cb884c1b305e None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:31.010346 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa038b73-57ab-40a9-be91-e4a790cd37a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:31.011067 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa038b73-57ab-40a9-be91-e4a790cd37a9 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:31.011350 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa038b73-57ab-40a9-be91-e4a790cd37a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:31.011625 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa038b73-57ab-40a9-be91-e4a790cd37a9 admin admin] PATH_INFO: `/v3/users` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:31.012528 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa038b73-57ab-40a9-be91-e4a790cd37a9 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=85204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:37:31.012938 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa038b73-57ab-40a9-be91-e4a790cd37a9 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:31.014929 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa038b73-57ab-40a9-be91-e4a790cd37a9 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:31.015665 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: WARNING keystone.server.flask.application [None req-12830e20-c44f-4f4d-8012-ca6b78ae129e admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 16:37:31.017598 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 227/464] 10.222.0.58 () {56 vars in 1129 bytes} [Tue Oct 12 16:37:30 2021] GET /identity/v3/domains/Default => generated 87 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:37:31.020398 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57444df3-ac24-4959-86d8-84ae64dc5a0f None None] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:31.020919 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57444df3-ac24-4959-86d8-84ae64dc5a0f None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:31.021405 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57444df3-ac24-4959-86d8-84ae64dc5a0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:31.039902 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 238/465] 10.222.0.58 () {56 vars in 1158 bytes} [Tue Oct 12 16:37:30 2021] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 16:37:31.040830 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa038b73-57ab-40a9-be91-e4a790cd37a9 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:31.042999 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.auth.core [None req-57444df3-ac24-4959-86d8-84ae64dc5a0f None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:37:31.044479 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-57444df3-ac24-4959-86d8-84ae64dc5a0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:37:31.051124 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa038b73-57ab-40a9-be91-e4a790cd37a9 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:31.054451 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 228/466] 10.222.0.58 () {58 vars in 1023 bytes} [Tue Oct 12 16:37:31 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:37:31.055522 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57444df3-ac24-4959-86d8-84ae64dc5a0f None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:31.055795 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57890c86-2625-41b7-81ae-9b78a0d8cd68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:31.056438 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57890c86-2625-41b7-81ae-9b78a0d8cd68 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:31.056725 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57890c86-2625-41b7-81ae-9b78a0d8cd68 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:31.057003 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57890c86-2625-41b7-81ae-9b78a0d8cd68 admin admin] PATH_INFO: `/v3/domains` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:31.057734 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57890c86-2625-41b7-81ae-9b78a0d8cd68 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:37:31.058067 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57890c86-2625-41b7-81ae-9b78a0d8cd68 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:31.059804 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57890c86-2625-41b7-81ae-9b78a0d8cd68 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:31.068107 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57444df3-ac24-4959-86d8-84ae64dc5a0f None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:31.072423 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 239/467] 10.222.0.58 () {56 vars in 1130 bytes} [Tue Oct 12 16:37:31 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:37:31.078477 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57890c86-2625-41b7-81ae-9b78a0d8cd68 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:31.083062 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47631d82-cdef-47ba-95ae-7b99b082242b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:31.084378 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47631d82-cdef-47ba-95ae-7b99b082242b admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:31.084882 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47631d82-cdef-47ba-95ae-7b99b082242b admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:31.085982 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47631d82-cdef-47ba-95ae-7b99b082242b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:31.089186 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57890c86-2625-41b7-81ae-9b78a0d8cd68 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:31.093817 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414efddc-cd67-4eef-a5ad-8fc0cff2095e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:31.094627 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414efddc-cd67-4eef-a5ad-8fc0cff2095e admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:31.094911 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414efddc-cd67-4eef-a5ad-8fc0cff2095e admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:31.095188 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414efddc-cd67-4eef-a5ad-8fc0cff2095e admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:31.099457 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47631d82-cdef-47ba-95ae-7b99b082242b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:31.101646 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47631d82-cdef-47ba-95ae-7b99b082242b admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:31.103742 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414efddc-cd67-4eef-a5ad-8fc0cff2095e admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:31.105739 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414efddc-cd67-4eef-a5ad-8fc0cff2095e admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:31.119253 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: WARNING keystone.server.flask.application [None req-414efddc-cd67-4eef-a5ad-8fc0cff2095e admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 12 16:37:31.120732 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 240/468] 10.222.0.58 () {56 vars in 1120 bytes} [Tue Oct 12 16:37:31 2021] GET /identity/v3/users/cinder => generated 84 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:37:31.121508 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414efddc-cd67-4eef-a5ad-8fc0cff2095e admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:31.122861 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: WARNING keystone.server.flask.application [None req-47631d82-cdef-47ba-95ae-7b99b082242b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 16:37:31.124558 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 229/469] 10.222.0.58 () {56 vars in 1129 bytes} [Tue Oct 12 16:37:31 2021] GET /identity/v3/domains/Default => generated 87 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:37:31.127971 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47631d82-cdef-47ba-95ae-7b99b082242b admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:31.137619 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414efddc-cd67-4eef-a5ad-8fc0cff2095e admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:31.140203 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47631d82-cdef-47ba-95ae-7b99b082242b admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:31.142533 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bd3df2-0464-4649-a577-95ded386d9dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:31.143485 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bd3df2-0464-4649-a577-95ded386d9dd admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:31.143868 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bd3df2-0464-4649-a577-95ded386d9dd admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:31.144297 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bd3df2-0464-4649-a577-95ded386d9dd admin admin] PATH_INFO: `/v3/roles/service` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:31.146450 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61712e33-19ea-466f-ac07-d50fc7e8391f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:31.147249 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61712e33-19ea-466f-ac07-d50fc7e8391f admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:31.147697 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61712e33-19ea-466f-ac07-d50fc7e8391f admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:31.148120 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61712e33-19ea-466f-ac07-d50fc7e8391f admin admin] PATH_INFO: `/v3/users` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:31.149094 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61712e33-19ea-466f-ac07-d50fc7e8391f admin admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=85205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:37:31.149727 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61712e33-19ea-466f-ac07-d50fc7e8391f admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:31.151984 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61712e33-19ea-466f-ac07-d50fc7e8391f admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:31.156629 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bd3df2-0464-4649-a577-95ded386d9dd admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 16:37:31.164568 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: WARNING keystone.server.flask.application [None req-f6bd3df2-0464-4649-a577-95ded386d9dd admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 12 16:37:31.165867 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 241/470] 10.222.0.58 () {56 vars in 1123 bytes} [Tue Oct 12 16:37:31 2021] GET /identity/v3/roles/service => generated 85 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:37:31.166807 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bd3df2-0464-4649-a577-95ded386d9dd admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:31.171288 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 230/471] 10.222.0.58 () {56 vars in 1158 bytes} [Tue Oct 12 16:37:31 2021] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:37:31.179420 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61712e33-19ea-466f-ac07-d50fc7e8391f admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:31.179595 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bd3df2-0464-4649-a577-95ded386d9dd admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:31.188187 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ad41f6-5738-4027-bdb8-0024759d91e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:31.188914 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ad41f6-5738-4027-bdb8-0024759d91e2 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:31.189195 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ad41f6-5738-4027-bdb8-0024759d91e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:31.189493 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ad41f6-5738-4027-bdb8-0024759d91e2 admin admin] PATH_INFO: `/v3/domains` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:31.190278 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ad41f6-5738-4027-bdb8-0024759d91e2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:37:31.190586 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ad41f6-5738-4027-bdb8-0024759d91e2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:31.192232 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ad41f6-5738-4027-bdb8-0024759d91e2 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:31.193014 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61712e33-19ea-466f-ac07-d50fc7e8391f admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:31.198700 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713bd9b2-a23a-4d60-b004-c417170584e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:31.199634 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713bd9b2-a23a-4d60-b004-c417170584e6 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:31.200589 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713bd9b2-a23a-4d60-b004-c417170584e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:31.201087 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713bd9b2-a23a-4d60-b004-c417170584e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:31.202538 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713bd9b2-a23a-4d60-b004-c417170584e6 admin admin] RBAC: Adding query filter params (name=service) {{(pid=85205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:37:31.203367 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713bd9b2-a23a-4d60-b004-c417170584e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:31.205069 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 242/472] 10.222.0.58 () {56 vars in 1130 bytes} [Tue Oct 12 16:37:31 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:37:31.205395 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713bd9b2-a23a-4d60-b004-c417170584e6 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:31.205976 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ad41f6-5738-4027-bdb8-0024759d91e2 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:31.216289 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 231/473] 10.222.0.58 () {56 vars in 1124 bytes} [Tue Oct 12 16:37:31 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:37:31.216463 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ad41f6-5738-4027-bdb8-0024759d91e2 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:31.217718 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713bd9b2-a23a-4d60-b004-c417170584e6 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:31.221072 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa67d20e-1dd7-4ced-8e1e-18284aa4a277 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:31.222264 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa67d20e-1dd7-4ced-8e1e-18284aa4a277 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:31.222646 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa67d20e-1dd7-4ced-8e1e-18284aa4a277 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:31.223593 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa67d20e-1dd7-4ced-8e1e-18284aa4a277 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:31.232743 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713bd9b2-a23a-4d60-b004-c417170584e6 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:31.235481 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa67d20e-1dd7-4ced-8e1e-18284aa4a277 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:31.237620 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa67d20e-1dd7-4ced-8e1e-18284aa4a277 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:31.238755 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d412d729-6f8a-4a2c-a90a-956006598c4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:31.239985 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d412d729-6f8a-4a2c-a90a-956006598c4a admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:31.240766 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d412d729-6f8a-4a2c-a90a-956006598c4a admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:31.241206 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d412d729-6f8a-4a2c-a90a-956006598c4a admin admin] PATH_INFO: `/v3/projects/service` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:31.249716 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d412d729-6f8a-4a2c-a90a-956006598c4a admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:31.251878 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d412d729-6f8a-4a2c-a90a-956006598c4a admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:31.257209 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: WARNING keystone.server.flask.application [None req-fa67d20e-1dd7-4ced-8e1e-18284aa4a277 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 16:37:31.258570 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 243/474] 10.222.0.58 () {56 vars in 1129 bytes} [Tue Oct 12 16:37:31 2021] GET /identity/v3/domains/Default => generated 87 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:37:31.264536 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa67d20e-1dd7-4ced-8e1e-18284aa4a277 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:31.266995 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: WARNING keystone.server.flask.application [None req-d412d729-6f8a-4a2c-a90a-956006598c4a admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 16:37:31.268393 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 232/475] 10.222.0.58 () {56 vars in 1132 bytes} [Tue Oct 12 16:37:31 2021] GET /identity/v3/projects/service => generated 88 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:37:31.269430 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d412d729-6f8a-4a2c-a90a-956006598c4a admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:31.275697 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa67d20e-1dd7-4ced-8e1e-18284aa4a277 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:31.280325 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7b6349-19c0-49e1-8986-5918ea769432 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:31.281207 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7b6349-19c0-49e1-8986-5918ea769432 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:31.281559 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7b6349-19c0-49e1-8986-5918ea769432 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:31.281925 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7b6349-19c0-49e1-8986-5918ea769432 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:31.282687 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d412d729-6f8a-4a2c-a90a-956006598c4a admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:31.288455 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af68ceb7-4c99-42a9-9ee8-6d14b3923a6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:31.289289 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af68ceb7-4c99-42a9-9ee8-6d14b3923a6f admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:31.289781 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af68ceb7-4c99-42a9-9ee8-6d14b3923a6f admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:31.290717 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af68ceb7-4c99-42a9-9ee8-6d14b3923a6f admin admin] PATH_INFO: `/v3/domains` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:31.291653 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af68ceb7-4c99-42a9-9ee8-6d14b3923a6f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:37:31.292511 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af68ceb7-4c99-42a9-9ee8-6d14b3923a6f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:31.294043 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7b6349-19c0-49e1-8986-5918ea769432 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:31.294848 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af68ceb7-4c99-42a9-9ee8-6d14b3923a6f admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:31.296156 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7b6349-19c0-49e1-8986-5918ea769432 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:31.308281 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 233/476] 10.222.0.58 () {56 vars in 1130 bytes} [Tue Oct 12 16:37:31 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:37:31.309295 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af68ceb7-4c99-42a9-9ee8-6d14b3923a6f admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:31.319544 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: WARNING keystone.server.flask.application [None req-1a7b6349-19c0-49e1-8986-5918ea769432 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 16:37:31.320637 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 244/477] 10.222.0.58 () {56 vars in 1129 bytes} [Tue Oct 12 16:37:31 2021] GET /identity/v3/domains/Default => generated 87 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:37:31.321543 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7b6349-19c0-49e1-8986-5918ea769432 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:31.323591 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af68ceb7-4c99-42a9-9ee8-6d14b3923a6f admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:31.329309 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cb53e2-a482-4513-abfe-dd89f3480b82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:31.330474 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cb53e2-a482-4513-abfe-dd89f3480b82 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:31.330954 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cb53e2-a482-4513-abfe-dd89f3480b82 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:31.331432 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cb53e2-a482-4513-abfe-dd89f3480b82 admin admin] PATH_INFO: `/v3/projects` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:31.332292 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7b6349-19c0-49e1-8986-5918ea769432 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:31.333172 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cb53e2-a482-4513-abfe-dd89f3480b82 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=85205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:37:31.333774 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cb53e2-a482-4513-abfe-dd89f3480b82 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:31.335978 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cb53e2-a482-4513-abfe-dd89f3480b82 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:31.337650 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff91ece8-de08-4354-b415-0464bf4bb31d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:31.338556 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff91ece8-de08-4354-b415-0464bf4bb31d admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:31.338948 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff91ece8-de08-4354-b415-0464bf4bb31d admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:31.339348 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff91ece8-de08-4354-b415-0464bf4bb31d admin admin] PATH_INFO: `/v3/projects/service` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:31.346683 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff91ece8-de08-4354-b415-0464bf4bb31d admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:31.348824 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff91ece8-de08-4354-b415-0464bf4bb31d admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:31.352018 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 234/478] 10.222.0.58 () {56 vars in 1169 bytes} [Tue Oct 12 16:37:31 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:37:31.353003 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cb53e2-a482-4513-abfe-dd89f3480b82 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:31.362696 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: WARNING keystone.server.flask.application [None req-ff91ece8-de08-4354-b415-0464bf4bb31d admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 16:37:31.362994 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cb53e2-a482-4513-abfe-dd89f3480b82 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:31.364164 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 245/479] 10.222.0.58 () {56 vars in 1132 bytes} [Tue Oct 12 16:37:31 2021] GET /identity/v3/projects/service => generated 88 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:37:31.366125 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff91ece8-de08-4354-b415-0464bf4bb31d admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:31.376982 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9289516-b0c1-40f3-a24f-4df77f5fb9ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:31.377722 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9289516-b0c1-40f3-a24f-4df77f5fb9ed admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:31.378079 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9289516-b0c1-40f3-a24f-4df77f5fb9ed admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:31.378428 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9289516-b0c1-40f3-a24f-4df77f5fb9ed admin admin] PATH_INFO: `/v3/domains` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:31.379757 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9289516-b0c1-40f3-a24f-4df77f5fb9ed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:37:31.380467 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9289516-b0c1-40f3-a24f-4df77f5fb9ed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:31.381605 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff91ece8-de08-4354-b415-0464bf4bb31d admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:31.382238 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9289516-b0c1-40f3-a24f-4df77f5fb9ed admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:31.387136 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5f3357-cda6-4efa-bd00-a39eb297ca70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:31.388182 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5f3357-cda6-4efa-bd00-a39eb297ca70 admin admin] REQUEST_METHOD: `PUT` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:31.388645 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5f3357-cda6-4efa-bd00-a39eb297ca70 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:31.389098 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5f3357-cda6-4efa-bd00-a39eb297ca70 admin admin] PATH_INFO: `/v3/projects/f3531f242eaa43b69562d70bca5ec5a8/users/8ff84015069041f2bf33e3fd55b92e44/roles/dea461b7131b413590d73da4994002ca` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:31.396057 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 235/480] 10.222.0.58 () {56 vars in 1130 bytes} [Tue Oct 12 16:37:31 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:37:31.396815 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9289516-b0c1-40f3-a24f-4df77f5fb9ed admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:31.406597 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9289516-b0c1-40f3-a24f-4df77f5fb9ed admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:31.407938 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5f3357-cda6-4efa-bd00-a39eb297ca70 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3531f242eaa43b69562d70bca5ec5a8, user_id=8ff84015069041f2bf33e3fd55b92e44, role_id=dea461b7131b413590d73da4994002ca)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:31.411352 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5f3357-cda6-4efa-bd00-a39eb297ca70 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:31.411485 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51711875-3b3f-4fe7-a819-cfbb1748b613 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:31.412138 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51711875-3b3f-4fe7-a819-cfbb1748b613 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:31.412489 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51711875-3b3f-4fe7-a819-cfbb1748b613 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:31.412838 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51711875-3b3f-4fe7-a819-cfbb1748b613 admin admin] PATH_INFO: `/v3/projects` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:31.413801 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51711875-3b3f-4fe7-a819-cfbb1748b613 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=85205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:37:31.414213 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51711875-3b3f-4fe7-a819-cfbb1748b613 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:31.416193 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51711875-3b3f-4fe7-a819-cfbb1748b613 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:31.427680 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 246/481] 10.222.0.58 () {58 vars in 1460 bytes} [Tue Oct 12 16:37:31 2021] PUT /identity/v3/projects/f3531f242eaa43b69562d70bca5ec5a8/users/8ff84015069041f2bf33e3fd55b92e44/roles/dea461b7131b413590d73da4994002ca => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:37:31.428884 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5f3357-cda6-4efa-bd00-a39eb297ca70 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:31.437954 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 236/482] 10.222.0.58 () {56 vars in 1169 bytes} [Tue Oct 12 16:37:31 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:37:31.437954 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51711875-3b3f-4fe7-a819-cfbb1748b613 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:31.448120 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51711875-3b3f-4fe7-a819-cfbb1748b613 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:31.506408 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d6c434-56d3-4acc-a65f-e5705d4c9051 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:31.507413 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d6c434-56d3-4acc-a65f-e5705d4c9051 admin admin] REQUEST_METHOD: `PUT` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:31.507820 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d6c434-56d3-4acc-a65f-e5705d4c9051 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:31.508230 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d6c434-56d3-4acc-a65f-e5705d4c9051 admin admin] PATH_INFO: `/v3/projects/f3531f242eaa43b69562d70bca5ec5a8/users/04704222b3d64a33a6c092fc641ccbb0/roles/dea461b7131b413590d73da4994002ca` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:31.517898 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5f3357-cda6-4efa-bd00-a39eb297ca70 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:31.524848 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d6c434-56d3-4acc-a65f-e5705d4c9051 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3531f242eaa43b69562d70bca5ec5a8, user_id=04704222b3d64a33a6c092fc641ccbb0, role_id=dea461b7131b413590d73da4994002ca)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:31.525199 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb55a507-fa2e-40cd-bcbd-c6f130b33f4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:31.526303 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb55a507-fa2e-40cd-bcbd-c6f130b33f4b admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:31.526781 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb55a507-fa2e-40cd-bcbd-c6f130b33f4b admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:31.527239 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb55a507-fa2e-40cd-bcbd-c6f130b33f4b admin admin] PATH_INFO: `/v3/users/neutron` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:31.529006 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d6c434-56d3-4acc-a65f-e5705d4c9051 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:31.536692 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb55a507-fa2e-40cd-bcbd-c6f130b33f4b admin admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:31.539086 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb55a507-fa2e-40cd-bcbd-c6f130b33f4b admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:31.547671 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 237/483] 10.222.0.58 () {58 vars in 1460 bytes} [Tue Oct 12 16:37:31 2021] PUT /identity/v3/projects/f3531f242eaa43b69562d70bca5ec5a8/users/04704222b3d64a33a6c092fc641ccbb0/roles/dea461b7131b413590d73da4994002ca => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:37:31.554414 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: WARNING keystone.server.flask.application [None req-bb55a507-fa2e-40cd-bcbd-c6f130b33f4b admin admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Oct 12 16:37:31.555973 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 247/484] 10.222.0.58 () {56 vars in 1123 bytes} [Tue Oct 12 16:37:31 2021] GET /identity/v3/users/neutron => generated 85 bytes in 128 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:37:31.562731 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d6c434-56d3-4acc-a65f-e5705d4c9051 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:31.671524 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d6c434-56d3-4acc-a65f-e5705d4c9051 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:31.678470 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267762b2-d128-4fee-8a8b-0fe6a0c0bad6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:31.679164 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267762b2-d128-4fee-8a8b-0fe6a0c0bad6 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:31.679448 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267762b2-d128-4fee-8a8b-0fe6a0c0bad6 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:31.679724 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267762b2-d128-4fee-8a8b-0fe6a0c0bad6 admin admin] PATH_INFO: `/v3/users` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:31.680594 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267762b2-d128-4fee-8a8b-0fe6a0c0bad6 admin admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=85205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:37:31.680996 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267762b2-d128-4fee-8a8b-0fe6a0c0bad6 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:31.682911 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267762b2-d128-4fee-8a8b-0fe6a0c0bad6 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:31.709385 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 238/485] 10.222.0.58 () {56 vars in 1160 bytes} [Tue Oct 12 16:37:31 2021] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:37:31.714667 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb55a507-fa2e-40cd-bcbd-c6f130b33f4b admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:31.727903 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb55a507-fa2e-40cd-bcbd-c6f130b33f4b admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:31.732989 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aec45c2-0f87-4a07-852e-126444e78f44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:31.734243 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aec45c2-0f87-4a07-852e-126444e78f44 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:31.734738 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aec45c2-0f87-4a07-852e-126444e78f44 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:31.735228 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aec45c2-0f87-4a07-852e-126444e78f44 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:31.750376 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aec45c2-0f87-4a07-852e-126444e78f44 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:31.752619 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aec45c2-0f87-4a07-852e-126444e78f44 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:31.772027 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: WARNING keystone.server.flask.application [None req-4aec45c2-0f87-4a07-852e-126444e78f44 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 16:37:31.774028 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 248/486] 10.222.0.58 () {56 vars in 1129 bytes} [Tue Oct 12 16:37:31 2021] GET /identity/v3/domains/Default => generated 87 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:37:31.780978 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cfff27-ad4b-4fdf-bb08-5e845dc45fee None None] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:31.780978 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cfff27-ad4b-4fdf-bb08-5e845dc45fee None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:31.780978 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cfff27-ad4b-4fdf-bb08-5e845dc45fee None None] PATH_INFO: `/` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:31.781543 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 239/487] 10.222.0.58 () {54 vars in 926 bytes} [Tue Oct 12 16:37:31 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:37:31.784318 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aec45c2-0f87-4a07-852e-126444e78f44 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:31.794608 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aec45c2-0f87-4a07-852e-126444e78f44 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:31.797428 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191b12d0-8aa7-400e-9ef8-a23e189a8f3a None None] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:31.798094 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191b12d0-8aa7-400e-9ef8-a23e189a8f3a None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:31.798585 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191b12d0-8aa7-400e-9ef8-a23e189a8f3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:31.799350 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ad2b5c-2764-4bac-a3b0-58574ffda6d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:31.800015 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ad2b5c-2764-4bac-a3b0-58574ffda6d8 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:31.800299 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ad2b5c-2764-4bac-a3b0-58574ffda6d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:31.800576 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ad2b5c-2764-4bac-a3b0-58574ffda6d8 admin admin] PATH_INFO: `/v3/domains` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:31.804244 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ad2b5c-2764-4bac-a3b0-58574ffda6d8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:37:31.804244 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ad2b5c-2764-4bac-a3b0-58574ffda6d8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:31.804244 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ad2b5c-2764-4bac-a3b0-58574ffda6d8 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:31.817914 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 249/488] 10.222.0.58 () {56 vars in 1130 bytes} [Tue Oct 12 16:37:31 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:37:31.823645 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ad2b5c-2764-4bac-a3b0-58574ffda6d8 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:31.837302 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ad2b5c-2764-4bac-a3b0-58574ffda6d8 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:31.842235 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81090450-3fcf-4be6-89b1-34fc81bdc155 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:31.842984 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.auth.core [None req-191b12d0-8aa7-400e-9ef8-a23e189a8f3a None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:37:31.843537 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81090450-3fcf-4be6-89b1-34fc81bdc155 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:31.843967 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81090450-3fcf-4be6-89b1-34fc81bdc155 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:31.844214 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-191b12d0-8aa7-400e-9ef8-a23e189a8f3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:37:31.844541 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81090450-3fcf-4be6-89b1-34fc81bdc155 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:31.852834 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81090450-3fcf-4be6-89b1-34fc81bdc155 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:31.855118 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81090450-3fcf-4be6-89b1-34fc81bdc155 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:31.868298 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 240/489] 10.222.0.58 () {58 vars in 1023 bytes} [Tue Oct 12 16:37:31 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:37:31.870309 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: WARNING keystone.server.flask.application [None req-81090450-3fcf-4be6-89b1-34fc81bdc155 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 16:37:31.871953 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 250/490] 10.222.0.58 () {56 vars in 1132 bytes} [Tue Oct 12 16:37:31 2021] GET /identity/v3/projects/service => generated 88 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 16:37:31.879657 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191b12d0-8aa7-400e-9ef8-a23e189a8f3a None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:31.895384 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191b12d0-8aa7-400e-9ef8-a23e189a8f3a None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:31.905830 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2740e991-7072-4887-895c-c5815d2a04b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:31.906691 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2740e991-7072-4887-895c-c5815d2a04b6 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:31.907070 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2740e991-7072-4887-895c-c5815d2a04b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:31.907537 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2740e991-7072-4887-895c-c5815d2a04b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:31.908510 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2740e991-7072-4887-895c-c5815d2a04b6 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=85205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:37:31.908838 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81090450-3fcf-4be6-89b1-34fc81bdc155 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:31.908960 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2740e991-7072-4887-895c-c5815d2a04b6 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:31.911299 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2740e991-7072-4887-895c-c5815d2a04b6 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:31.922493 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81090450-3fcf-4be6-89b1-34fc81bdc155 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:31.930045 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2192917b-11fd-437d-8bcd-4eaee63d6358 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:31.930838 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 241/491] 10.222.0.58 () {56 vars in 1169 bytes} [Tue Oct 12 16:37:31 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:37:31.936131 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2192917b-11fd-437d-8bcd-4eaee63d6358 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:31.936131 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2192917b-11fd-437d-8bcd-4eaee63d6358 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:31.936131 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2192917b-11fd-437d-8bcd-4eaee63d6358 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:31.937412 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2740e991-7072-4887-895c-c5815d2a04b6 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:31.944281 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2192917b-11fd-437d-8bcd-4eaee63d6358 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 16:37:31.950074 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2740e991-7072-4887-895c-c5815d2a04b6 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:31.951535 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: WARNING keystone.server.flask.application [None req-2192917b-11fd-437d-8bcd-4eaee63d6358 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 12 16:37:31.953040 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 251/492] 10.222.0.58 () {56 vars in 1123 bytes} [Tue Oct 12 16:37:31 2021] GET /identity/v3/roles/service => generated 85 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:37:31.958242 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966fb439-b8a8-4da0-b49a-b09f857565cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:31.959391 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966fb439-b8a8-4da0-b49a-b09f857565cb admin admin] REQUEST_METHOD: `PUT` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:31.959571 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2192917b-11fd-437d-8bcd-4eaee63d6358 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:31.960336 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966fb439-b8a8-4da0-b49a-b09f857565cb admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:31.960970 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966fb439-b8a8-4da0-b49a-b09f857565cb admin admin] PATH_INFO: `/v3/projects/f3531f242eaa43b69562d70bca5ec5a8/users/6e65f6d0598e4c539134292b86fb43d2/roles/dea461b7131b413590d73da4994002ca` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:31.970502 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2192917b-11fd-437d-8bcd-4eaee63d6358 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:31.977900 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6daaaf87-81ae-4039-bfb1-a892e034918a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:31.977900 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daaaf87-81ae-4039-bfb1-a892e034918a admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:31.977900 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daaaf87-81ae-4039-bfb1-a892e034918a admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:31.977900 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daaaf87-81ae-4039-bfb1-a892e034918a admin admin] PATH_INFO: `/v3/roles` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:31.978288 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6daaaf87-81ae-4039-bfb1-a892e034918a admin admin] RBAC: Adding query filter params (name=service) {{(pid=85204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:37:31.978288 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6daaaf87-81ae-4039-bfb1-a892e034918a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:31.979559 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6daaaf87-81ae-4039-bfb1-a892e034918a admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:31.988090 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966fb439-b8a8-4da0-b49a-b09f857565cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3531f242eaa43b69562d70bca5ec5a8, user_id=6e65f6d0598e4c539134292b86fb43d2, role_id=dea461b7131b413590d73da4994002ca)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:31.990174 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 252/493] 10.222.0.58 () {56 vars in 1124 bytes} [Tue Oct 12 16:37:31 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:37:31.995635 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966fb439-b8a8-4da0-b49a-b09f857565cb admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:31.996425 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6daaaf87-81ae-4039-bfb1-a892e034918a admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:32.007984 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6daaaf87-81ae-4039-bfb1-a892e034918a admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:32.012638 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ae93c4-f4e5-46af-b732-64ecb0225a9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:32.013550 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ae93c4-f4e5-46af-b732-64ecb0225a9a admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:32.013847 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ae93c4-f4e5-46af-b732-64ecb0225a9a admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:32.014275 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ae93c4-f4e5-46af-b732-64ecb0225a9a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:32.026260 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ae93c4-f4e5-46af-b732-64ecb0225a9a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:32.028346 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ae93c4-f4e5-46af-b732-64ecb0225a9a admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:32.029512 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 242/494] 10.222.0.58 () {58 vars in 1460 bytes} [Tue Oct 12 16:37:31 2021] PUT /identity/v3/projects/f3531f242eaa43b69562d70bca5ec5a8/users/6e65f6d0598e4c539134292b86fb43d2/roles/dea461b7131b413590d73da4994002ca => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:37:32.047022 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: WARNING keystone.server.flask.application [None req-82ae93c4-f4e5-46af-b732-64ecb0225a9a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 16:37:32.048275 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 253/495] 10.222.0.58 () {56 vars in 1129 bytes} [Tue Oct 12 16:37:31 2021] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 16:37:32.055247 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966fb439-b8a8-4da0-b49a-b09f857565cb admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:32.186979 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966fb439-b8a8-4da0-b49a-b09f857565cb admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:32.191750 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3cb74a-3486-4996-b426-51572026b33a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:32.192416 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3cb74a-3486-4996-b426-51572026b33a admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:32.192699 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3cb74a-3486-4996-b426-51572026b33a admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:32.192971 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3cb74a-3486-4996-b426-51572026b33a admin admin] PATH_INFO: `/v3/domains` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:32.193719 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3cb74a-3486-4996-b426-51572026b33a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:37:32.194057 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3cb74a-3486-4996-b426-51572026b33a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:32.195669 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3cb74a-3486-4996-b426-51572026b33a admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:32.207843 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 243/496] 10.222.0.58 () {56 vars in 1130 bytes} [Tue Oct 12 16:37:32 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:37:32.213843 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ae93c4-f4e5-46af-b732-64ecb0225a9a admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:32.235350 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ae93c4-f4e5-46af-b732-64ecb0225a9a admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:32.240693 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6234a5-adcf-490c-b4b0-7433209071f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:32.241639 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6234a5-adcf-490c-b4b0-7433209071f6 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:32.242103 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6234a5-adcf-490c-b4b0-7433209071f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:32.242574 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6234a5-adcf-490c-b4b0-7433209071f6 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:32.255490 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6234a5-adcf-490c-b4b0-7433209071f6 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:32.257725 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6234a5-adcf-490c-b4b0-7433209071f6 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:32.281152 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: WARNING keystone.server.flask.application [None req-4c6234a5-adcf-490c-b4b0-7433209071f6 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 12 16:37:32.282885 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 254/497] 10.222.0.58 () {56 vars in 1117 bytes} [Tue Oct 12 16:37:32 2021] GET /identity/v3/users/swift => generated 83 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:37:32.289845 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3cb74a-3486-4996-b426-51572026b33a admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:32.310468 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3cb74a-3486-4996-b426-51572026b33a admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:32.320032 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ee0e59-2624-4acb-8d9e-7f3cff3710fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:32.320718 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ee0e59-2624-4acb-8d9e-7f3cff3710fe admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:32.321001 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ee0e59-2624-4acb-8d9e-7f3cff3710fe admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:32.321277 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ee0e59-2624-4acb-8d9e-7f3cff3710fe admin admin] PATH_INFO: `/v3/users` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:32.322184 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ee0e59-2624-4acb-8d9e-7f3cff3710fe admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=85205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:37:32.322495 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ee0e59-2624-4acb-8d9e-7f3cff3710fe admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:32.324372 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ee0e59-2624-4acb-8d9e-7f3cff3710fe admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:32.351533 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 244/498] 10.222.0.58 () {56 vars in 1156 bytes} [Tue Oct 12 16:37:32 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:37:32.357967 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6234a5-adcf-490c-b4b0-7433209071f6 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:32.371700 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6234a5-adcf-490c-b4b0-7433209071f6 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:32.382001 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deaadd44-0f5a-4443-9f76-1684bbff7289 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:32.382872 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deaadd44-0f5a-4443-9f76-1684bbff7289 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:32.383306 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deaadd44-0f5a-4443-9f76-1684bbff7289 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:32.383728 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deaadd44-0f5a-4443-9f76-1684bbff7289 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:32.392463 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deaadd44-0f5a-4443-9f76-1684bbff7289 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:32.394422 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deaadd44-0f5a-4443-9f76-1684bbff7289 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:32.408567 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 255/499] 10.222.0.58 () {58 vars in 1324 bytes} [Tue Oct 12 16:37:32 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:37:32.415544 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ee0e59-2624-4acb-8d9e-7f3cff3710fe admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:32.432534 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ee0e59-2624-4acb-8d9e-7f3cff3710fe admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:32.436573 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084b5b43-4920-4842-ba03-2bae64f41aff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:32.437590 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084b5b43-4920-4842-ba03-2bae64f41aff admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:32.438061 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084b5b43-4920-4842-ba03-2bae64f41aff admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:32.438484 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084b5b43-4920-4842-ba03-2bae64f41aff admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:32.449341 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084b5b43-4920-4842-ba03-2bae64f41aff admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:32.451430 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084b5b43-4920-4842-ba03-2bae64f41aff admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:32.470506 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: WARNING keystone.server.flask.application [None req-084b5b43-4920-4842-ba03-2bae64f41aff admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 16:37:32.472171 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 245/500] 10.222.0.58 () {56 vars in 1129 bytes} [Tue Oct 12 16:37:32 2021] GET /identity/v3/domains/Default => generated 87 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:37:32.480734 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deaadd44-0f5a-4443-9f76-1684bbff7289 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:32.490344 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deaadd44-0f5a-4443-9f76-1684bbff7289 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:32.495110 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69edeca-91f2-428f-9f70-9fab5dfe468a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:32.495934 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69edeca-91f2-428f-9f70-9fab5dfe468a admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:32.496364 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69edeca-91f2-428f-9f70-9fab5dfe468a admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:32.496780 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69edeca-91f2-428f-9f70-9fab5dfe468a admin admin] PATH_INFO: `/v3/domains` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:32.497657 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69edeca-91f2-428f-9f70-9fab5dfe468a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:37:32.498151 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69edeca-91f2-428f-9f70-9fab5dfe468a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:32.499971 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69edeca-91f2-428f-9f70-9fab5dfe468a admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:32.512963 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 256/501] 10.222.0.58 () {56 vars in 1130 bytes} [Tue Oct 12 16:37:32 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:37:32.519891 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084b5b43-4920-4842-ba03-2bae64f41aff admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:32.531058 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084b5b43-4920-4842-ba03-2bae64f41aff admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:32.536441 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e79303-f4c7-46d8-b596-fc343ecbfad7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:32.537395 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e79303-f4c7-46d8-b596-fc343ecbfad7 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:32.537845 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e79303-f4c7-46d8-b596-fc343ecbfad7 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:32.538287 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e79303-f4c7-46d8-b596-fc343ecbfad7 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:32.545839 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e79303-f4c7-46d8-b596-fc343ecbfad7 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:32.547964 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e79303-f4c7-46d8-b596-fc343ecbfad7 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:32.561446 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: WARNING keystone.server.flask.application [None req-24e79303-f4c7-46d8-b596-fc343ecbfad7 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 16:37:32.563148 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 246/502] 10.222.0.58 () {56 vars in 1132 bytes} [Tue Oct 12 16:37:32 2021] GET /identity/v3/projects/service => generated 88 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:37:32.569809 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69edeca-91f2-428f-9f70-9fab5dfe468a admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:32.580063 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69edeca-91f2-428f-9f70-9fab5dfe468a admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:32.586465 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8de8a1-bf00-4e84-8992-8721a03b0d34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:32.587347 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8de8a1-bf00-4e84-8992-8721a03b0d34 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:32.587777 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8de8a1-bf00-4e84-8992-8721a03b0d34 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:32.588197 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8de8a1-bf00-4e84-8992-8721a03b0d34 admin admin] PATH_INFO: `/v3/projects` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:32.589160 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8de8a1-bf00-4e84-8992-8721a03b0d34 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=85204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:37:32.589631 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8de8a1-bf00-4e84-8992-8721a03b0d34 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:32.591691 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8de8a1-bf00-4e84-8992-8721a03b0d34 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:32.605557 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 257/503] 10.222.0.58 () {56 vars in 1169 bytes} [Tue Oct 12 16:37:32 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:37:32.612378 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e79303-f4c7-46d8-b596-fc343ecbfad7 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:32.627662 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e79303-f4c7-46d8-b596-fc343ecbfad7 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:32.632817 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f80362-d694-4fe7-9ed3-16606971c97d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:32.633622 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f80362-d694-4fe7-9ed3-16606971c97d admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:32.634077 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f80362-d694-4fe7-9ed3-16606971c97d admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:32.634495 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f80362-d694-4fe7-9ed3-16606971c97d admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:32.635479 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f80362-d694-4fe7-9ed3-16606971c97d admin admin] RBAC: Adding query filter params (role.id=dea461b7131b413590d73da4994002ca, scope.project.id=f3531f242eaa43b69562d70bca5ec5a8, user.id=9fdeb0a451344c9987b4134b957ffa22) {{(pid=85205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:37:32.635958 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f80362-d694-4fe7-9ed3-16606971c97d admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:32.638014 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f80362-d694-4fe7-9ed3-16606971c97d admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:32.645002 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 247/504] 10.222.0.58 () {56 vars in 1395 bytes} [Tue Oct 12 16:37:32 2021] GET /identity/v3/role_assignments?user.id=9fdeb0a451344c9987b4134b957ffa22&scope.project.id=f3531f242eaa43b69562d70bca5ec5a8&role.id=dea461b7131b413590d73da4994002ca => generated 259 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:37:33.510285 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d713fd6d-9622-413a-b3a6-ae63baba3b51 None None] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:33.511376 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d713fd6d-9622-413a-b3a6-ae63baba3b51 None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:33.511870 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d713fd6d-9622-413a-b3a6-ae63baba3b51 None None] PATH_INFO: `/` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:33.514186 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 258/505] 10.222.0.58 () {54 vars in 926 bytes} [Tue Oct 12 16:37:33 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:37:33.520551 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64256cc-356f-454b-af27-6c89992e9087 None None] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:33.521399 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64256cc-356f-454b-af27-6c89992e9087 None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:33.521924 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64256cc-356f-454b-af27-6c89992e9087 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:33.543019 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.auth.core [None req-d64256cc-356f-454b-af27-6c89992e9087 None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:37:33.544561 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-d64256cc-356f-454b-af27-6c89992e9087 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:37:33.561350 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 248/506] 10.222.0.58 () {58 vars in 1023 bytes} [Tue Oct 12 16:37:33 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:37:33.596694 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d713fd6d-9622-413a-b3a6-ae63baba3b51 None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:33.616549 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d713fd6d-9622-413a-b3a6-ae63baba3b51 None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:33.622049 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fb6390-1e48-4cb4-b304-2fbd0f73db7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:33.622844 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fb6390-1e48-4cb4-b304-2fbd0f73db7e admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:33.623129 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fb6390-1e48-4cb4-b304-2fbd0f73db7e admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:33.623402 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fb6390-1e48-4cb4-b304-2fbd0f73db7e admin admin] PATH_INFO: `/v3/roles/service` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:33.641596 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fb6390-1e48-4cb4-b304-2fbd0f73db7e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 16:37:33.648556 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: WARNING keystone.server.flask.application [None req-89fb6390-1e48-4cb4-b304-2fbd0f73db7e admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 12 16:37:33.653977 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 259/507] 10.222.0.58 () {56 vars in 1123 bytes} [Tue Oct 12 16:37:33 2021] GET /identity/v3/roles/service => generated 85 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:37:33.656330 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64256cc-356f-454b-af27-6c89992e9087 None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:33.671169 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64256cc-356f-454b-af27-6c89992e9087 None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:33.682290 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03c7421-b7ae-4d93-8664-dc25b362f92c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:33.683336 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03c7421-b7ae-4d93-8664-dc25b362f92c admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:33.683827 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03c7421-b7ae-4d93-8664-dc25b362f92c admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:33.684328 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03c7421-b7ae-4d93-8664-dc25b362f92c admin admin] PATH_INFO: `/v3/roles` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:33.685343 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03c7421-b7ae-4d93-8664-dc25b362f92c admin admin] RBAC: Adding query filter params (name=service) {{(pid=85205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:37:33.685909 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03c7421-b7ae-4d93-8664-dc25b362f92c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:33.687948 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03c7421-b7ae-4d93-8664-dc25b362f92c admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:33.705352 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 249/508] 10.222.0.58 () {56 vars in 1124 bytes} [Tue Oct 12 16:37:33 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:37:33.711763 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fb6390-1e48-4cb4-b304-2fbd0f73db7e admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:33.726433 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fb6390-1e48-4cb4-b304-2fbd0f73db7e admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:33.734007 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322f8b5a-c835-45e6-8d32-384215de1b6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:33.734793 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322f8b5a-c835-45e6-8d32-384215de1b6a admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:33.735079 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322f8b5a-c835-45e6-8d32-384215de1b6a admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:33.735356 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322f8b5a-c835-45e6-8d32-384215de1b6a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:33.753652 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322f8b5a-c835-45e6-8d32-384215de1b6a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:33.755820 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322f8b5a-c835-45e6-8d32-384215de1b6a admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:33.776082 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: WARNING keystone.server.flask.application [None req-322f8b5a-c835-45e6-8d32-384215de1b6a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 16:37:33.777391 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 260/509] 10.222.0.58 () {56 vars in 1129 bytes} [Tue Oct 12 16:37:33 2021] GET /identity/v3/domains/Default => generated 87 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:37:33.783885 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03c7421-b7ae-4d93-8664-dc25b362f92c admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:33.798820 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03c7421-b7ae-4d93-8664-dc25b362f92c admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:33.813903 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9a1b46-4127-441c-a767-03cc97a899a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:33.813903 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9a1b46-4127-441c-a767-03cc97a899a2 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:33.813903 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9a1b46-4127-441c-a767-03cc97a899a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:33.813903 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9a1b46-4127-441c-a767-03cc97a899a2 admin admin] PATH_INFO: `/v3/domains` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:33.814226 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9a1b46-4127-441c-a767-03cc97a899a2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:37:33.814226 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9a1b46-4127-441c-a767-03cc97a899a2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:33.815023 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9a1b46-4127-441c-a767-03cc97a899a2 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:33.830757 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 250/510] 10.222.0.58 () {56 vars in 1130 bytes} [Tue Oct 12 16:37:33 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:37:33.836989 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322f8b5a-c835-45e6-8d32-384215de1b6a admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:33.851477 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322f8b5a-c835-45e6-8d32-384215de1b6a admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:33.871711 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1975ea3f-83a8-4e00-bc8c-88f395a52cd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:33.871711 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1975ea3f-83a8-4e00-bc8c-88f395a52cd1 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:33.871711 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1975ea3f-83a8-4e00-bc8c-88f395a52cd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:33.871711 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1975ea3f-83a8-4e00-bc8c-88f395a52cd1 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:33.886578 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1975ea3f-83a8-4e00-bc8c-88f395a52cd1 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:33.888591 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1975ea3f-83a8-4e00-bc8c-88f395a52cd1 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:33.905833 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: WARNING keystone.server.flask.application [None req-1975ea3f-83a8-4e00-bc8c-88f395a52cd1 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 12 16:37:33.910375 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 261/511] 10.222.0.58 () {56 vars in 1114 bytes} [Tue Oct 12 16:37:33 2021] GET /identity/v3/users/nova => generated 82 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:37:33.913663 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9a1b46-4127-441c-a767-03cc97a899a2 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:33.934543 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9a1b46-4127-441c-a767-03cc97a899a2 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:33.943866 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2060da7-1315-4bde-be39-920b055c9208 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:33.944548 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2060da7-1315-4bde-be39-920b055c9208 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:33.944861 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2060da7-1315-4bde-be39-920b055c9208 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:33.945147 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2060da7-1315-4bde-be39-920b055c9208 admin admin] PATH_INFO: `/v3/users` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:33.947704 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2060da7-1315-4bde-be39-920b055c9208 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=85205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:37:33.947704 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2060da7-1315-4bde-be39-920b055c9208 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:33.953894 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2060da7-1315-4bde-be39-920b055c9208 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:33.991369 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 251/512] 10.222.0.58 () {56 vars in 1154 bytes} [Tue Oct 12 16:37:33 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:37:33.997528 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1975ea3f-83a8-4e00-bc8c-88f395a52cd1 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:34.025427 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1975ea3f-83a8-4e00-bc8c-88f395a52cd1 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:34.058666 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8c6c84-249c-415e-b91a-b68a25243024 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:34.059655 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8c6c84-249c-415e-b91a-b68a25243024 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:34.060135 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8c6c84-249c-415e-b91a-b68a25243024 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:34.060601 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8c6c84-249c-415e-b91a-b68a25243024 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:34.079030 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8c6c84-249c-415e-b91a-b68a25243024 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:34.081092 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8c6c84-249c-415e-b91a-b68a25243024 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:34.097182 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 262/513] 10.222.0.58 () {58 vars in 1324 bytes} [Tue Oct 12 16:37:33 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:37:34.107209 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2060da7-1315-4bde-be39-920b055c9208 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:34.121762 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2060da7-1315-4bde-be39-920b055c9208 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:34.135285 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11749e6-3bac-4a2a-a579-4d47d7fb4849 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:34.136117 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11749e6-3bac-4a2a-a579-4d47d7fb4849 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:34.136407 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11749e6-3bac-4a2a-a579-4d47d7fb4849 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:34.136689 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11749e6-3bac-4a2a-a579-4d47d7fb4849 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:34.162975 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11749e6-3bac-4a2a-a579-4d47d7fb4849 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:34.164939 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11749e6-3bac-4a2a-a579-4d47d7fb4849 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:34.190593 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: WARNING keystone.server.flask.application [None req-f11749e6-3bac-4a2a-a579-4d47d7fb4849 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 16:37:34.191351 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 252/514] 10.222.0.58 () {56 vars in 1129 bytes} [Tue Oct 12 16:37:34 2021] GET /identity/v3/domains/Default => generated 87 bytes in 84 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:37:34.197848 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8c6c84-249c-415e-b91a-b68a25243024 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:34.219781 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8c6c84-249c-415e-b91a-b68a25243024 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:34.230088 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65b1728-725b-4163-8f10-81400583b5df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:34.230757 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65b1728-725b-4163-8f10-81400583b5df admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:34.231037 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65b1728-725b-4163-8f10-81400583b5df admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:34.231308 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65b1728-725b-4163-8f10-81400583b5df admin admin] PATH_INFO: `/v3/domains` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:34.232048 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65b1728-725b-4163-8f10-81400583b5df admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:37:34.232354 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65b1728-725b-4163-8f10-81400583b5df admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:34.237750 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65b1728-725b-4163-8f10-81400583b5df admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:34.264479 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 263/515] 10.222.0.58 () {56 vars in 1130 bytes} [Tue Oct 12 16:37:34 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:37:34.268172 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11749e6-3bac-4a2a-a579-4d47d7fb4849 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:34.283125 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11749e6-3bac-4a2a-a579-4d47d7fb4849 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:34.295430 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69837a57-da62-4bc7-b433-10f406e65452 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:34.296230 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69837a57-da62-4bc7-b433-10f406e65452 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:34.296514 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69837a57-da62-4bc7-b433-10f406e65452 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:34.296787 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69837a57-da62-4bc7-b433-10f406e65452 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:34.311193 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69837a57-da62-4bc7-b433-10f406e65452 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:34.313078 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69837a57-da62-4bc7-b433-10f406e65452 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:34.315507 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e69b5d-1300-4a3e-8f01-7362d59c87b5 None None] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:34.315799 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e69b5d-1300-4a3e-8f01-7362d59c87b5 None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:34.316629 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e69b5d-1300-4a3e-8f01-7362d59c87b5 None None] PATH_INFO: `/` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:34.320462 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 264/516] 10.222.0.58 () {54 vars in 926 bytes} [Tue Oct 12 16:37:34 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 12 16:37:34.326178 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d53491-e856-4730-94dc-42a04444d115 None None] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:34.326463 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d53491-e856-4730-94dc-42a04444d115 None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:34.326741 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d53491-e856-4730-94dc-42a04444d115 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:34.336456 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: WARNING keystone.server.flask.application [None req-69837a57-da62-4bc7-b433-10f406e65452 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 16:37:34.342543 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 253/517] 10.222.0.58 () {56 vars in 1132 bytes} [Tue Oct 12 16:37:34 2021] GET /identity/v3/projects/service => generated 88 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:37:34.347012 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69837a57-da62-4bc7-b433-10f406e65452 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:34.355286 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.auth.core [None req-28d53491-e856-4730-94dc-42a04444d115 None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:37:34.356484 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-28d53491-e856-4730-94dc-42a04444d115 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:37:34.364441 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69837a57-da62-4bc7-b433-10f406e65452 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:34.364966 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 265/518] 10.222.0.58 () {58 vars in 1023 bytes} [Tue Oct 12 16:37:34 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:37:34.388189 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5810eca-5972-43af-8b0a-f1619c85f22c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:34.388893 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5810eca-5972-43af-8b0a-f1619c85f22c admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:34.390350 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d53491-e856-4730-94dc-42a04444d115 None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:34.395175 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5810eca-5972-43af-8b0a-f1619c85f22c admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:34.395551 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5810eca-5972-43af-8b0a-f1619c85f22c admin admin] PATH_INFO: `/v3/projects` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:34.396388 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5810eca-5972-43af-8b0a-f1619c85f22c admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=85205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:37:34.397927 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5810eca-5972-43af-8b0a-f1619c85f22c admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:34.400526 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5810eca-5972-43af-8b0a-f1619c85f22c admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:34.406564 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d53491-e856-4730-94dc-42a04444d115 None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:34.429898 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf690cd-fa3d-403d-b75b-887ae89998b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:34.431409 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf690cd-fa3d-403d-b75b-887ae89998b6 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:34.434038 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf690cd-fa3d-403d-b75b-887ae89998b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:34.434038 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf690cd-fa3d-403d-b75b-887ae89998b6 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:34.440344 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 254/519] 10.222.0.58 () {56 vars in 1169 bytes} [Tue Oct 12 16:37:34 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 16:37:34.445900 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5810eca-5972-43af-8b0a-f1619c85f22c admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:34.476891 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5810eca-5972-43af-8b0a-f1619c85f22c admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:34.481023 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf690cd-fa3d-403d-b75b-887ae89998b6 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 16:37:34.489908 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: WARNING keystone.server.flask.application [None req-8cf690cd-fa3d-403d-b75b-887ae89998b6 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 12 16:37:34.498016 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 266/520] 10.222.0.58 () {56 vars in 1123 bytes} [Tue Oct 12 16:37:34 2021] GET /identity/v3/roles/service => generated 85 bytes in 108 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 16:37:34.505531 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf690cd-fa3d-403d-b75b-887ae89998b6 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:34.521134 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16eb1fb2-4ed3-40be-a6f3-bebb098fc57d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:34.521760 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16eb1fb2-4ed3-40be-a6f3-bebb098fc57d admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:34.522270 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16eb1fb2-4ed3-40be-a6f3-bebb098fc57d admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:34.522556 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16eb1fb2-4ed3-40be-a6f3-bebb098fc57d admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:34.523418 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16eb1fb2-4ed3-40be-a6f3-bebb098fc57d admin admin] RBAC: Adding query filter params (role.id=dea461b7131b413590d73da4994002ca, scope.project.id=f3531f242eaa43b69562d70bca5ec5a8, user.id=29d30b574eec4ad3990d77d235c8b424) {{(pid=85205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:37:34.523732 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16eb1fb2-4ed3-40be-a6f3-bebb098fc57d admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:34.525573 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16eb1fb2-4ed3-40be-a6f3-bebb098fc57d admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:34.533455 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf690cd-fa3d-403d-b75b-887ae89998b6 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:34.537062 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 255/521] 10.222.0.58 () {56 vars in 1395 bytes} [Tue Oct 12 16:37:34 2021] GET /identity/v3/role_assignments?user.id=29d30b574eec4ad3990d77d235c8b424&scope.project.id=f3531f242eaa43b69562d70bca5ec5a8&role.id=dea461b7131b413590d73da4994002ca => generated 608 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:37:34.567392 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5746e19d-9b2c-4a1d-b734-1a2bcff26669 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:34.568552 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5746e19d-9b2c-4a1d-b734-1a2bcff26669 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:34.568552 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5746e19d-9b2c-4a1d-b734-1a2bcff26669 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:34.568552 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5746e19d-9b2c-4a1d-b734-1a2bcff26669 admin admin] PATH_INFO: `/v3/roles` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:34.570420 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5746e19d-9b2c-4a1d-b734-1a2bcff26669 admin admin] RBAC: Adding query filter params (name=service) {{(pid=85204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:37:34.570420 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5746e19d-9b2c-4a1d-b734-1a2bcff26669 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:34.571299 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5746e19d-9b2c-4a1d-b734-1a2bcff26669 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:34.581125 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 267/522] 10.222.0.58 () {56 vars in 1124 bytes} [Tue Oct 12 16:37:34 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:37:34.589153 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16eb1fb2-4ed3-40be-a6f3-bebb098fc57d admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:34.608887 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16eb1fb2-4ed3-40be-a6f3-bebb098fc57d admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:34.623512 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbf9d75-9ba2-44a0-9e19-9976a8424d77 None None] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:34.623834 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbf9d75-9ba2-44a0-9e19-9976a8424d77 None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:34.624076 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbf9d75-9ba2-44a0-9e19-9976a8424d77 None None] PATH_INFO: `/` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:34.626144 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 268/523] 10.222.0.58 () {54 vars in 926 bytes} [Tue Oct 12 16:37:34 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:37:34.634674 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7051885b-23e0-4170-850d-816d8199b667 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:34.635484 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7051885b-23e0-4170-850d-816d8199b667 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:34.635769 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7051885b-23e0-4170-850d-816d8199b667 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:34.636045 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7051885b-23e0-4170-850d-816d8199b667 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:34.645986 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e585807-83d4-4603-91ed-86baa0151780 None None] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:34.645986 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e585807-83d4-4603-91ed-86baa0151780 None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:34.645986 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e585807-83d4-4603-91ed-86baa0151780 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:34.657163 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7051885b-23e0-4170-850d-816d8199b667 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:34.659404 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7051885b-23e0-4170-850d-816d8199b667 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:34.677781 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: WARNING keystone.server.flask.application [None req-7051885b-23e0-4170-850d-816d8199b667 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 16:37:34.679712 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 256/524] 10.222.0.58 () {56 vars in 1129 bytes} [Tue Oct 12 16:37:34 2021] GET /identity/v3/domains/Default => generated 87 bytes in 91 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:37:34.691041 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7051885b-23e0-4170-850d-816d8199b667 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:34.691781 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.auth.core [None req-7e585807-83d4-4603-91ed-86baa0151780 None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:37:34.692886 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-7e585807-83d4-4603-91ed-86baa0151780 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:37:34.702624 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7051885b-23e0-4170-850d-816d8199b667 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:34.711388 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a9c77e-5176-485c-b29b-a5c62ccf5e58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:34.712438 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a9c77e-5176-485c-b29b-a5c62ccf5e58 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:34.714996 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a9c77e-5176-485c-b29b-a5c62ccf5e58 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:34.715521 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a9c77e-5176-485c-b29b-a5c62ccf5e58 admin admin] PATH_INFO: `/v3/domains` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:34.716476 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a9c77e-5176-485c-b29b-a5c62ccf5e58 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:37:34.716925 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 269/525] 10.222.0.58 () {58 vars in 1023 bytes} [Tue Oct 12 16:37:34 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:37:34.717468 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a9c77e-5176-485c-b29b-a5c62ccf5e58 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:34.719282 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a9c77e-5176-485c-b29b-a5c62ccf5e58 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:34.733013 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 257/526] 10.222.0.58 () {56 vars in 1130 bytes} [Tue Oct 12 16:37:34 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:37:34.739618 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e585807-83d4-4603-91ed-86baa0151780 None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:34.747921 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a9c77e-5176-485c-b29b-a5c62ccf5e58 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:34.752269 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e585807-83d4-4603-91ed-86baa0151780 None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:34.763890 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a84045-e69a-4786-adae-a3aa3bb1a652 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:34.765083 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a84045-e69a-4786-adae-a3aa3bb1a652 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:34.765591 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a84045-e69a-4786-adae-a3aa3bb1a652 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:34.766079 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a84045-e69a-4786-adae-a3aa3bb1a652 admin admin] PATH_INFO: `/v3/users/glance` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:34.772887 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a9c77e-5176-485c-b29b-a5c62ccf5e58 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:34.780611 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a84045-e69a-4786-adae-a3aa3bb1a652 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:34.783515 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a84045-e69a-4786-adae-a3aa3bb1a652 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:34.786192 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5321ab25-fba3-4b9d-9383-8152da59478b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:34.787269 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5321ab25-fba3-4b9d-9383-8152da59478b admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:34.787851 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5321ab25-fba3-4b9d-9383-8152da59478b admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:34.788564 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5321ab25-fba3-4b9d-9383-8152da59478b admin admin] PATH_INFO: `/v3/roles/service` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:34.817471 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5321ab25-fba3-4b9d-9383-8152da59478b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 16:37:34.824488 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: WARNING keystone.server.flask.application [None req-5321ab25-fba3-4b9d-9383-8152da59478b admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 12 16:37:34.825746 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 258/527] 10.222.0.58 () {56 vars in 1123 bytes} [Tue Oct 12 16:37:34 2021] GET /identity/v3/roles/service => generated 85 bytes in 78 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:37:34.826747 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: WARNING keystone.server.flask.application [None req-05a84045-e69a-4786-adae-a3aa3bb1a652 admin admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Oct 12 16:37:34.828191 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 270/528] 10.222.0.58 () {56 vars in 1120 bytes} [Tue Oct 12 16:37:34 2021] GET /identity/v3/users/glance => generated 84 bytes in 89 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 16:37:34.837706 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5321ab25-fba3-4b9d-9383-8152da59478b admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:34.837917 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a84045-e69a-4786-adae-a3aa3bb1a652 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:34.847741 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5321ab25-fba3-4b9d-9383-8152da59478b admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:34.852431 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788976a6-4fc1-418b-af69-13b15a31adc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:34.853106 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788976a6-4fc1-418b-af69-13b15a31adc2 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:34.853428 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788976a6-4fc1-418b-af69-13b15a31adc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:34.853707 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788976a6-4fc1-418b-af69-13b15a31adc2 admin admin] PATH_INFO: `/v3/users` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:34.854655 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788976a6-4fc1-418b-af69-13b15a31adc2 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=85205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:37:34.854966 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788976a6-4fc1-418b-af69-13b15a31adc2 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:34.856809 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788976a6-4fc1-418b-af69-13b15a31adc2 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:34.860451 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a84045-e69a-4786-adae-a3aa3bb1a652 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:34.873571 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d007b23-11ac-41de-9286-1b0c9f033bf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:34.874309 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d007b23-11ac-41de-9286-1b0c9f033bf8 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:34.874595 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d007b23-11ac-41de-9286-1b0c9f033bf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:34.874871 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d007b23-11ac-41de-9286-1b0c9f033bf8 admin admin] PATH_INFO: `/v3/roles` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:34.875652 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d007b23-11ac-41de-9286-1b0c9f033bf8 admin admin] RBAC: Adding query filter params (name=service) {{(pid=85204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:37:34.875970 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d007b23-11ac-41de-9286-1b0c9f033bf8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:34.877607 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d007b23-11ac-41de-9286-1b0c9f033bf8 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:34.877867 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 259/529] 10.222.0.58 () {56 vars in 1158 bytes} [Tue Oct 12 16:37:34 2021] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:37:34.886633 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788976a6-4fc1-418b-af69-13b15a31adc2 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:34.899831 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 271/530] 10.222.0.58 () {56 vars in 1124 bytes} [Tue Oct 12 16:37:34 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:37:34.900033 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788976a6-4fc1-418b-af69-13b15a31adc2 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:34.901539 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d007b23-11ac-41de-9286-1b0c9f033bf8 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:34.908939 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465971e0-812a-4242-b0fa-80c7e9500d75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:34.909639 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465971e0-812a-4242-b0fa-80c7e9500d75 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:34.910571 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465971e0-812a-4242-b0fa-80c7e9500d75 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:34.910837 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465971e0-812a-4242-b0fa-80c7e9500d75 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:34.913740 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d007b23-11ac-41de-9286-1b0c9f033bf8 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:34.919186 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e595381b-910e-499c-97ab-7567c4d1b62d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:34.920257 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e595381b-910e-499c-97ab-7567c4d1b62d admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:34.920662 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465971e0-812a-4242-b0fa-80c7e9500d75 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:34.920936 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e595381b-910e-499c-97ab-7567c4d1b62d admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:34.921380 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e595381b-910e-499c-97ab-7567c4d1b62d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:34.922680 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465971e0-812a-4242-b0fa-80c7e9500d75 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:34.935051 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 260/531] 10.222.0.58 () {58 vars in 1324 bytes} [Tue Oct 12 16:37:34 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 12 16:37:34.941751 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e595381b-910e-499c-97ab-7567c4d1b62d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:34.942119 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465971e0-812a-4242-b0fa-80c7e9500d75 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:34.944278 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e595381b-910e-499c-97ab-7567c4d1b62d admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:34.952211 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465971e0-812a-4242-b0fa-80c7e9500d75 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:34.958146 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75aa07f6-553f-4ad4-b8cc-4cacc1ea122a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:34.958924 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75aa07f6-553f-4ad4-b8cc-4cacc1ea122a admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:34.959204 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75aa07f6-553f-4ad4-b8cc-4cacc1ea122a admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:34.959479 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75aa07f6-553f-4ad4-b8cc-4cacc1ea122a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:34.966222 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: WARNING keystone.server.flask.application [None req-e595381b-910e-499c-97ab-7567c4d1b62d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 16:37:34.973939 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 272/532] 10.222.0.58 () {56 vars in 1129 bytes} [Tue Oct 12 16:37:34 2021] GET /identity/v3/domains/Default => generated 87 bytes in 68 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 16:37:34.975947 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e595381b-910e-499c-97ab-7567c4d1b62d admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:34.976620 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75aa07f6-553f-4ad4-b8cc-4cacc1ea122a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:34.978602 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75aa07f6-553f-4ad4-b8cc-4cacc1ea122a admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:34.987810 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e595381b-910e-499c-97ab-7567c4d1b62d admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:34.993417 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e659e5e0-d69f-48a5-90d4-f01175fe2503 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:34.994348 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e659e5e0-d69f-48a5-90d4-f01175fe2503 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:34.994837 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e659e5e0-d69f-48a5-90d4-f01175fe2503 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:34.995335 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e659e5e0-d69f-48a5-90d4-f01175fe2503 admin admin] PATH_INFO: `/v3/domains` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:34.996270 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e659e5e0-d69f-48a5-90d4-f01175fe2503 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:37:34.996446 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: WARNING keystone.server.flask.application [None req-75aa07f6-553f-4ad4-b8cc-4cacc1ea122a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 16:37:34.996959 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e659e5e0-d69f-48a5-90d4-f01175fe2503 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:35.001927 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 261/533] 10.222.0.58 () {56 vars in 1129 bytes} [Tue Oct 12 16:37:34 2021] GET /identity/v3/domains/Default => generated 87 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:37:35.002983 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e659e5e0-d69f-48a5-90d4-f01175fe2503 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:35.005627 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75aa07f6-553f-4ad4-b8cc-4cacc1ea122a admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:35.015509 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75aa07f6-553f-4ad4-b8cc-4cacc1ea122a admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:35.025006 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36123c99-d4f9-4d24-a3ec-49d0f2d7236a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:35.025006 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36123c99-d4f9-4d24-a3ec-49d0f2d7236a admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:35.025006 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36123c99-d4f9-4d24-a3ec-49d0f2d7236a admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:35.025006 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36123c99-d4f9-4d24-a3ec-49d0f2d7236a admin admin] PATH_INFO: `/v3/domains` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:35.025384 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36123c99-d4f9-4d24-a3ec-49d0f2d7236a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:37:35.025384 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36123c99-d4f9-4d24-a3ec-49d0f2d7236a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:35.025384 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36123c99-d4f9-4d24-a3ec-49d0f2d7236a admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:35.026113 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 273/534] 10.222.0.58 () {56 vars in 1130 bytes} [Tue Oct 12 16:37:34 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:37:35.027831 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e659e5e0-d69f-48a5-90d4-f01175fe2503 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:35.041938 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 262/535] 10.222.0.58 () {56 vars in 1130 bytes} [Tue Oct 12 16:37:35 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:37:35.047737 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36123c99-d4f9-4d24-a3ec-49d0f2d7236a admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:35.048256 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e659e5e0-d69f-48a5-90d4-f01175fe2503 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:35.053247 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6457f408-8f67-40fa-bca3-1563f20099b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:35.054271 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6457f408-8f67-40fa-bca3-1563f20099b3 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:35.054691 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6457f408-8f67-40fa-bca3-1563f20099b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:35.055102 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6457f408-8f67-40fa-bca3-1563f20099b3 admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:35.058036 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36123c99-d4f9-4d24-a3ec-49d0f2d7236a admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:35.063832 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6457f408-8f67-40fa-bca3-1563f20099b3 admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:35.066546 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6457f408-8f67-40fa-bca3-1563f20099b3 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:35.068094 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a9e4c9-3290-401d-83c5-cd311902302a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:35.069018 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a9e4c9-3290-401d-83c5-cd311902302a admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:35.069340 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a9e4c9-3290-401d-83c5-cd311902302a admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:35.069623 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a9e4c9-3290-401d-83c5-cd311902302a admin admin] PATH_INFO: `/v3/projects/service` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:35.078025 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a9e4c9-3290-401d-83c5-cd311902302a admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:35.080079 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a9e4c9-3290-401d-83c5-cd311902302a admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:35.084109 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: WARNING keystone.server.flask.application [None req-6457f408-8f67-40fa-bca3-1563f20099b3 admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 12 16:37:35.089997 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 274/536] 10.222.0.58 () {56 vars in 1120 bytes} [Tue Oct 12 16:37:35 2021] GET /identity/v3/users/cinder => generated 84 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:37:35.091432 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df5769d-8879-43b7-94de-6da4ab44de4c None None] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:35.091729 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df5769d-8879-43b7-94de-6da4ab44de4c None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:35.092008 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df5769d-8879-43b7-94de-6da4ab44de4c None None] PATH_INFO: `/` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:35.094026 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 275/537] 10.222.0.58 () {54 vars in 926 bytes} [Tue Oct 12 16:37:35 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:37:35.095165 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: WARNING keystone.server.flask.application [None req-77a9e4c9-3290-401d-83c5-cd311902302a admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 16:37:35.096471 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 263/538] 10.222.0.58 () {56 vars in 1132 bytes} [Tue Oct 12 16:37:35 2021] GET /identity/v3/projects/service => generated 88 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:37:35.097463 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df5769d-8879-43b7-94de-6da4ab44de4c None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:35.102636 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938b2686-4127-4a8c-8169-77a897d0bdf3 None None] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:35.102931 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938b2686-4127-4a8c-8169-77a897d0bdf3 None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:35.103210 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938b2686-4127-4a8c-8169-77a897d0bdf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:35.112012 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df5769d-8879-43b7-94de-6da4ab44de4c None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:35.116473 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecdb6db-329f-43b0-b660-546518506536 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:35.117213 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecdb6db-329f-43b0-b660-546518506536 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:35.117583 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecdb6db-329f-43b0-b660-546518506536 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:35.117974 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecdb6db-329f-43b0-b660-546518506536 admin admin] PATH_INFO: `/v3/users` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:35.118886 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecdb6db-329f-43b0-b660-546518506536 admin admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=85204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:37:35.119199 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecdb6db-329f-43b0-b660-546518506536 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:35.121007 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecdb6db-329f-43b0-b660-546518506536 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:35.124329 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.auth.core [None req-938b2686-4127-4a8c-8169-77a897d0bdf3 None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:37:35.125544 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-938b2686-4127-4a8c-8169-77a897d0bdf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:37:35.135843 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 264/539] 10.222.0.58 () {58 vars in 1023 bytes} [Tue Oct 12 16:37:35 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:37:35.137180 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938b2686-4127-4a8c-8169-77a897d0bdf3 None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:35.140106 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 276/540] 10.222.0.58 () {56 vars in 1158 bytes} [Tue Oct 12 16:37:35 2021] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:37:35.146737 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecdb6db-329f-43b0-b660-546518506536 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:35.156313 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938b2686-4127-4a8c-8169-77a897d0bdf3 None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:35.156485 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecdb6db-329f-43b0-b660-546518506536 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:35.163791 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a841ca-c336-4a07-b3d9-151ddb347501 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:35.164642 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab329a9-d989-4ca8-b829-22c5c19f1bf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:35.165480 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a841ca-c336-4a07-b3d9-151ddb347501 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:35.165760 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a841ca-c336-4a07-b3d9-151ddb347501 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:35.166050 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a841ca-c336-4a07-b3d9-151ddb347501 admin admin] PATH_INFO: `/v3/projects` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:35.166906 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a841ca-c336-4a07-b3d9-151ddb347501 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=85205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:37:35.167211 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a841ca-c336-4a07-b3d9-151ddb347501 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:35.169185 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a841ca-c336-4a07-b3d9-151ddb347501 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:35.170185 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab329a9-d989-4ca8-b829-22c5c19f1bf4 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:35.170496 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab329a9-d989-4ca8-b829-22c5c19f1bf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:35.170782 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab329a9-d989-4ca8-b829-22c5c19f1bf4 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:35.181860 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 265/541] 10.222.0.58 () {56 vars in 1169 bytes} [Tue Oct 12 16:37:35 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:37:35.182214 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab329a9-d989-4ca8-b829-22c5c19f1bf4 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:35.182676 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a841ca-c336-4a07-b3d9-151ddb347501 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:35.183947 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab329a9-d989-4ca8-b829-22c5c19f1bf4 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:35.193891 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 277/542] 10.222.0.58 () {58 vars in 1324 bytes} [Tue Oct 12 16:37:35 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 12 16:37:35.194703 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab329a9-d989-4ca8-b829-22c5c19f1bf4 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:35.204245 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a841ca-c336-4a07-b3d9-151ddb347501 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:35.208546 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab329a9-d989-4ca8-b829-22c5c19f1bf4 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:35.209685 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef211899-7e97-41bc-9ba4-7769d515f6eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:35.210521 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef211899-7e97-41bc-9ba4-7769d515f6eb admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:35.210796 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef211899-7e97-41bc-9ba4-7769d515f6eb admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:35.211061 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef211899-7e97-41bc-9ba4-7769d515f6eb admin admin] PATH_INFO: `/v3/roles/service` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:35.213264 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b17ddd-02b5-4aff-a94c-e4f18891041c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:35.213997 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b17ddd-02b5-4aff-a94c-e4f18891041c admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:35.214353 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b17ddd-02b5-4aff-a94c-e4f18891041c admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:35.214639 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b17ddd-02b5-4aff-a94c-e4f18891041c admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:35.215591 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b17ddd-02b5-4aff-a94c-e4f18891041c admin admin] RBAC: Adding query filter params (role.id=dea461b7131b413590d73da4994002ca, scope.project.id=f3531f242eaa43b69562d70bca5ec5a8, user.id=8ff84015069041f2bf33e3fd55b92e44) {{(pid=85204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:37:35.215906 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b17ddd-02b5-4aff-a94c-e4f18891041c admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:35.217765 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b17ddd-02b5-4aff-a94c-e4f18891041c admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:35.222324 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef211899-7e97-41bc-9ba4-7769d515f6eb admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 16:37:35.223846 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 278/543] 10.222.0.58 () {56 vars in 1395 bytes} [Tue Oct 12 16:37:35 2021] GET /identity/v3/role_assignments?user.id=8ff84015069041f2bf33e3fd55b92e44&scope.project.id=f3531f242eaa43b69562d70bca5ec5a8&role.id=dea461b7131b413590d73da4994002ca => generated 608 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:37:35.224669 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b17ddd-02b5-4aff-a94c-e4f18891041c admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:35.236622 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: WARNING keystone.server.flask.application [None req-ef211899-7e97-41bc-9ba4-7769d515f6eb admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 12 16:37:35.237947 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 266/544] 10.222.0.58 () {56 vars in 1123 bytes} [Tue Oct 12 16:37:35 2021] GET /identity/v3/roles/service => generated 85 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:37:35.241717 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b17ddd-02b5-4aff-a94c-e4f18891041c admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:35.247249 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef211899-7e97-41bc-9ba4-7769d515f6eb admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:35.252380 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4c36d3-6bec-4b64-82cf-b82ba127ba79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:35.252380 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4c36d3-6bec-4b64-82cf-b82ba127ba79 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:35.252380 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4c36d3-6bec-4b64-82cf-b82ba127ba79 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:35.252380 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4c36d3-6bec-4b64-82cf-b82ba127ba79 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:35.264735 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef211899-7e97-41bc-9ba4-7769d515f6eb admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:35.273210 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d33a9e-701b-4b00-9412-92e25be89e05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:35.274230 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d33a9e-701b-4b00-9412-92e25be89e05 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:35.274569 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d33a9e-701b-4b00-9412-92e25be89e05 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:35.274846 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d33a9e-701b-4b00-9412-92e25be89e05 admin admin] PATH_INFO: `/v3/roles` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:35.276800 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d33a9e-701b-4b00-9412-92e25be89e05 admin admin] RBAC: Adding query filter params (name=service) {{(pid=85205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:37:35.277372 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d33a9e-701b-4b00-9412-92e25be89e05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:35.279684 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4c36d3-6bec-4b64-82cf-b82ba127ba79 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:35.281724 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4c36d3-6bec-4b64-82cf-b82ba127ba79 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:35.282823 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d33a9e-701b-4b00-9412-92e25be89e05 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:35.301223 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 267/545] 10.222.0.58 () {56 vars in 1124 bytes} [Tue Oct 12 16:37:35 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 16:37:35.307932 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d33a9e-701b-4b00-9412-92e25be89e05 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:35.319577 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: WARNING keystone.server.flask.application [None req-fa4c36d3-6bec-4b64-82cf-b82ba127ba79 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 16:37:35.323529 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d33a9e-701b-4b00-9412-92e25be89e05 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:35.324575 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 279/546] 10.222.0.58 () {56 vars in 1129 bytes} [Tue Oct 12 16:37:35 2021] GET /identity/v3/domains/Default => generated 87 bytes in 97 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:37:35.327172 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4c36d3-6bec-4b64-82cf-b82ba127ba79 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:35.336372 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21570e6d-1be0-4e6a-8712-64daa057283a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:35.337189 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21570e6d-1be0-4e6a-8712-64daa057283a admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:35.337470 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21570e6d-1be0-4e6a-8712-64daa057283a admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:35.337743 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21570e6d-1be0-4e6a-8712-64daa057283a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:35.343524 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4c36d3-6bec-4b64-82cf-b82ba127ba79 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:35.355048 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c07211-700f-4890-87ae-91c6e1672ab4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:35.355777 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c07211-700f-4890-87ae-91c6e1672ab4 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:35.356062 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c07211-700f-4890-87ae-91c6e1672ab4 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:35.356343 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c07211-700f-4890-87ae-91c6e1672ab4 admin admin] PATH_INFO: `/v3/domains` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:35.357089 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c07211-700f-4890-87ae-91c6e1672ab4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:37:35.357395 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c07211-700f-4890-87ae-91c6e1672ab4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:35.359231 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c07211-700f-4890-87ae-91c6e1672ab4 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:35.362912 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21570e6d-1be0-4e6a-8712-64daa057283a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:35.365743 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21570e6d-1be0-4e6a-8712-64daa057283a admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:35.382914 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 280/547] 10.222.0.58 () {56 vars in 1130 bytes} [Tue Oct 12 16:37:35 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:37:35.391269 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c07211-700f-4890-87ae-91c6e1672ab4 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:35.395876 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: WARNING keystone.server.flask.application [None req-21570e6d-1be0-4e6a-8712-64daa057283a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 16:37:35.402795 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 268/548] 10.222.0.58 () {56 vars in 1129 bytes} [Tue Oct 12 16:37:35 2021] GET /identity/v3/domains/Default => generated 87 bytes in 95 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:37:35.406223 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c07211-700f-4890-87ae-91c6e1672ab4 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:35.409418 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21570e6d-1be0-4e6a-8712-64daa057283a admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:35.417717 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a6e153-f8cd-462d-a70c-f425fb89e216 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:35.418567 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a6e153-f8cd-462d-a70c-f425fb89e216 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:35.418898 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a6e153-f8cd-462d-a70c-f425fb89e216 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:35.419171 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a6e153-f8cd-462d-a70c-f425fb89e216 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:35.426570 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21570e6d-1be0-4e6a-8712-64daa057283a admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:35.430441 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a6e153-f8cd-462d-a70c-f425fb89e216 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:35.431294 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0639a70-bbc9-44b0-b42f-bbbc5ba9c27f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:35.432065 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0639a70-bbc9-44b0-b42f-bbbc5ba9c27f admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:35.432347 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0639a70-bbc9-44b0-b42f-bbbc5ba9c27f admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:35.432465 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a6e153-f8cd-462d-a70c-f425fb89e216 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:35.432624 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0639a70-bbc9-44b0-b42f-bbbc5ba9c27f admin admin] PATH_INFO: `/v3/domains` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:35.433558 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0639a70-bbc9-44b0-b42f-bbbc5ba9c27f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:37:35.433960 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0639a70-bbc9-44b0-b42f-bbbc5ba9c27f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:35.435595 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0639a70-bbc9-44b0-b42f-bbbc5ba9c27f admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:35.447374 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: WARNING keystone.server.flask.application [None req-c1a6e153-f8cd-462d-a70c-f425fb89e216 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 16:37:35.448914 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 281/550] 10.222.0.58 () {56 vars in 1132 bytes} [Tue Oct 12 16:37:35 2021] GET /identity/v3/projects/service => generated 88 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:37:35.449057 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 269/550] 10.222.0.58 () {56 vars in 1130 bytes} [Tue Oct 12 16:37:35 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:37:35.450246 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffea062-a886-4306-a78b-9543103ae488 None None] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:35.450542 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffea062-a886-4306-a78b-9543103ae488 None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:35.450821 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffea062-a886-4306-a78b-9543103ae488 None None] PATH_INFO: `/` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:35.452528 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 282/551] 10.222.0.58 () {54 vars in 926 bytes} [Tue Oct 12 16:37:35 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:37:35.460168 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffea062-a886-4306-a78b-9543103ae488 None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:35.460605 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c2f70e-e93b-4c59-8ea0-4bebcfc9fcda None None] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:35.460893 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c2f70e-e93b-4c59-8ea0-4bebcfc9fcda None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:35.461173 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c2f70e-e93b-4c59-8ea0-4bebcfc9fcda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:35.474464 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffea062-a886-4306-a78b-9543103ae488 None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:35.481113 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.auth.core [None req-07c2f70e-e93b-4c59-8ea0-4bebcfc9fcda None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:37:35.483602 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-07c2f70e-e93b-4c59-8ea0-4bebcfc9fcda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:37:35.483726 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3440a67-62c9-4263-b7db-4ae15d2daaf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:35.483978 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3440a67-62c9-4263-b7db-4ae15d2daaf5 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:35.484237 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3440a67-62c9-4263-b7db-4ae15d2daaf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:35.485439 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3440a67-62c9-4263-b7db-4ae15d2daaf5 admin admin] PATH_INFO: `/v3/projects` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:35.485540 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3440a67-62c9-4263-b7db-4ae15d2daaf5 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=85204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:37:35.485837 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3440a67-62c9-4263-b7db-4ae15d2daaf5 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:35.488309 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3440a67-62c9-4263-b7db-4ae15d2daaf5 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:35.491357 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 270/552] 10.222.0.58 () {58 vars in 1023 bytes} [Tue Oct 12 16:37:35 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:37:35.491593 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c2f70e-e93b-4c59-8ea0-4bebcfc9fcda None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:35.501748 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c2f70e-e93b-4c59-8ea0-4bebcfc9fcda None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:35.505217 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 283/553] 10.222.0.58 () {56 vars in 1169 bytes} [Tue Oct 12 16:37:35 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:37:35.512013 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3440a67-62c9-4263-b7db-4ae15d2daaf5 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:35.512475 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ffd0cd-2486-47b3-a84a-7f1adfcea90b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:35.513408 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ffd0cd-2486-47b3-a84a-7f1adfcea90b admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:35.513699 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ffd0cd-2486-47b3-a84a-7f1adfcea90b admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:35.514017 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ffd0cd-2486-47b3-a84a-7f1adfcea90b admin admin] PATH_INFO: `/v3/users/neutron` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:35.521803 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ffd0cd-2486-47b3-a84a-7f1adfcea90b admin admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:35.523967 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ffd0cd-2486-47b3-a84a-7f1adfcea90b admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:35.524930 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3440a67-62c9-4263-b7db-4ae15d2daaf5 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:35.529652 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15ea565-11f2-4076-b7fd-e902d105b07a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:35.530548 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15ea565-11f2-4076-b7fd-e902d105b07a admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:35.531032 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15ea565-11f2-4076-b7fd-e902d105b07a admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:35.531534 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15ea565-11f2-4076-b7fd-e902d105b07a admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:35.532580 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15ea565-11f2-4076-b7fd-e902d105b07a admin admin] RBAC: Adding query filter params (role.id=dea461b7131b413590d73da4994002ca, scope.project.id=f3531f242eaa43b69562d70bca5ec5a8, user.id=04704222b3d64a33a6c092fc641ccbb0) {{(pid=85204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:37:35.533100 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15ea565-11f2-4076-b7fd-e902d105b07a admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:35.535273 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15ea565-11f2-4076-b7fd-e902d105b07a admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:35.537853 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: WARNING keystone.server.flask.application [None req-c1ffd0cd-2486-47b3-a84a-7f1adfcea90b admin admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Oct 12 16:37:35.539181 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 271/554] 10.222.0.58 () {56 vars in 1123 bytes} [Tue Oct 12 16:37:35 2021] GET /identity/v3/users/neutron => generated 85 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:37:35.539778 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ffd0cd-2486-47b3-a84a-7f1adfcea90b admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:35.547812 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 284/555] 10.222.0.58 () {56 vars in 1395 bytes} [Tue Oct 12 16:37:35 2021] GET /identity/v3/role_assignments?user.id=04704222b3d64a33a6c092fc641ccbb0&scope.project.id=f3531f242eaa43b69562d70bca5ec5a8&role.id=dea461b7131b413590d73da4994002ca => generated 608 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 16:37:35.548840 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15ea565-11f2-4076-b7fd-e902d105b07a admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:35.550855 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ffd0cd-2486-47b3-a84a-7f1adfcea90b admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:35.555343 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee467b1-4471-4348-8a3f-deec4658d08c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:35.561900 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee467b1-4471-4348-8a3f-deec4658d08c admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:35.561900 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee467b1-4471-4348-8a3f-deec4658d08c admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:35.561900 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee467b1-4471-4348-8a3f-deec4658d08c admin admin] PATH_INFO: `/v3/roles/service` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:35.568283 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15ea565-11f2-4076-b7fd-e902d105b07a admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:35.569369 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee467b1-4471-4348-8a3f-deec4658d08c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 16:37:35.573676 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749deaac-b754-4950-83bb-90e21a36aeaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:35.574717 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749deaac-b754-4950-83bb-90e21a36aeaf admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:35.575206 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749deaac-b754-4950-83bb-90e21a36aeaf admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:35.575681 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749deaac-b754-4950-83bb-90e21a36aeaf admin admin] PATH_INFO: `/v3/users` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:35.576787 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749deaac-b754-4950-83bb-90e21a36aeaf admin admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=85204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:37:35.577012 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: WARNING keystone.server.flask.application [None req-9ee467b1-4471-4348-8a3f-deec4658d08c admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 12 16:37:35.577510 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749deaac-b754-4950-83bb-90e21a36aeaf admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:35.578685 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 272/556] 10.222.0.58 () {56 vars in 1123 bytes} [Tue Oct 12 16:37:35 2021] GET /identity/v3/roles/service => generated 85 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:37:35.579861 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749deaac-b754-4950-83bb-90e21a36aeaf admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:35.587976 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee467b1-4471-4348-8a3f-deec4658d08c admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:35.601765 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee467b1-4471-4348-8a3f-deec4658d08c admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:35.606725 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 285/557] 10.222.0.58 () {56 vars in 1160 bytes} [Tue Oct 12 16:37:35 2021] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:37:35.608951 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ab32ec-69d9-4ef5-985d-9d1e23b58acc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:35.609956 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ab32ec-69d9-4ef5-985d-9d1e23b58acc admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:35.610507 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ab32ec-69d9-4ef5-985d-9d1e23b58acc admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:35.610997 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ab32ec-69d9-4ef5-985d-9d1e23b58acc admin admin] PATH_INFO: `/v3/roles` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:35.612504 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ab32ec-69d9-4ef5-985d-9d1e23b58acc admin admin] RBAC: Adding query filter params (name=service) {{(pid=85205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:37:35.613572 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ab32ec-69d9-4ef5-985d-9d1e23b58acc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:35.614147 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749deaac-b754-4950-83bb-90e21a36aeaf admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:35.615901 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ab32ec-69d9-4ef5-985d-9d1e23b58acc admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:35.624383 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749deaac-b754-4950-83bb-90e21a36aeaf admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:35.627514 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 273/558] 10.222.0.58 () {56 vars in 1124 bytes} [Tue Oct 12 16:37:35 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:37:35.634975 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97df2e74-358d-49f0-b4f3-5516a3614ef7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:35.635546 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ab32ec-69d9-4ef5-985d-9d1e23b58acc admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:35.635681 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97df2e74-358d-49f0-b4f3-5516a3614ef7 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:35.636027 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97df2e74-358d-49f0-b4f3-5516a3614ef7 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:35.636311 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97df2e74-358d-49f0-b4f3-5516a3614ef7 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:35.646462 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97df2e74-358d-49f0-b4f3-5516a3614ef7 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:35.646825 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ab32ec-69d9-4ef5-985d-9d1e23b58acc admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:35.649311 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97df2e74-358d-49f0-b4f3-5516a3614ef7 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:35.653550 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae152e2-ee3f-4c4d-871b-a9d1397174fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:35.654744 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae152e2-ee3f-4c4d-871b-a9d1397174fb admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:35.655287 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae152e2-ee3f-4c4d-871b-a9d1397174fb admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:35.655804 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae152e2-ee3f-4c4d-871b-a9d1397174fb admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:35.659708 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 286/559] 10.222.0.58 () {58 vars in 1324 bytes} [Tue Oct 12 16:37:35 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:37:35.666219 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97df2e74-358d-49f0-b4f3-5516a3614ef7 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:35.668625 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae152e2-ee3f-4c4d-871b-a9d1397174fb admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:35.671755 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae152e2-ee3f-4c4d-871b-a9d1397174fb admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:35.676868 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97df2e74-358d-49f0-b4f3-5516a3614ef7 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:35.683170 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af794c35-69a4-4d6f-8053-a413c652b017 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:35.684260 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af794c35-69a4-4d6f-8053-a413c652b017 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:35.684737 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af794c35-69a4-4d6f-8053-a413c652b017 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:35.685192 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af794c35-69a4-4d6f-8053-a413c652b017 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:35.693557 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: WARNING keystone.server.flask.application [None req-eae152e2-ee3f-4c4d-871b-a9d1397174fb admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 16:37:35.694905 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 274/560] 10.222.0.58 () {56 vars in 1129 bytes} [Tue Oct 12 16:37:35 2021] GET /identity/v3/domains/Default => generated 87 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 16:37:35.698314 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af794c35-69a4-4d6f-8053-a413c652b017 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:35.700439 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af794c35-69a4-4d6f-8053-a413c652b017 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:35.702044 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae152e2-ee3f-4c4d-871b-a9d1397174fb admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:35.712259 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae152e2-ee3f-4c4d-871b-a9d1397174fb admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:35.718024 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00126c25-f416-48e3-a457-31a7b1d10f66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:35.718788 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00126c25-f416-48e3-a457-31a7b1d10f66 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:35.719189 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00126c25-f416-48e3-a457-31a7b1d10f66 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:35.719589 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00126c25-f416-48e3-a457-31a7b1d10f66 admin admin] PATH_INFO: `/v3/domains` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:35.720412 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00126c25-f416-48e3-a457-31a7b1d10f66 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:37:35.720809 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00126c25-f416-48e3-a457-31a7b1d10f66 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:35.722356 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: WARNING keystone.server.flask.application [None req-af794c35-69a4-4d6f-8053-a413c652b017 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 16:37:35.722741 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00126c25-f416-48e3-a457-31a7b1d10f66 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:35.724318 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 287/561] 10.222.0.58 () {56 vars in 1129 bytes} [Tue Oct 12 16:37:35 2021] GET /identity/v3/domains/Default => generated 87 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:37:35.730886 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af794c35-69a4-4d6f-8053-a413c652b017 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:35.742008 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af794c35-69a4-4d6f-8053-a413c652b017 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:35.744561 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 275/562] 10.222.0.58 () {56 vars in 1130 bytes} [Tue Oct 12 16:37:35 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 16:37:35.745726 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00126c25-f416-48e3-a457-31a7b1d10f66 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:35.747651 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9238940-13d5-43f6-8acd-abe07b1b29a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:35.748570 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9238940-13d5-43f6-8acd-abe07b1b29a7 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:35.749071 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9238940-13d5-43f6-8acd-abe07b1b29a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:35.749554 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9238940-13d5-43f6-8acd-abe07b1b29a7 admin admin] PATH_INFO: `/v3/domains` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:35.750552 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9238940-13d5-43f6-8acd-abe07b1b29a7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:37:35.751064 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9238940-13d5-43f6-8acd-abe07b1b29a7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:35.752870 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9238940-13d5-43f6-8acd-abe07b1b29a7 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:35.757136 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00126c25-f416-48e3-a457-31a7b1d10f66 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:35.762292 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b5f8ad-11ec-440e-8134-b73a32c68e60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:35.762970 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b5f8ad-11ec-440e-8134-b73a32c68e60 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:35.763256 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b5f8ad-11ec-440e-8134-b73a32c68e60 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:35.763589 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b5f8ad-11ec-440e-8134-b73a32c68e60 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:35.769689 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 288/563] 10.222.0.58 () {56 vars in 1130 bytes} [Tue Oct 12 16:37:35 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:37:35.773833 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b5f8ad-11ec-440e-8134-b73a32c68e60 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:35.775829 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b5f8ad-11ec-440e-8134-b73a32c68e60 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:35.777046 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9238940-13d5-43f6-8acd-abe07b1b29a7 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:35.787587 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9238940-13d5-43f6-8acd-abe07b1b29a7 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:35.791370 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: WARNING keystone.server.flask.application [None req-93b5f8ad-11ec-440e-8134-b73a32c68e60 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 12 16:37:35.792608 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 276/564] 10.222.0.58 () {56 vars in 1117 bytes} [Tue Oct 12 16:37:35 2021] GET /identity/v3/users/swift => generated 83 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:37:35.794606 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0923f6e6-d7f3-4ce8-b4be-07a52756cbe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:35.795762 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0923f6e6-d7f3-4ce8-b4be-07a52756cbe7 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:35.796244 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0923f6e6-d7f3-4ce8-b4be-07a52756cbe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:35.796801 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0923f6e6-d7f3-4ce8-b4be-07a52756cbe7 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:35.799120 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b5f8ad-11ec-440e-8134-b73a32c68e60 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:35.805121 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0923f6e6-d7f3-4ce8-b4be-07a52756cbe7 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:35.808416 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0923f6e6-d7f3-4ce8-b4be-07a52756cbe7 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:35.812057 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b5f8ad-11ec-440e-8134-b73a32c68e60 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:35.819552 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1087b505-15ec-4a6f-9cfb-50926c023420 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:35.820225 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1087b505-15ec-4a6f-9cfb-50926c023420 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:35.820509 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1087b505-15ec-4a6f-9cfb-50926c023420 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:35.820790 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1087b505-15ec-4a6f-9cfb-50926c023420 admin admin] PATH_INFO: `/v3/users` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:35.821653 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1087b505-15ec-4a6f-9cfb-50926c023420 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=85205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:37:35.821994 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1087b505-15ec-4a6f-9cfb-50926c023420 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:35.823884 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1087b505-15ec-4a6f-9cfb-50926c023420 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:35.828079 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: WARNING keystone.server.flask.application [None req-0923f6e6-d7f3-4ce8-b4be-07a52756cbe7 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 16:37:35.829473 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 289/565] 10.222.0.58 () {56 vars in 1132 bytes} [Tue Oct 12 16:37:35 2021] GET /identity/v3/projects/service => generated 88 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 16:37:35.835907 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0923f6e6-d7f3-4ce8-b4be-07a52756cbe7 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:35.847436 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 277/566] 10.222.0.58 () {56 vars in 1156 bytes} [Tue Oct 12 16:37:35 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:37:35.847808 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0923f6e6-d7f3-4ce8-b4be-07a52756cbe7 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:35.855096 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1087b505-15ec-4a6f-9cfb-50926c023420 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:35.858783 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3eb7916-e233-4319-a382-ce87dabbe6e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:35.859780 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3eb7916-e233-4319-a382-ce87dabbe6e8 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:35.860261 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3eb7916-e233-4319-a382-ce87dabbe6e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:35.861036 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3eb7916-e233-4319-a382-ce87dabbe6e8 admin admin] PATH_INFO: `/v3/projects` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:35.863297 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3eb7916-e233-4319-a382-ce87dabbe6e8 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=85204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:37:35.864005 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3eb7916-e233-4319-a382-ce87dabbe6e8 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:35.866175 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3eb7916-e233-4319-a382-ce87dabbe6e8 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:35.866368 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1087b505-15ec-4a6f-9cfb-50926c023420 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:35.871370 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cc58f3-9efc-4ea5-a6d8-abb6d9632142 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:35.872158 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cc58f3-9efc-4ea5-a6d8-abb6d9632142 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:35.872443 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cc58f3-9efc-4ea5-a6d8-abb6d9632142 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:35.872728 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cc58f3-9efc-4ea5-a6d8-abb6d9632142 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:35.886568 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 290/567] 10.222.0.58 () {56 vars in 1169 bytes} [Tue Oct 12 16:37:35 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 16:37:35.893656 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3eb7916-e233-4319-a382-ce87dabbe6e8 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:35.899031 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cc58f3-9efc-4ea5-a6d8-abb6d9632142 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:35.901232 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cc58f3-9efc-4ea5-a6d8-abb6d9632142 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:35.905586 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3eb7916-e233-4319-a382-ce87dabbe6e8 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:35.912113 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043060c8-7967-4f40-9d7c-57584a22dcba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:35.912926 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043060c8-7967-4f40-9d7c-57584a22dcba admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:35.913523 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043060c8-7967-4f40-9d7c-57584a22dcba admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:35.914098 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043060c8-7967-4f40-9d7c-57584a22dcba admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:35.914953 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043060c8-7967-4f40-9d7c-57584a22dcba admin admin] RBAC: Adding query filter params (role.id=dea461b7131b413590d73da4994002ca, scope.project.id=f3531f242eaa43b69562d70bca5ec5a8, user.id=6e65f6d0598e4c539134292b86fb43d2) {{(pid=85204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:37:35.915270 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043060c8-7967-4f40-9d7c-57584a22dcba admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:35.917088 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043060c8-7967-4f40-9d7c-57584a22dcba admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:35.922604 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: WARNING keystone.server.flask.application [None req-51cc58f3-9efc-4ea5-a6d8-abb6d9632142 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 16:37:35.924240 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 291/568] 10.222.0.58 () {56 vars in 1395 bytes} [Tue Oct 12 16:37:35 2021] GET /identity/v3/role_assignments?user.id=6e65f6d0598e4c539134292b86fb43d2&scope.project.id=f3531f242eaa43b69562d70bca5ec5a8&role.id=dea461b7131b413590d73da4994002ca => generated 608 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:37:35.924846 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 278/569] 10.222.0.58 () {56 vars in 1129 bytes} [Tue Oct 12 16:37:35 2021] GET /identity/v3/domains/Default => generated 87 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 16:37:35.932035 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043060c8-7967-4f40-9d7c-57584a22dcba admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:35.942615 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043060c8-7967-4f40-9d7c-57584a22dcba admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:35.947406 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a126f4f5-ec8d-4f01-9e25-9e0495d77cd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:35.948084 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a126f4f5-ec8d-4f01-9e25-9e0495d77cd7 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:35.948380 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a126f4f5-ec8d-4f01-9e25-9e0495d77cd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:35.948657 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a126f4f5-ec8d-4f01-9e25-9e0495d77cd7 admin admin] PATH_INFO: `/v3/domains` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:35.949406 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a126f4f5-ec8d-4f01-9e25-9e0495d77cd7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:37:35.949714 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a126f4f5-ec8d-4f01-9e25-9e0495d77cd7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:35.951400 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a126f4f5-ec8d-4f01-9e25-9e0495d77cd7 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:35.965213 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 292/570] 10.222.0.58 () {56 vars in 1130 bytes} [Tue Oct 12 16:37:35 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:37:35.971579 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cc58f3-9efc-4ea5-a6d8-abb6d9632142 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:35.984821 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cc58f3-9efc-4ea5-a6d8-abb6d9632142 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:35.991727 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3fc43c-8410-4b11-8c95-6e2f1fef466d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:35.992547 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3fc43c-8410-4b11-8c95-6e2f1fef466d admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:35.992838 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3fc43c-8410-4b11-8c95-6e2f1fef466d admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:35.993118 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3fc43c-8410-4b11-8c95-6e2f1fef466d admin admin] PATH_INFO: `/v3/projects/service` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:36.001148 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3fc43c-8410-4b11-8c95-6e2f1fef466d admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:36.003246 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3fc43c-8410-4b11-8c95-6e2f1fef466d admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:36.017930 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: WARNING keystone.server.flask.application [None req-0a3fc43c-8410-4b11-8c95-6e2f1fef466d admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 16:37:36.019532 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 279/571] 10.222.0.58 () {56 vars in 1132 bytes} [Tue Oct 12 16:37:35 2021] GET /identity/v3/projects/service => generated 88 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:37:36.026004 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a126f4f5-ec8d-4f01-9e25-9e0495d77cd7 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:36.037982 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a126f4f5-ec8d-4f01-9e25-9e0495d77cd7 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:36.042619 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f67b45e-c696-4a7a-a839-933a136a56a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:36.043295 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f67b45e-c696-4a7a-a839-933a136a56a2 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:36.043579 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f67b45e-c696-4a7a-a839-933a136a56a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:36.043852 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f67b45e-c696-4a7a-a839-933a136a56a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:36.044672 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f67b45e-c696-4a7a-a839-933a136a56a2 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=85204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:37:36.044982 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f67b45e-c696-4a7a-a839-933a136a56a2 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:36.046859 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f67b45e-c696-4a7a-a839-933a136a56a2 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:36.060317 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 293/572] 10.222.0.58 () {56 vars in 1169 bytes} [Tue Oct 12 16:37:36 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:37:36.066867 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3fc43c-8410-4b11-8c95-6e2f1fef466d admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:36.078645 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3fc43c-8410-4b11-8c95-6e2f1fef466d admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:36.083350 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905309ae-83cd-458c-a8fc-e054ccbd9734 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:36.084250 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905309ae-83cd-458c-a8fc-e054ccbd9734 admin admin] REQUEST_METHOD: `PUT` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:36.084533 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905309ae-83cd-458c-a8fc-e054ccbd9734 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:36.084808 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905309ae-83cd-458c-a8fc-e054ccbd9734 admin admin] PATH_INFO: `/v3/projects/f3531f242eaa43b69562d70bca5ec5a8/users/9fdeb0a451344c9987b4134b957ffa22/roles/dea461b7131b413590d73da4994002ca` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:36.105319 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905309ae-83cd-458c-a8fc-e054ccbd9734 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3531f242eaa43b69562d70bca5ec5a8, user_id=9fdeb0a451344c9987b4134b957ffa22, role_id=dea461b7131b413590d73da4994002ca)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:36.108045 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905309ae-83cd-458c-a8fc-e054ccbd9734 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:36.132027 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 280/573] 10.222.0.58 () {58 vars in 1460 bytes} [Tue Oct 12 16:37:36 2021] PUT /identity/v3/projects/f3531f242eaa43b69562d70bca5ec5a8/users/9fdeb0a451344c9987b4134b957ffa22/roles/dea461b7131b413590d73da4994002ca => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:37:37.664006 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c72af9b-33fe-4fce-b5be-09df4d3b895b None None] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:37.664529 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c72af9b-33fe-4fce-b5be-09df4d3b895b None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:37.664604 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c72af9b-33fe-4fce-b5be-09df4d3b895b None None] PATH_INFO: `/` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:37.666631 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 294/574] 10.222.0.58 () {54 vars in 926 bytes} [Tue Oct 12 16:37:37 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:37:37.672684 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db91e98-6fdc-4709-821a-0036b85d1107 None None] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:37.673084 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db91e98-6fdc-4709-821a-0036b85d1107 None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:37.673250 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db91e98-6fdc-4709-821a-0036b85d1107 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:37.695203 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.auth.core [None req-4db91e98-6fdc-4709-821a-0036b85d1107 None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:37:37.696400 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-4db91e98-6fdc-4709-821a-0036b85d1107 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:37:37.773215 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 281/575] 10.222.0.58 () {58 vars in 1023 bytes} [Tue Oct 12 16:37:37 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:37:37.815388 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c72af9b-33fe-4fce-b5be-09df4d3b895b None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:37.832240 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c72af9b-33fe-4fce-b5be-09df4d3b895b None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:37.839374 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cb86c2-f53f-4cb9-a6ee-c01629743d3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:37.840176 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cb86c2-f53f-4cb9-a6ee-c01629743d3b admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:37.840460 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cb86c2-f53f-4cb9-a6ee-c01629743d3b admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:37.840738 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cb86c2-f53f-4cb9-a6ee-c01629743d3b admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:37.858833 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cb86c2-f53f-4cb9-a6ee-c01629743d3b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 16:37:37.865727 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: WARNING keystone.server.flask.application [None req-a7cb86c2-f53f-4cb9-a6ee-c01629743d3b admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 16:37:37.866948 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 295/576] 10.222.0.58 () {56 vars in 1117 bytes} [Tue Oct 12 16:37:37 2021] GET /identity/v3/roles/admin => generated 83 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:37:37.873505 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db91e98-6fdc-4709-821a-0036b85d1107 None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:37.883026 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db91e98-6fdc-4709-821a-0036b85d1107 None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:37.894227 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6d3147-4b45-4c3c-b6d5-0e402c3ab67b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:37.894906 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6d3147-4b45-4c3c-b6d5-0e402c3ab67b admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:37.895191 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6d3147-4b45-4c3c-b6d5-0e402c3ab67b admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:37.895465 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6d3147-4b45-4c3c-b6d5-0e402c3ab67b admin admin] PATH_INFO: `/v3/roles` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:37.896235 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6d3147-4b45-4c3c-b6d5-0e402c3ab67b admin admin] RBAC: Adding query filter params (name=admin) {{(pid=85205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:37:37.896544 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6d3147-4b45-4c3c-b6d5-0e402c3ab67b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:37.898157 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6d3147-4b45-4c3c-b6d5-0e402c3ab67b admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:37.907031 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 282/577] 10.222.0.58 () {56 vars in 1120 bytes} [Tue Oct 12 16:37:37 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:37:37.914208 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cb86c2-f53f-4cb9-a6ee-c01629743d3b admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:37.924503 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cb86c2-f53f-4cb9-a6ee-c01629743d3b admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:37.929071 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ae731d-acbb-40ae-b6d6-870a55bbe89f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:37.929851 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ae731d-acbb-40ae-b6d6-870a55bbe89f admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:37.930161 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ae731d-acbb-40ae-b6d6-870a55bbe89f admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:37.930436 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ae731d-acbb-40ae-b6d6-870a55bbe89f admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:37.940938 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ae731d-acbb-40ae-b6d6-870a55bbe89f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:37.942831 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ae731d-acbb-40ae-b6d6-870a55bbe89f admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:37.960420 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: WARNING keystone.server.flask.application [None req-98ae731d-acbb-40ae-b6d6-870a55bbe89f admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 16:37:37.961936 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 296/578] 10.222.0.58 () {56 vars in 1129 bytes} [Tue Oct 12 16:37:37 2021] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:37:37.970128 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6d3147-4b45-4c3c-b6d5-0e402c3ab67b admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:37.980718 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6d3147-4b45-4c3c-b6d5-0e402c3ab67b admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:37.989690 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee15de95-cd76-4732-9549-c4be6392fa18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:37.990384 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee15de95-cd76-4732-9549-c4be6392fa18 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:37.990669 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee15de95-cd76-4732-9549-c4be6392fa18 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:37.990948 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee15de95-cd76-4732-9549-c4be6392fa18 admin admin] PATH_INFO: `/v3/domains` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:37.991695 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee15de95-cd76-4732-9549-c4be6392fa18 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:37:37.992005 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee15de95-cd76-4732-9549-c4be6392fa18 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:37.993593 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee15de95-cd76-4732-9549-c4be6392fa18 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:38.011538 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 283/579] 10.222.0.58 () {56 vars in 1130 bytes} [Tue Oct 12 16:37:37 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:37:38.017477 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ae731d-acbb-40ae-b6d6-870a55bbe89f admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:38.030877 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ae731d-acbb-40ae-b6d6-870a55bbe89f admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:38.039478 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f45b57-ab41-41f5-8e46-226882dd41f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:38.040286 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f45b57-ab41-41f5-8e46-226882dd41f4 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:38.040572 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f45b57-ab41-41f5-8e46-226882dd41f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:38.040847 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f45b57-ab41-41f5-8e46-226882dd41f4 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:38.050585 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f45b57-ab41-41f5-8e46-226882dd41f4 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:38.052594 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f45b57-ab41-41f5-8e46-226882dd41f4 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:38.070118 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: WARNING keystone.server.flask.application [None req-08f45b57-ab41-41f5-8e46-226882dd41f4 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 12 16:37:38.071601 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 297/580] 10.222.0.58 () {56 vars in 1114 bytes} [Tue Oct 12 16:37:38 2021] GET /identity/v3/users/nova => generated 82 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:37:38.077822 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee15de95-cd76-4732-9549-c4be6392fa18 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:38.088875 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee15de95-cd76-4732-9549-c4be6392fa18 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:38.097591 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108cf38e-0bae-4d52-913c-7c15b0dff53c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:38.098283 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108cf38e-0bae-4d52-913c-7c15b0dff53c admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:38.098568 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108cf38e-0bae-4d52-913c-7c15b0dff53c admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:38.098844 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108cf38e-0bae-4d52-913c-7c15b0dff53c admin admin] PATH_INFO: `/v3/users` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:38.099697 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108cf38e-0bae-4d52-913c-7c15b0dff53c admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=85205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:37:38.100010 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108cf38e-0bae-4d52-913c-7c15b0dff53c admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:38.101848 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108cf38e-0bae-4d52-913c-7c15b0dff53c admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:38.124357 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 284/581] 10.222.0.58 () {56 vars in 1154 bytes} [Tue Oct 12 16:37:38 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:37:38.131274 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f45b57-ab41-41f5-8e46-226882dd41f4 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:38.147541 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f45b57-ab41-41f5-8e46-226882dd41f4 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:38.155361 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a397d90-8845-44dc-b55b-e441e210cc4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:38.156014 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a397d90-8845-44dc-b55b-e441e210cc4d admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:38.156301 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a397d90-8845-44dc-b55b-e441e210cc4d admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:38.156578 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a397d90-8845-44dc-b55b-e441e210cc4d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:38.169486 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a397d90-8845-44dc-b55b-e441e210cc4d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:38.171186 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a397d90-8845-44dc-b55b-e441e210cc4d admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:38.183536 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 298/582] 10.222.0.58 () {58 vars in 1324 bytes} [Tue Oct 12 16:37:38 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:37:38.189452 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108cf38e-0bae-4d52-913c-7c15b0dff53c admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:38.199872 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108cf38e-0bae-4d52-913c-7c15b0dff53c admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:38.210171 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587c96e8-6372-4b53-b3a4-723e9d90e539 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:38.210987 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587c96e8-6372-4b53-b3a4-723e9d90e539 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:38.211242 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587c96e8-6372-4b53-b3a4-723e9d90e539 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:38.211514 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587c96e8-6372-4b53-b3a4-723e9d90e539 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:38.222314 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587c96e8-6372-4b53-b3a4-723e9d90e539 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:38.224139 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587c96e8-6372-4b53-b3a4-723e9d90e539 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:38.250499 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: WARNING keystone.server.flask.application [None req-587c96e8-6372-4b53-b3a4-723e9d90e539 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 16:37:38.251707 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 285/583] 10.222.0.58 () {56 vars in 1129 bytes} [Tue Oct 12 16:37:38 2021] GET /identity/v3/domains/Default => generated 87 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:37:38.258735 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a397d90-8845-44dc-b55b-e441e210cc4d admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:38.268217 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a397d90-8845-44dc-b55b-e441e210cc4d admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:38.276276 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcf19b3-f65b-4a0a-99e9-2485bbc95a6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:38.277009 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcf19b3-f65b-4a0a-99e9-2485bbc95a6a admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:38.277300 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcf19b3-f65b-4a0a-99e9-2485bbc95a6a admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:38.277603 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcf19b3-f65b-4a0a-99e9-2485bbc95a6a admin admin] PATH_INFO: `/v3/domains` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:38.278444 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcf19b3-f65b-4a0a-99e9-2485bbc95a6a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:37:38.278757 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcf19b3-f65b-4a0a-99e9-2485bbc95a6a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:38.280495 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcf19b3-f65b-4a0a-99e9-2485bbc95a6a admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:38.297502 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 299/584] 10.222.0.58 () {56 vars in 1130 bytes} [Tue Oct 12 16:37:38 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:37:38.303906 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587c96e8-6372-4b53-b3a4-723e9d90e539 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:38.314409 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587c96e8-6372-4b53-b3a4-723e9d90e539 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:38.325187 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1428108d-69b0-48b8-bc29-cb19ee03a7a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:38.326033 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1428108d-69b0-48b8-bc29-cb19ee03a7a0 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:38.326316 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1428108d-69b0-48b8-bc29-cb19ee03a7a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:38.326587 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1428108d-69b0-48b8-bc29-cb19ee03a7a0 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:38.343346 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1428108d-69b0-48b8-bc29-cb19ee03a7a0 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:38.345360 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1428108d-69b0-48b8-bc29-cb19ee03a7a0 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:38.362910 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: WARNING keystone.server.flask.application [None req-1428108d-69b0-48b8-bc29-cb19ee03a7a0 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 16:37:38.364175 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 286/585] 10.222.0.58 () {56 vars in 1132 bytes} [Tue Oct 12 16:37:38 2021] GET /identity/v3/projects/service => generated 88 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:37:38.372405 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcf19b3-f65b-4a0a-99e9-2485bbc95a6a admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:38.390994 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcf19b3-f65b-4a0a-99e9-2485bbc95a6a admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:38.403482 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a603145e-bfc8-420f-bbb5-56d065d5c645 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:38.404167 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a603145e-bfc8-420f-bbb5-56d065d5c645 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:38.404451 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a603145e-bfc8-420f-bbb5-56d065d5c645 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:38.404728 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a603145e-bfc8-420f-bbb5-56d065d5c645 admin admin] PATH_INFO: `/v3/projects` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:38.405542 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a603145e-bfc8-420f-bbb5-56d065d5c645 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=85204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:37:38.405856 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a603145e-bfc8-420f-bbb5-56d065d5c645 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:38.407823 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a603145e-bfc8-420f-bbb5-56d065d5c645 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:38.429268 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 300/586] 10.222.0.58 () {56 vars in 1169 bytes} [Tue Oct 12 16:37:38 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:37:38.435494 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1428108d-69b0-48b8-bc29-cb19ee03a7a0 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:38.445902 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc7548e-24c8-4840-817c-5031e2388ad6 None None] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:38.446255 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc7548e-24c8-4840-817c-5031e2388ad6 None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:38.446532 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc7548e-24c8-4840-817c-5031e2388ad6 None None] PATH_INFO: `/` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:38.448887 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 301/587] 10.222.0.58 () {54 vars in 926 bytes} [Tue Oct 12 16:37:38 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 12 16:37:38.451011 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1428108d-69b0-48b8-bc29-cb19ee03a7a0 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:38.454734 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03a92f6-6c3c-433e-a041-0087808d87a1 None None] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:38.455018 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03a92f6-6c3c-433e-a041-0087808d87a1 None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:38.455292 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03a92f6-6c3c-433e-a041-0087808d87a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:38.461145 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bc27e8-4c84-4fb1-9e96-35bfe2ebd81a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:38.462057 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bc27e8-4c84-4fb1-9e96-35bfe2ebd81a admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:38.463257 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bc27e8-4c84-4fb1-9e96-35bfe2ebd81a admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:38.463541 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bc27e8-4c84-4fb1-9e96-35bfe2ebd81a admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:38.464453 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bc27e8-4c84-4fb1-9e96-35bfe2ebd81a admin admin] RBAC: Adding query filter params (role.id=610824e4f50f4fb8954610e98c1de784, scope.project.id=f3531f242eaa43b69562d70bca5ec5a8, user.id=29d30b574eec4ad3990d77d235c8b424) {{(pid=85205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:37:38.464776 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bc27e8-4c84-4fb1-9e96-35bfe2ebd81a admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:38.466700 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bc27e8-4c84-4fb1-9e96-35bfe2ebd81a admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:38.474466 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 287/588] 10.222.0.58 () {56 vars in 1395 bytes} [Tue Oct 12 16:37:38 2021] GET /identity/v3/role_assignments?user.id=29d30b574eec4ad3990d77d235c8b424&scope.project.id=f3531f242eaa43b69562d70bca5ec5a8&role.id=610824e4f50f4fb8954610e98c1de784 => generated 259 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:37:38.478594 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.auth.core [None req-d03a92f6-6c3c-433e-a041-0087808d87a1 None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:37:38.479831 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-d03a92f6-6c3c-433e-a041-0087808d87a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:37:38.488966 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 302/589] 10.222.0.58 () {58 vars in 1023 bytes} [Tue Oct 12 16:37:38 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:37:38.513347 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bc27e8-4c84-4fb1-9e96-35bfe2ebd81a admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:38.524085 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bc27e8-4c84-4fb1-9e96-35bfe2ebd81a admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:38.529090 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99393e5f-3609-4d42-80b6-8fdfb12ca784 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:38.530006 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99393e5f-3609-4d42-80b6-8fdfb12ca784 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:38.530390 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99393e5f-3609-4d42-80b6-8fdfb12ca784 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:38.530664 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99393e5f-3609-4d42-80b6-8fdfb12ca784 admin admin] PATH_INFO: `/v3/services/block-storage` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:38.531336 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99393e5f-3609-4d42-80b6-8fdfb12ca784 admin admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:38.532399 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: WARNING py.warnings [None req-99393e5f-3609-4d42-80b6-8fdfb12ca784 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:get_service failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 12 16:37:38.532399 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: warnings.warn(msg) Oct 12 16:37:38.532399 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: Oct 12 16:37:38.533326 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99393e5f-3609-4d42-80b6-8fdfb12ca784 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:38.539182 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e00f5b-77d7-400b-a471-7ec2a70d3329 None None] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:38.539470 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e00f5b-77d7-400b-a471-7ec2a70d3329 None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:38.539744 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e00f5b-77d7-400b-a471-7ec2a70d3329 None None] PATH_INFO: `/` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:38.541785 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 303/590] 10.222.0.58 () {54 vars in 926 bytes} [Tue Oct 12 16:37:38 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:37:38.547497 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: WARNING keystone.server.flask.application [None req-99393e5f-3609-4d42-80b6-8fdfb12ca784 admin admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 12 16:37:38.549028 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 288/591] 10.222.0.58 () {56 vars in 1150 bytes} [Tue Oct 12 16:37:38 2021] GET /identity/v3/services/block-storage => generated 94 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:37:38.552873 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e26a44-9c54-4346-b9f7-b4c3bdf298cc None None] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:38.553162 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e26a44-9c54-4346-b9f7-b4c3bdf298cc None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:38.553439 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e26a44-9c54-4346-b9f7-b4c3bdf298cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:38.556585 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99393e5f-3609-4d42-80b6-8fdfb12ca784 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:38.567322 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99393e5f-3609-4d42-80b6-8fdfb12ca784 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:38.572577 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.auth.core [None req-58e26a44-9c54-4346-b9f7-b4c3bdf298cc None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:37:38.573912 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-58e26a44-9c54-4346-b9f7-b4c3bdf298cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:37:38.577419 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79997383-d189-43e6-a81c-934662504651 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:38.578305 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79997383-d189-43e6-a81c-934662504651 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:38.578595 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79997383-d189-43e6-a81c-934662504651 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:38.578878 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79997383-d189-43e6-a81c-934662504651 admin admin] PATH_INFO: `/v3/services` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:38.579613 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79997383-d189-43e6-a81c-934662504651 admin admin] RBAC: Adding query filter params (name=block-storage) {{(pid=85205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:37:38.579970 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79997383-d189-43e6-a81c-934662504651 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:38.581081 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: WARNING py.warnings [None req-79997383-d189-43e6-a81c-934662504651 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:list_services failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 12 16:37:38.581081 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: warnings.warn(msg) Oct 12 16:37:38.581081 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: Oct 12 16:37:38.582011 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79997383-d189-43e6-a81c-934662504651 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:38.582524 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 304/592] 10.222.0.58 () {58 vars in 1023 bytes} [Tue Oct 12 16:37:38 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:37:38.587576 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 289/593] 10.222.0.58 () {56 vars in 1145 bytes} [Tue Oct 12 16:37:38 2021] GET /identity/v3/services?name=block-storage => generated 130 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:37:38.595360 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e26a44-9c54-4346-b9f7-b4c3bdf298cc None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:38.609434 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e26a44-9c54-4346-b9f7-b4c3bdf298cc None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:38.622746 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6448a7-fc20-4d36-9215-44a71cca6cb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:38.623442 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6448a7-fc20-4d36-9215-44a71cca6cb0 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:38.623721 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6448a7-fc20-4d36-9215-44a71cca6cb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:38.623994 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6448a7-fc20-4d36-9215-44a71cca6cb0 admin admin] PATH_INFO: `/v3/services` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:38.624738 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6448a7-fc20-4d36-9215-44a71cca6cb0 admin admin] RBAC: Adding query filter params (type=block-storage) {{(pid=85204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:37:38.625042 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6448a7-fc20-4d36-9215-44a71cca6cb0 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:38.626101 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: WARNING py.warnings [None req-fd6448a7-fc20-4d36-9215-44a71cca6cb0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:list_services failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 12 16:37:38.626101 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: warnings.warn(msg) Oct 12 16:37:38.626101 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: Oct 12 16:37:38.627071 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6448a7-fc20-4d36-9215-44a71cca6cb0 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:38.632917 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79997383-d189-43e6-a81c-934662504651 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:38.634942 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 305/594] 10.222.0.58 () {56 vars in 1145 bytes} [Tue Oct 12 16:37:38 2021] GET /identity/v3/services?type=block-storage => generated 130 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:37:38.647808 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79997383-d189-43e6-a81c-934662504651 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:38.652746 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2dece2-1228-4940-94ab-8b54a013a079 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:38.653569 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2dece2-1228-4940-94ab-8b54a013a079 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:38.653857 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2dece2-1228-4940-94ab-8b54a013a079 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:38.654169 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2dece2-1228-4940-94ab-8b54a013a079 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:38.667380 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2dece2-1228-4940-94ab-8b54a013a079 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:38.669328 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2dece2-1228-4940-94ab-8b54a013a079 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:38.688805 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: WARNING keystone.server.flask.application [None req-bb2dece2-1228-4940-94ab-8b54a013a079 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 16:37:38.690004 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 290/595] 10.222.0.58 () {56 vars in 1129 bytes} [Tue Oct 12 16:37:38 2021] GET /identity/v3/domains/Default => generated 87 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 16:37:38.697462 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6448a7-fc20-4d36-9215-44a71cca6cb0 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:38.711997 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6448a7-fc20-4d36-9215-44a71cca6cb0 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:38.722746 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1750e3-0fc1-4441-8d14-bae94a5f10dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:38.723748 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1750e3-0fc1-4441-8d14-bae94a5f10dd admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:38.724265 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1750e3-0fc1-4441-8d14-bae94a5f10dd admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:38.724693 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1750e3-0fc1-4441-8d14-bae94a5f10dd admin admin] PATH_INFO: `/v3/domains` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:38.725695 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1750e3-0fc1-4441-8d14-bae94a5f10dd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:37:38.726312 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1750e3-0fc1-4441-8d14-bae94a5f10dd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:38.728223 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1750e3-0fc1-4441-8d14-bae94a5f10dd admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:38.747710 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 306/596] 10.222.0.58 () {56 vars in 1130 bytes} [Tue Oct 12 16:37:38 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:37:38.755363 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2dece2-1228-4940-94ab-8b54a013a079 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:38.772586 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2dece2-1228-4940-94ab-8b54a013a079 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:38.782373 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b64d93-0fb5-4032-a4b1-bc593501e6f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:38.783219 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b64d93-0fb5-4032-a4b1-bc593501e6f0 admin admin] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:38.783603 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b64d93-0fb5-4032-a4b1-bc593501e6f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:38.784019 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b64d93-0fb5-4032-a4b1-bc593501e6f0 admin admin] PATH_INFO: `/v3/users` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:38.784856 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b64d93-0fb5-4032-a4b1-bc593501e6f0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:38.786919 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b64d93-0fb5-4032-a4b1-bc593501e6f0 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:38.827803 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 291/597] 10.222.0.58 () {60 vars in 1153 bytes} [Tue Oct 12 16:37:38 2021] POST /identity/v3/users => generated 254 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 16:37:38.896360 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fda71b5-7805-461a-acef-d965e1b480e6 None None] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:38.896932 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fda71b5-7805-461a-acef-d965e1b480e6 None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:38.897449 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fda71b5-7805-461a-acef-d965e1b480e6 None None] PATH_INFO: `/` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:38.899854 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 307/598] 10.222.0.58 () {54 vars in 926 bytes} [Tue Oct 12 16:37:38 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:37:38.906499 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d303db-a7ac-490c-a884-1cd79add5f37 None None] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:38.906802 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d303db-a7ac-490c-a884-1cd79add5f37 None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:38.907208 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d303db-a7ac-490c-a884-1cd79add5f37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:38.930050 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.auth.core [None req-97d303db-a7ac-490c-a884-1cd79add5f37 None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:37:38.931285 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-97d303db-a7ac-490c-a884-1cd79add5f37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:37:38.949109 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 292/599] 10.222.0.58 () {58 vars in 1023 bytes} [Tue Oct 12 16:37:38 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:37:38.978738 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fda71b5-7805-461a-acef-d965e1b480e6 None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:39.000187 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fda71b5-7805-461a-acef-d965e1b480e6 None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:39.009051 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821c053d-c402-4f48-bee1-0147239338f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:39.010251 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821c053d-c402-4f48-bee1-0147239338f5 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:39.010741 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821c053d-c402-4f48-bee1-0147239338f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:39.011237 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821c053d-c402-4f48-bee1-0147239338f5 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:39.027041 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821c053d-c402-4f48-bee1-0147239338f5 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 16:37:39.034783 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: WARNING keystone.server.flask.application [None req-821c053d-c402-4f48-bee1-0147239338f5 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 12 16:37:39.036383 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 308/600] 10.222.0.58 () {56 vars in 1123 bytes} [Tue Oct 12 16:37:38 2021] GET /identity/v3/roles/service => generated 85 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:37:39.042882 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d303db-a7ac-490c-a884-1cd79add5f37 None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:39.059758 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d303db-a7ac-490c-a884-1cd79add5f37 None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:39.067699 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702bb4b6-af34-407b-a6b9-69286aa15e21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:39.068454 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702bb4b6-af34-407b-a6b9-69286aa15e21 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:39.068741 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702bb4b6-af34-407b-a6b9-69286aa15e21 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:39.069014 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702bb4b6-af34-407b-a6b9-69286aa15e21 admin admin] PATH_INFO: `/v3/roles` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:39.069852 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702bb4b6-af34-407b-a6b9-69286aa15e21 admin admin] RBAC: Adding query filter params (name=service) {{(pid=85205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:37:39.070187 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702bb4b6-af34-407b-a6b9-69286aa15e21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:39.071854 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702bb4b6-af34-407b-a6b9-69286aa15e21 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:39.084813 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 293/601] 10.222.0.58 () {56 vars in 1124 bytes} [Tue Oct 12 16:37:39 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:37:39.090793 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821c053d-c402-4f48-bee1-0147239338f5 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:39.103355 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821c053d-c402-4f48-bee1-0147239338f5 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:39.108977 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f739b033-c9f1-4ef6-bace-1b1b006fdcad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:39.109763 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f739b033-c9f1-4ef6-bace-1b1b006fdcad admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:39.110082 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f739b033-c9f1-4ef6-bace-1b1b006fdcad admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:39.110360 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f739b033-c9f1-4ef6-bace-1b1b006fdcad admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:39.122626 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f739b033-c9f1-4ef6-bace-1b1b006fdcad admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:39.124477 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f739b033-c9f1-4ef6-bace-1b1b006fdcad admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:39.131412 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28abc414-9282-4569-8b12-f7c7bdf08cf4 None None] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:39.131957 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28abc414-9282-4569-8b12-f7c7bdf08cf4 None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:39.132436 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28abc414-9282-4569-8b12-f7c7bdf08cf4 None None] PATH_INFO: `/` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:39.134515 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 294/602] 10.222.0.58 () {54 vars in 926 bytes} [Tue Oct 12 16:37:39 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 12 16:37:39.140422 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2bfacf-5e0e-4a52-825a-7a3a10268c92 None None] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:39.140927 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2bfacf-5e0e-4a52-825a-7a3a10268c92 None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:39.141386 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2bfacf-5e0e-4a52-825a-7a3a10268c92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:39.142465 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: WARNING keystone.server.flask.application [None req-f739b033-c9f1-4ef6-bace-1b1b006fdcad admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 16:37:39.143800 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 309/603] 10.222.0.58 () {56 vars in 1129 bytes} [Tue Oct 12 16:37:39 2021] GET /identity/v3/domains/Default => generated 87 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:37:39.149537 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f739b033-c9f1-4ef6-bace-1b1b006fdcad admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:39.159702 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f739b033-c9f1-4ef6-bace-1b1b006fdcad admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:39.161142 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.auth.core [None req-da2bfacf-5e0e-4a52-825a-7a3a10268c92 None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:37:39.162574 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-da2bfacf-5e0e-4a52-825a-7a3a10268c92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:37:39.165268 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b442611-a8ad-48c2-8fa9-de1242d63ee9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:39.165490 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b442611-a8ad-48c2-8fa9-de1242d63ee9 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:39.165749 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b442611-a8ad-48c2-8fa9-de1242d63ee9 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:39.166066 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b442611-a8ad-48c2-8fa9-de1242d63ee9 admin admin] PATH_INFO: `/v3/domains` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:39.166803 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b442611-a8ad-48c2-8fa9-de1242d63ee9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:37:39.167109 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b442611-a8ad-48c2-8fa9-de1242d63ee9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:39.168710 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b442611-a8ad-48c2-8fa9-de1242d63ee9 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:39.173041 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 295/604] 10.222.0.58 () {58 vars in 1023 bytes} [Tue Oct 12 16:37:39 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:37:39.183172 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 310/605] 10.222.0.58 () {56 vars in 1130 bytes} [Tue Oct 12 16:37:39 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 16:37:39.189285 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2bfacf-5e0e-4a52-825a-7a3a10268c92 None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:39.203740 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2bfacf-5e0e-4a52-825a-7a3a10268c92 None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:39.203973 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b442611-a8ad-48c2-8fa9-de1242d63ee9 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:39.212850 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6c614f-4049-448c-a7d8-8bceca1358b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:39.213930 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6c614f-4049-448c-a7d8-8bceca1358b4 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:39.214428 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6c614f-4049-448c-a7d8-8bceca1358b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:39.214844 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6c614f-4049-448c-a7d8-8bceca1358b4 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:39.217612 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b442611-a8ad-48c2-8fa9-de1242d63ee9 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:39.222796 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b164ac-35d9-4894-aefb-2050db69b93e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:39.223575 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b164ac-35d9-4894-aefb-2050db69b93e admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:39.223894 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b164ac-35d9-4894-aefb-2050db69b93e admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:39.224134 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b164ac-35d9-4894-aefb-2050db69b93e admin admin] PATH_INFO: `/v3/services/network` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:39.224804 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b164ac-35d9-4894-aefb-2050db69b93e admin admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:39.225437 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6c614f-4049-448c-a7d8-8bceca1358b4 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:39.225899 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: WARNING py.warnings [None req-44b164ac-35d9-4894-aefb-2050db69b93e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:get_service failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 12 16:37:39.225899 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: warnings.warn(msg) Oct 12 16:37:39.225899 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: Oct 12 16:37:39.227934 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b164ac-35d9-4894-aefb-2050db69b93e admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:39.228217 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6c614f-4049-448c-a7d8-8bceca1358b4 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:39.241895 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: WARNING keystone.server.flask.application [None req-44b164ac-35d9-4894-aefb-2050db69b93e admin admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 12 16:37:39.243344 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: WARNING keystone.server.flask.application [None req-fc6c614f-4049-448c-a7d8-8bceca1358b4 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 12 16:37:39.243463 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 311/606] 10.222.0.58 () {56 vars in 1132 bytes} [Tue Oct 12 16:37:39 2021] GET /identity/v3/services/network => generated 88 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 16:37:39.244738 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 296/607] 10.222.0.58 () {56 vars in 1117 bytes} [Tue Oct 12 16:37:39 2021] GET /identity/v3/users/swift => generated 83 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:37:39.250891 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b164ac-35d9-4894-aefb-2050db69b93e admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:39.251706 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6c614f-4049-448c-a7d8-8bceca1358b4 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:39.263559 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6c614f-4049-448c-a7d8-8bceca1358b4 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:39.264518 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b164ac-35d9-4894-aefb-2050db69b93e admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:39.268484 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b6742c-c4b6-486d-a108-557db1c233c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:39.269123 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b6742c-c4b6-486d-a108-557db1c233c4 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:39.269406 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b6742c-c4b6-486d-a108-557db1c233c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:39.269672 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b6742c-c4b6-486d-a108-557db1c233c4 admin admin] PATH_INFO: `/v3/services` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:39.270499 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b6742c-c4b6-486d-a108-557db1c233c4 admin admin] RBAC: Adding query filter params (name=network) {{(pid=85205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:37:39.270808 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b6742c-c4b6-486d-a108-557db1c233c4 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:39.271286 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3569fe-f9c6-4e2d-80ff-78c317d5cdef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:39.272166 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3569fe-f9c6-4e2d-80ff-78c317d5cdef admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:39.272383 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b6742c-c4b6-486d-a108-557db1c233c4 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:39.272790 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3569fe-f9c6-4e2d-80ff-78c317d5cdef admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:39.273237 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3569fe-f9c6-4e2d-80ff-78c317d5cdef admin admin] PATH_INFO: `/v3/users` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:39.274292 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3569fe-f9c6-4e2d-80ff-78c317d5cdef admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=85204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:37:39.274802 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3569fe-f9c6-4e2d-80ff-78c317d5cdef admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:39.276936 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3569fe-f9c6-4e2d-80ff-78c317d5cdef admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:39.277262 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 297/608] 10.222.0.58 () {56 vars in 1133 bytes} [Tue Oct 12 16:37:39 2021] GET /identity/v3/services?name=network => generated 124 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 16:37:39.283286 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b6742c-c4b6-486d-a108-557db1c233c4 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:39.292797 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b6742c-c4b6-486d-a108-557db1c233c4 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:39.298119 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 312/609] 10.222.0.58 () {56 vars in 1156 bytes} [Tue Oct 12 16:37:39 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:37:39.298245 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e19f61-2206-4c71-ad07-c9a8ac7357bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:39.298825 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e19f61-2206-4c71-ad07-c9a8ac7357bc admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:39.299107 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e19f61-2206-4c71-ad07-c9a8ac7357bc admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:39.299384 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e19f61-2206-4c71-ad07-c9a8ac7357bc admin admin] PATH_INFO: `/v3/services` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:39.300616 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e19f61-2206-4c71-ad07-c9a8ac7357bc admin admin] RBAC: Adding query filter params (type=network) {{(pid=85205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:37:39.300924 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e19f61-2206-4c71-ad07-c9a8ac7357bc admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:39.305921 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e19f61-2206-4c71-ad07-c9a8ac7357bc admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:39.308145 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3569fe-f9c6-4e2d-80ff-78c317d5cdef admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:39.314223 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 298/610] 10.222.0.58 () {56 vars in 1133 bytes} [Tue Oct 12 16:37:39 2021] GET /identity/v3/services?type=network => generated 124 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:37:39.321123 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3569fe-f9c6-4e2d-80ff-78c317d5cdef admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:39.326320 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa11f933-2276-4fe1-8e56-3f96cca0ee6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:39.327309 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa11f933-2276-4fe1-8e56-3f96cca0ee6a admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:39.327826 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa11f933-2276-4fe1-8e56-3f96cca0ee6a admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:39.328257 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa11f933-2276-4fe1-8e56-3f96cca0ee6a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:39.337949 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa11f933-2276-4fe1-8e56-3f96cca0ee6a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:39.340151 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa11f933-2276-4fe1-8e56-3f96cca0ee6a admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:39.350871 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 313/611] 10.222.0.58 () {58 vars in 1324 bytes} [Tue Oct 12 16:37:39 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 12 16:37:39.357490 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e19f61-2206-4c71-ad07-c9a8ac7357bc admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:39.368623 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e19f61-2206-4c71-ad07-c9a8ac7357bc admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:39.373655 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a218ed-7268-4bc9-b9f7-2cf779dabb21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:39.374745 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a218ed-7268-4bc9-b9f7-2cf779dabb21 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:39.375176 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a218ed-7268-4bc9-b9f7-2cf779dabb21 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:39.375655 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a218ed-7268-4bc9-b9f7-2cf779dabb21 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:39.388843 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a218ed-7268-4bc9-b9f7-2cf779dabb21 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:39.391031 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a218ed-7268-4bc9-b9f7-2cf779dabb21 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:39.410760 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: WARNING keystone.server.flask.application [None req-c0a218ed-7268-4bc9-b9f7-2cf779dabb21 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 16:37:39.412282 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 299/612] 10.222.0.58 () {56 vars in 1129 bytes} [Tue Oct 12 16:37:39 2021] GET /identity/v3/domains/Default => generated 87 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:37:39.418733 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa11f933-2276-4fe1-8e56-3f96cca0ee6a admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:39.428633 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa11f933-2276-4fe1-8e56-3f96cca0ee6a admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:39.433685 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3212e105-0904-4296-8bbf-bea733939cef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:39.434667 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3212e105-0904-4296-8bbf-bea733939cef admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:39.435098 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3212e105-0904-4296-8bbf-bea733939cef admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:39.435517 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3212e105-0904-4296-8bbf-bea733939cef admin admin] PATH_INFO: `/v3/domains` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:39.436505 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3212e105-0904-4296-8bbf-bea733939cef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:37:39.436966 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3212e105-0904-4296-8bbf-bea733939cef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:39.439006 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3212e105-0904-4296-8bbf-bea733939cef admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:39.452725 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 314/613] 10.222.0.58 () {56 vars in 1130 bytes} [Tue Oct 12 16:37:39 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:37:39.459845 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a218ed-7268-4bc9-b9f7-2cf779dabb21 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:39.470503 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a218ed-7268-4bc9-b9f7-2cf779dabb21 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:39.476048 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb8e3df-9865-4a14-b5bf-4c82539e9257 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:39.477059 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb8e3df-9865-4a14-b5bf-4c82539e9257 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:39.477517 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb8e3df-9865-4a14-b5bf-4c82539e9257 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:39.477959 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb8e3df-9865-4a14-b5bf-4c82539e9257 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:39.486151 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb8e3df-9865-4a14-b5bf-4c82539e9257 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:39.489774 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb8e3df-9865-4a14-b5bf-4c82539e9257 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:39.505579 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: WARNING keystone.server.flask.application [None req-4fb8e3df-9865-4a14-b5bf-4c82539e9257 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 16:37:39.507407 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 300/614] 10.222.0.58 () {56 vars in 1132 bytes} [Tue Oct 12 16:37:39 2021] GET /identity/v3/projects/service => generated 88 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:37:39.513952 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3212e105-0904-4296-8bbf-bea733939cef admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:39.524649 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3212e105-0904-4296-8bbf-bea733939cef admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:39.530000 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e9eac8-70ce-45dd-821d-813eea676c0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:39.530651 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e9eac8-70ce-45dd-821d-813eea676c0a admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:39.530934 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e9eac8-70ce-45dd-821d-813eea676c0a admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:39.531212 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e9eac8-70ce-45dd-821d-813eea676c0a admin admin] PATH_INFO: `/v3/projects` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:39.532012 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e9eac8-70ce-45dd-821d-813eea676c0a admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=85204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:37:39.532329 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e9eac8-70ce-45dd-821d-813eea676c0a admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:39.535252 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e9eac8-70ce-45dd-821d-813eea676c0a admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:39.548499 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 315/615] 10.222.0.58 () {56 vars in 1169 bytes} [Tue Oct 12 16:37:39 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:37:39.555194 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb8e3df-9865-4a14-b5bf-4c82539e9257 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:39.566327 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb8e3df-9865-4a14-b5bf-4c82539e9257 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:39.571113 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49084fee-7502-4fae-8118-5e5cf06461b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:39.571924 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49084fee-7502-4fae-8118-5e5cf06461b2 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:39.572354 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49084fee-7502-4fae-8118-5e5cf06461b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:39.572774 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49084fee-7502-4fae-8118-5e5cf06461b2 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:39.573777 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49084fee-7502-4fae-8118-5e5cf06461b2 admin admin] RBAC: Adding query filter params (role.id=dea461b7131b413590d73da4994002ca, scope.project.id=f3531f242eaa43b69562d70bca5ec5a8, user.id=9fdeb0a451344c9987b4134b957ffa22) {{(pid=85205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:37:39.574289 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49084fee-7502-4fae-8118-5e5cf06461b2 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:39.578814 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49084fee-7502-4fae-8118-5e5cf06461b2 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:39.586233 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 301/616] 10.222.0.58 () {56 vars in 1395 bytes} [Tue Oct 12 16:37:39 2021] GET /identity/v3/role_assignments?user.id=9fdeb0a451344c9987b4134b957ffa22&scope.project.id=f3531f242eaa43b69562d70bca5ec5a8&role.id=dea461b7131b413590d73da4994002ca => generated 608 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:37:41.252395 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1588584-0eac-4f46-a6bd-0420531f10a8 None None] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:41.252915 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1588584-0eac-4f46-a6bd-0420531f10a8 None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:41.252991 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1588584-0eac-4f46-a6bd-0420531f10a8 None None] PATH_INFO: `/` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:41.255303 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 316/617] 10.222.0.58 () {54 vars in 926 bytes} [Tue Oct 12 16:37:41 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:37:41.261298 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d795842-c58f-40bd-aecb-7aead7dae5b8 None None] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:41.261736 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d795842-c58f-40bd-aecb-7aead7dae5b8 None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:41.261979 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d795842-c58f-40bd-aecb-7aead7dae5b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:41.280496 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.auth.core [None req-9d795842-c58f-40bd-aecb-7aead7dae5b8 None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:37:41.281710 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-9d795842-c58f-40bd-aecb-7aead7dae5b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:37:41.290371 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 302/618] 10.222.0.58 () {58 vars in 1023 bytes} [Tue Oct 12 16:37:41 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:37:41.314443 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1588584-0eac-4f46-a6bd-0420531f10a8 None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:41.325395 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efab714-d62f-4092-9764-1c9f9385b5fb None None] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:41.325696 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efab714-d62f-4092-9764-1c9f9385b5fb None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:41.326256 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efab714-d62f-4092-9764-1c9f9385b5fb None None] PATH_INFO: `/` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:41.331246 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1588584-0eac-4f46-a6bd-0420531f10a8 None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:41.332202 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 303/619] 10.222.0.58 () {54 vars in 926 bytes} [Tue Oct 12 16:37:41 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:37:41.335683 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8316754c-28dd-4502-91c7-22fb003f8a81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:41.336889 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e526824-0ec3-4a1d-9427-b3ff04c0de67 None None] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:41.337177 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e526824-0ec3-4a1d-9427-b3ff04c0de67 None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:41.337461 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e526824-0ec3-4a1d-9427-b3ff04c0de67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:41.339461 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8316754c-28dd-4502-91c7-22fb003f8a81 admin admin] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:41.339743 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8316754c-28dd-4502-91c7-22fb003f8a81 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:41.340018 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8316754c-28dd-4502-91c7-22fb003f8a81 admin admin] PATH_INFO: `/v3/services` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:41.340766 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8316754c-28dd-4502-91c7-22fb003f8a81 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:41.341770 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: WARNING py.warnings [None req-8316754c-28dd-4502-91c7-22fb003f8a81 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:create_service failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 12 16:37:41.341770 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: warnings.warn(msg) Oct 12 16:37:41.341770 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: Oct 12 16:37:41.342665 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8316754c-28dd-4502-91c7-22fb003f8a81 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:41.362444 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.auth.core [None req-2e526824-0ec3-4a1d-9427-b3ff04c0de67 None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:37:41.363617 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-2e526824-0ec3-4a1d-9427-b3ff04c0de67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:37:41.371998 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 304/620] 10.222.0.58 () {58 vars in 1023 bytes} [Tue Oct 12 16:37:41 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:37:41.375798 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 317/621] 10.222.0.58 () {60 vars in 1162 bytes} [Tue Oct 12 16:37:41 2021] POST /identity/v3/services => generated 251 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:37:41.417052 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e526824-0ec3-4a1d-9427-b3ff04c0de67 None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:41.427239 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e526824-0ec3-4a1d-9427-b3ff04c0de67 None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:41.454863 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a878502-70c3-4724-bb64-6c86c99a5198 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:41.456501 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a878502-70c3-4724-bb64-6c86c99a5198 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:41.456895 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a878502-70c3-4724-bb64-6c86c99a5198 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:41.457280 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a878502-70c3-4724-bb64-6c86c99a5198 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:41.469770 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a878502-70c3-4724-bb64-6c86c99a5198 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 16:37:41.478221 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: WARNING keystone.server.flask.application [None req-1a878502-70c3-4724-bb64-6c86c99a5198 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 16:37:41.480017 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 305/622] 10.222.0.58 () {56 vars in 1117 bytes} [Tue Oct 12 16:37:41 2021] GET /identity/v3/roles/admin => generated 83 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:37:41.486748 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8316754c-28dd-4502-91c7-22fb003f8a81 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:41.510349 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8316754c-28dd-4502-91c7-22fb003f8a81 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:41.520243 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d58c31-3b9c-4b08-8540-504f2dee5dd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:41.520931 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d58c31-3b9c-4b08-8540-504f2dee5dd4 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:41.521213 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d58c31-3b9c-4b08-8540-504f2dee5dd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:41.521487 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d58c31-3b9c-4b08-8540-504f2dee5dd4 admin admin] PATH_INFO: `/v3/roles` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:41.522296 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d58c31-3b9c-4b08-8540-504f2dee5dd4 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=85204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:37:41.522603 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d58c31-3b9c-4b08-8540-504f2dee5dd4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:41.524193 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d58c31-3b9c-4b08-8540-504f2dee5dd4 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:41.544654 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 318/623] 10.222.0.58 () {56 vars in 1120 bytes} [Tue Oct 12 16:37:41 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:37:41.551430 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a878502-70c3-4724-bb64-6c86c99a5198 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:41.562107 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a878502-70c3-4724-bb64-6c86c99a5198 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:41.573779 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac25130-e45f-413c-b736-1d57175704b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:41.574673 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac25130-e45f-413c-b736-1d57175704b0 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:41.575028 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac25130-e45f-413c-b736-1d57175704b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:41.575311 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac25130-e45f-413c-b736-1d57175704b0 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:41.588127 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac25130-e45f-413c-b736-1d57175704b0 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:41.590077 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac25130-e45f-413c-b736-1d57175704b0 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:41.608585 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: WARNING keystone.server.flask.application [None req-1ac25130-e45f-413c-b736-1d57175704b0 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 16:37:41.610201 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 306/624] 10.222.0.58 () {56 vars in 1129 bytes} [Tue Oct 12 16:37:41 2021] GET /identity/v3/domains/Default => generated 87 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:37:41.619253 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d58c31-3b9c-4b08-8540-504f2dee5dd4 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:41.639001 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d58c31-3b9c-4b08-8540-504f2dee5dd4 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:41.651663 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b49e7e2-2a6b-4c31-bab8-81b012d4ed25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:41.652340 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b49e7e2-2a6b-4c31-bab8-81b012d4ed25 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:41.652622 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b49e7e2-2a6b-4c31-bab8-81b012d4ed25 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:41.652893 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b49e7e2-2a6b-4c31-bab8-81b012d4ed25 admin admin] PATH_INFO: `/v3/domains` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:41.653635 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b49e7e2-2a6b-4c31-bab8-81b012d4ed25 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:37:41.653954 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b49e7e2-2a6b-4c31-bab8-81b012d4ed25 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:41.655534 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b49e7e2-2a6b-4c31-bab8-81b012d4ed25 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:41.679436 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 319/625] 10.222.0.58 () {56 vars in 1130 bytes} [Tue Oct 12 16:37:41 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:37:41.686179 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac25130-e45f-413c-b736-1d57175704b0 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:41.697032 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac25130-e45f-413c-b736-1d57175704b0 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:41.707632 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7290845a-7bcc-445d-ab77-d7168275bb82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:41.708607 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7290845a-7bcc-445d-ab77-d7168275bb82 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:41.709031 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7290845a-7bcc-445d-ab77-d7168275bb82 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:41.709409 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7290845a-7bcc-445d-ab77-d7168275bb82 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:41.719127 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7290845a-7bcc-445d-ab77-d7168275bb82 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:41.723077 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7290845a-7bcc-445d-ab77-d7168275bb82 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:41.737704 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: WARNING keystone.server.flask.application [None req-7290845a-7bcc-445d-ab77-d7168275bb82 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 12 16:37:41.739364 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 307/626] 10.222.0.58 () {56 vars in 1114 bytes} [Tue Oct 12 16:37:41 2021] GET /identity/v3/users/nova => generated 82 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:37:41.745570 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b49e7e2-2a6b-4c31-bab8-81b012d4ed25 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:41.762451 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b49e7e2-2a6b-4c31-bab8-81b012d4ed25 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:41.775607 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed14460-19f4-4f7e-847a-5db2eb60e524 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:41.776375 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed14460-19f4-4f7e-847a-5db2eb60e524 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:41.776655 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed14460-19f4-4f7e-847a-5db2eb60e524 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:41.776929 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed14460-19f4-4f7e-847a-5db2eb60e524 admin admin] PATH_INFO: `/v3/users` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:41.777785 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed14460-19f4-4f7e-847a-5db2eb60e524 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=85204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:37:41.778203 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed14460-19f4-4f7e-847a-5db2eb60e524 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:41.779940 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed14460-19f4-4f7e-847a-5db2eb60e524 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:41.802022 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 320/627] 10.222.0.58 () {56 vars in 1154 bytes} [Tue Oct 12 16:37:41 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:37:41.808336 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7290845a-7bcc-445d-ab77-d7168275bb82 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:41.820778 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7290845a-7bcc-445d-ab77-d7168275bb82 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:41.826381 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41d7301-bda0-4191-8d93-5b50f099b760 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:41.827291 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41d7301-bda0-4191-8d93-5b50f099b760 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:41.827580 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41d7301-bda0-4191-8d93-5b50f099b760 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:41.827858 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41d7301-bda0-4191-8d93-5b50f099b760 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:41.840374 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41d7301-bda0-4191-8d93-5b50f099b760 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:41.843744 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41d7301-bda0-4191-8d93-5b50f099b760 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:41.844960 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76463ed-a2f0-4327-af08-3d035c6ba9bd None None] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:41.845248 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76463ed-a2f0-4327-af08-3d035c6ba9bd None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:41.845525 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76463ed-a2f0-4327-af08-3d035c6ba9bd None None] PATH_INFO: `/` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:41.847622 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 321/628] 10.222.0.58 () {54 vars in 926 bytes} [Tue Oct 12 16:37:41 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 12 16:37:41.853672 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7690a7-0501-4d07-a3b5-6397203e1968 None None] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:41.853984 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7690a7-0501-4d07-a3b5-6397203e1968 None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:41.854260 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7690a7-0501-4d07-a3b5-6397203e1968 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:41.862103 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: WARNING keystone.server.flask.application [None req-c41d7301-bda0-4191-8d93-5b50f099b760 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 16:37:41.863576 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 308/629] 10.222.0.58 () {56 vars in 1129 bytes} [Tue Oct 12 16:37:41 2021] GET /identity/v3/domains/Default => generated 87 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:37:41.869716 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41d7301-bda0-4191-8d93-5b50f099b760 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:41.880636 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41d7301-bda0-4191-8d93-5b50f099b760 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:41.888603 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.auth.core [None req-de7690a7-0501-4d07-a3b5-6397203e1968 None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:37:41.890039 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-de7690a7-0501-4d07-a3b5-6397203e1968 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:37:41.891055 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5b92f4-bdd2-47a7-8eae-1a360c53073d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:41.891721 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5b92f4-bdd2-47a7-8eae-1a360c53073d admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:41.892007 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5b92f4-bdd2-47a7-8eae-1a360c53073d admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:41.892287 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5b92f4-bdd2-47a7-8eae-1a360c53073d admin admin] PATH_INFO: `/v3/domains` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:41.893693 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5b92f4-bdd2-47a7-8eae-1a360c53073d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:37:41.894030 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5b92f4-bdd2-47a7-8eae-1a360c53073d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:41.895627 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5b92f4-bdd2-47a7-8eae-1a360c53073d admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:41.901405 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 322/630] 10.222.0.58 () {58 vars in 1023 bytes} [Tue Oct 12 16:37:41 2021] POST /identity/v3/auth/tokens => generated 1171 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:37:41.914800 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 309/631] 10.222.0.58 () {56 vars in 1130 bytes} [Tue Oct 12 16:37:41 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 16:37:41.920634 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7690a7-0501-4d07-a3b5-6397203e1968 None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:41.932908 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7690a7-0501-4d07-a3b5-6397203e1968 None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:41.941914 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7de466-c3d0-44ce-8c1d-660fcee00200 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:41.943046 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7de466-c3d0-44ce-8c1d-660fcee00200 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:41.943580 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7de466-c3d0-44ce-8c1d-660fcee00200 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:41.944048 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7de466-c3d0-44ce-8c1d-660fcee00200 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:41.947792 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5b92f4-bdd2-47a7-8eae-1a360c53073d admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:41.954124 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7de466-c3d0-44ce-8c1d-660fcee00200 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:41.956955 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7de466-c3d0-44ce-8c1d-660fcee00200 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:41.966523 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5b92f4-bdd2-47a7-8eae-1a360c53073d admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:41.972289 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: WARNING keystone.server.flask.application [None req-9e7de466-c3d0-44ce-8c1d-660fcee00200 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 16:37:41.974065 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 323/632] 10.222.0.58 () {56 vars in 1132 bytes} [Tue Oct 12 16:37:41 2021] GET /identity/v3/projects/service => generated 88 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:37:41.979700 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1c5dd7-9ea5-42f1-947b-aa2e995272a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:41.980125 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7de466-c3d0-44ce-8c1d-660fcee00200 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:41.980495 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1c5dd7-9ea5-42f1-947b-aa2e995272a4 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:41.980781 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1c5dd7-9ea5-42f1-947b-aa2e995272a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:41.981057 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1c5dd7-9ea5-42f1-947b-aa2e995272a4 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:41.997305 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7de466-c3d0-44ce-8c1d-660fcee00200 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:42.007093 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1c5dd7-9ea5-42f1-947b-aa2e995272a4 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 16:37:42.010767 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759a13a0-5c9c-4788-b77f-d77c558d76e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:42.011714 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759a13a0-5c9c-4788-b77f-d77c558d76e0 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:42.013684 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759a13a0-5c9c-4788-b77f-d77c558d76e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:42.014184 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759a13a0-5c9c-4788-b77f-d77c558d76e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:42.016762 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759a13a0-5c9c-4788-b77f-d77c558d76e0 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=85204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:37:42.017282 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759a13a0-5c9c-4788-b77f-d77c558d76e0 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:42.019990 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759a13a0-5c9c-4788-b77f-d77c558d76e0 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:42.021535 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: WARNING keystone.server.flask.application [None req-ae1c5dd7-9ea5-42f1-947b-aa2e995272a4 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 12 16:37:42.029900 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 310/633] 10.222.0.58 () {56 vars in 1123 bytes} [Tue Oct 12 16:37:41 2021] GET /identity/v3/roles/service => generated 85 bytes in 76 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:37:42.035447 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1c5dd7-9ea5-42f1-947b-aa2e995272a4 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:42.043375 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 324/634] 10.222.0.58 () {56 vars in 1169 bytes} [Tue Oct 12 16:37:41 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 16:37:42.048970 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759a13a0-5c9c-4788-b77f-d77c558d76e0 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:42.051028 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1c5dd7-9ea5-42f1-947b-aa2e995272a4 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:42.060737 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e6ef54-d999-4e48-b88b-94a0ac0413b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:42.061495 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e6ef54-d999-4e48-b88b-94a0ac0413b7 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:42.061808 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e6ef54-d999-4e48-b88b-94a0ac0413b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:42.062129 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e6ef54-d999-4e48-b88b-94a0ac0413b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:42.062909 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e6ef54-d999-4e48-b88b-94a0ac0413b7 admin admin] RBAC: Adding query filter params (name=service) {{(pid=85205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:37:42.063018 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759a13a0-5c9c-4788-b77f-d77c558d76e0 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:42.063272 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e6ef54-d999-4e48-b88b-94a0ac0413b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:42.065499 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e6ef54-d999-4e48-b88b-94a0ac0413b7 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:42.075503 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 311/635] 10.222.0.58 () {56 vars in 1124 bytes} [Tue Oct 12 16:37:42 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:37:42.076363 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923e421b-e25e-4545-8a44-37602a8aa413 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:42.077273 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923e421b-e25e-4545-8a44-37602a8aa413 admin admin] REQUEST_METHOD: `PUT` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:42.077563 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923e421b-e25e-4545-8a44-37602a8aa413 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:42.077845 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923e421b-e25e-4545-8a44-37602a8aa413 admin admin] PATH_INFO: `/v3/projects/f3531f242eaa43b69562d70bca5ec5a8/users/29d30b574eec4ad3990d77d235c8b424/roles/610824e4f50f4fb8954610e98c1de784` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:42.082457 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e6ef54-d999-4e48-b88b-94a0ac0413b7 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:42.083250 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923e421b-e25e-4545-8a44-37602a8aa413 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3531f242eaa43b69562d70bca5ec5a8, user_id=29d30b574eec4ad3990d77d235c8b424, role_id=610824e4f50f4fb8954610e98c1de784)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:42.085810 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923e421b-e25e-4545-8a44-37602a8aa413 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:42.107878 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e6ef54-d999-4e48-b88b-94a0ac0413b7 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:42.118668 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 325/636] 10.222.0.58 () {58 vars in 1460 bytes} [Tue Oct 12 16:37:42 2021] PUT /identity/v3/projects/f3531f242eaa43b69562d70bca5ec5a8/users/29d30b574eec4ad3990d77d235c8b424/roles/610824e4f50f4fb8954610e98c1de784 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 16:37:42.203574 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b01ed7d-b707-45d1-8df5-b5de652454f9 None None] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:42.203886 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b01ed7d-b707-45d1-8df5-b5de652454f9 None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:42.204124 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b01ed7d-b707-45d1-8df5-b5de652454f9 None None] PATH_INFO: `/` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:42.206399 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ddd081-af0c-4e04-b4d7-a7b7eb82a4e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:42.207187 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ddd081-af0c-4e04-b4d7-a7b7eb82a4e5 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:42.207467 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ddd081-af0c-4e04-b4d7-a7b7eb82a4e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:42.207738 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ddd081-af0c-4e04-b4d7-a7b7eb82a4e5 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:42.209511 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 326/637] 10.222.0.58 () {54 vars in 926 bytes} [Tue Oct 12 16:37:42 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:37:42.219616 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf71dc7-40de-40a9-968e-0932a65198a7 None None] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:42.219925 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf71dc7-40de-40a9-968e-0932a65198a7 None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:42.220160 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf71dc7-40de-40a9-968e-0932a65198a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:42.224218 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ddd081-af0c-4e04-b4d7-a7b7eb82a4e5 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:42.226099 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ddd081-af0c-4e04-b4d7-a7b7eb82a4e5 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:42.243769 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: WARNING keystone.server.flask.application [None req-77ddd081-af0c-4e04-b4d7-a7b7eb82a4e5 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 16:37:42.245365 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 312/638] 10.222.0.58 () {56 vars in 1129 bytes} [Tue Oct 12 16:37:42 2021] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 16:37:42.254399 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.auth.core [None req-4cf71dc7-40de-40a9-968e-0932a65198a7 None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:37:42.254937 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ddd081-af0c-4e04-b4d7-a7b7eb82a4e5 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:42.256582 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-4cf71dc7-40de-40a9-968e-0932a65198a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:37:42.265048 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ddd081-af0c-4e04-b4d7-a7b7eb82a4e5 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:42.266274 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 327/639] 10.222.0.58 () {58 vars in 1023 bytes} [Tue Oct 12 16:37:42 2021] POST /identity/v3/auth/tokens => generated 1171 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:37:42.282146 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efc83fd-e715-4ef0-a8ee-18d3f3e77df2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:42.282837 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efc83fd-e715-4ef0-a8ee-18d3f3e77df2 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:42.283127 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efc83fd-e715-4ef0-a8ee-18d3f3e77df2 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:42.284003 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efc83fd-e715-4ef0-a8ee-18d3f3e77df2 admin admin] PATH_INFO: `/v3/domains` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:42.284862 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efc83fd-e715-4ef0-a8ee-18d3f3e77df2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:37:42.285176 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efc83fd-e715-4ef0-a8ee-18d3f3e77df2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:42.286841 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efc83fd-e715-4ef0-a8ee-18d3f3e77df2 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:42.304248 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 313/640] 10.222.0.58 () {56 vars in 1130 bytes} [Tue Oct 12 16:37:42 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:37:42.310154 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf71dc7-40de-40a9-968e-0932a65198a7 None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:42.313644 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efc83fd-e715-4ef0-a8ee-18d3f3e77df2 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:42.323715 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efc83fd-e715-4ef0-a8ee-18d3f3e77df2 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:42.328366 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf71dc7-40de-40a9-968e-0932a65198a7 None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:42.333339 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e495d1fd-6dcc-4e89-b0f6-267a454e3675 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:42.334047 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e495d1fd-6dcc-4e89-b0f6-267a454e3675 admin admin] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:42.334330 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e495d1fd-6dcc-4e89-b0f6-267a454e3675 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:42.334602 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e495d1fd-6dcc-4e89-b0f6-267a454e3675 admin admin] PATH_INFO: `/v3/services` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:42.335353 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e495d1fd-6dcc-4e89-b0f6-267a454e3675 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:42.336374 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: WARNING py.warnings [None req-e495d1fd-6dcc-4e89-b0f6-267a454e3675 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:create_service failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 12 16:37:42.336374 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: warnings.warn(msg) Oct 12 16:37:42.336374 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: Oct 12 16:37:42.337246 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e495d1fd-6dcc-4e89-b0f6-267a454e3675 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:42.342397 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16da5ba-b679-46db-bfdd-eb48592dacfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:42.343229 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16da5ba-b679-46db-bfdd-eb48592dacfb admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:42.343509 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16da5ba-b679-46db-bfdd-eb48592dacfb admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:42.343784 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16da5ba-b679-46db-bfdd-eb48592dacfb admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:42.357484 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16da5ba-b679-46db-bfdd-eb48592dacfb admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:42.360372 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16da5ba-b679-46db-bfdd-eb48592dacfb admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:42.367302 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 314/641] 10.222.0.58 () {60 vars in 1162 bytes} [Tue Oct 12 16:37:42 2021] POST /identity/v3/services => generated 240 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 16:37:42.388482 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: WARNING keystone.server.flask.application [None req-b16da5ba-b679-46db-bfdd-eb48592dacfb admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 12 16:37:42.390111 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 328/642] 10.222.0.58 () {56 vars in 1138 bytes} [Tue Oct 12 16:37:42 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 80 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:37:42.396932 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e495d1fd-6dcc-4e89-b0f6-267a454e3675 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:42.419356 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e495d1fd-6dcc-4e89-b0f6-267a454e3675 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:42.424372 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d43dc3-9249-4128-9c3d-1279dc8b9dea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:42.425069 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d43dc3-9249-4128-9c3d-1279dc8b9dea admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:42.425349 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d43dc3-9249-4128-9c3d-1279dc8b9dea admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:42.425626 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d43dc3-9249-4128-9c3d-1279dc8b9dea admin admin] PATH_INFO: `/v3/users` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:42.426540 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d43dc3-9249-4128-9c3d-1279dc8b9dea admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=85205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:37:42.426852 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d43dc3-9249-4128-9c3d-1279dc8b9dea admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:42.428737 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d43dc3-9249-4128-9c3d-1279dc8b9dea admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:42.453586 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 315/643] 10.222.0.58 () {56 vars in 1170 bytes} [Tue Oct 12 16:37:42 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 16:37:42.458929 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16da5ba-b679-46db-bfdd-eb48592dacfb admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:42.470127 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16da5ba-b679-46db-bfdd-eb48592dacfb admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:42.480299 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4237e846-7730-4028-a4d3-ab20e0ea74ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:42.481157 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4237e846-7730-4028-a4d3-ab20e0ea74ab admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:42.481440 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4237e846-7730-4028-a4d3-ab20e0ea74ab admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:42.481763 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4237e846-7730-4028-a4d3-ab20e0ea74ab admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:42.493220 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4237e846-7730-4028-a4d3-ab20e0ea74ab admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:42.495081 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4237e846-7730-4028-a4d3-ab20e0ea74ab admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:42.506023 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 329/644] 10.222.0.58 () {58 vars in 1324 bytes} [Tue Oct 12 16:37:42 2021] GET /identity/v3/auth/tokens => generated 1270 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:37:42.512401 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d43dc3-9249-4128-9c3d-1279dc8b9dea admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:42.530936 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d43dc3-9249-4128-9c3d-1279dc8b9dea admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:42.536327 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2a9a1a-d9c6-44d3-bd5a-da0316062aff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:42.537240 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2a9a1a-d9c6-44d3-bd5a-da0316062aff admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:42.537586 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2a9a1a-d9c6-44d3-bd5a-da0316062aff admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:42.537964 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2a9a1a-d9c6-44d3-bd5a-da0316062aff admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:42.553665 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2a9a1a-d9c6-44d3-bd5a-da0316062aff admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:42.555644 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2a9a1a-d9c6-44d3-bd5a-da0316062aff admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:42.585537 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: WARNING keystone.server.flask.application [None req-9a2a9a1a-d9c6-44d3-bd5a-da0316062aff admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 16:37:42.586821 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 316/645] 10.222.0.58 () {56 vars in 1129 bytes} [Tue Oct 12 16:37:42 2021] GET /identity/v3/domains/Default => generated 87 bytes in 75 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:37:42.594056 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4237e846-7730-4028-a4d3-ab20e0ea74ab admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:42.607533 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4237e846-7730-4028-a4d3-ab20e0ea74ab admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:42.614541 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f1938e-172a-490c-ba0a-b31b5c171ed7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:42.615209 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f1938e-172a-490c-ba0a-b31b5c171ed7 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:42.615492 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f1938e-172a-490c-ba0a-b31b5c171ed7 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:42.615769 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f1938e-172a-490c-ba0a-b31b5c171ed7 admin admin] PATH_INFO: `/v3/domains` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:42.616515 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f1938e-172a-490c-ba0a-b31b5c171ed7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:37:42.616823 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f1938e-172a-490c-ba0a-b31b5c171ed7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:42.618896 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f1938e-172a-490c-ba0a-b31b5c171ed7 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:42.635027 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 330/646] 10.222.0.58 () {56 vars in 1130 bytes} [Tue Oct 12 16:37:42 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:37:42.641561 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2a9a1a-d9c6-44d3-bd5a-da0316062aff admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:42.652313 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2a9a1a-d9c6-44d3-bd5a-da0316062aff admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:42.657290 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6e3d15-8695-405c-ad7b-b71e551735ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:42.658108 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6e3d15-8695-405c-ad7b-b71e551735ca admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:42.658500 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6e3d15-8695-405c-ad7b-b71e551735ca admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:42.658773 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6e3d15-8695-405c-ad7b-b71e551735ca admin admin] PATH_INFO: `/v3/projects/service` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:42.667034 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6e3d15-8695-405c-ad7b-b71e551735ca admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:42.669021 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6e3d15-8695-405c-ad7b-b71e551735ca admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:42.682766 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: WARNING keystone.server.flask.application [None req-4e6e3d15-8695-405c-ad7b-b71e551735ca admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 16:37:42.689294 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 317/647] 10.222.0.58 () {56 vars in 1132 bytes} [Tue Oct 12 16:37:42 2021] GET /identity/v3/projects/service => generated 88 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:37:42.691183 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f1938e-172a-490c-ba0a-b31b5c171ed7 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:42.707730 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f1938e-172a-490c-ba0a-b31b5c171ed7 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:42.716710 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7a9354-830f-4de1-b5af-bc9b3c4396ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:42.717652 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7a9354-830f-4de1-b5af-bc9b3c4396ba admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:42.718148 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7a9354-830f-4de1-b5af-bc9b3c4396ba admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:42.718596 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7a9354-830f-4de1-b5af-bc9b3c4396ba admin admin] PATH_INFO: `/v3/projects` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:42.719577 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7a9354-830f-4de1-b5af-bc9b3c4396ba admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=85204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:37:42.720078 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7a9354-830f-4de1-b5af-bc9b3c4396ba admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:42.722179 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7a9354-830f-4de1-b5af-bc9b3c4396ba admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:42.744135 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 331/648] 10.222.0.58 () {56 vars in 1169 bytes} [Tue Oct 12 16:37:42 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:37:42.746459 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6e3d15-8695-405c-ad7b-b71e551735ca admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:42.759764 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6e3d15-8695-405c-ad7b-b71e551735ca admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:42.768572 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bd0fb5-6772-426b-9bb2-f1691899b321 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:42.769613 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bd0fb5-6772-426b-9bb2-f1691899b321 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:42.770118 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bd0fb5-6772-426b-9bb2-f1691899b321 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:42.770568 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bd0fb5-6772-426b-9bb2-f1691899b321 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:42.771620 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bd0fb5-6772-426b-9bb2-f1691899b321 admin admin] RBAC: Adding query filter params (role.id=dea461b7131b413590d73da4994002ca, scope.project.id=f3531f242eaa43b69562d70bca5ec5a8, user.id=387a65d2bfb142499c9b3b0ac946f48b) {{(pid=85205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:37:42.772125 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bd0fb5-6772-426b-9bb2-f1691899b321 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:42.774286 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bd0fb5-6772-426b-9bb2-f1691899b321 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:42.785503 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 318/649] 10.222.0.58 () {56 vars in 1395 bytes} [Tue Oct 12 16:37:42 2021] GET /identity/v3/role_assignments?user.id=387a65d2bfb142499c9b3b0ac946f48b&scope.project.id=f3531f242eaa43b69562d70bca5ec5a8&role.id=dea461b7131b413590d73da4994002ca => generated 259 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:37:43.176934 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ea7033-4c74-4e3a-aea2-34836e1a2dc8 None None] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:43.177199 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ea7033-4c74-4e3a-aea2-34836e1a2dc8 None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:43.177674 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ea7033-4c74-4e3a-aea2-34836e1a2dc8 None None] PATH_INFO: `/` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:43.179806 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 332/650] 10.222.0.58 () {54 vars in 926 bytes} [Tue Oct 12 16:37:43 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:37:43.186148 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee2d720-abde-40ae-a7d6-e1c5bfb121cc None None] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:43.186508 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee2d720-abde-40ae-a7d6-e1c5bfb121cc None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:43.186854 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee2d720-abde-40ae-a7d6-e1c5bfb121cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:43.209513 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.auth.core [None req-aee2d720-abde-40ae-a7d6-e1c5bfb121cc None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:37:43.210849 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-aee2d720-abde-40ae-a7d6-e1c5bfb121cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:37:43.221330 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 319/651] 10.222.0.58 () {58 vars in 1023 bytes} [Tue Oct 12 16:37:43 2021] POST /identity/v3/auth/tokens => generated 1270 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:37:43.249205 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ea7033-4c74-4e3a-aea2-34836e1a2dc8 None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:43.265052 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ea7033-4c74-4e3a-aea2-34836e1a2dc8 None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:43.270176 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb0d8e4-0bb2-4e72-a91c-b42db494e51f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:43.270962 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb0d8e4-0bb2-4e72-a91c-b42db494e51f admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:43.271319 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb0d8e4-0bb2-4e72-a91c-b42db494e51f admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:43.271622 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb0d8e4-0bb2-4e72-a91c-b42db494e51f admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:43.286637 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb0d8e4-0bb2-4e72-a91c-b42db494e51f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 16:37:43.293603 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: WARNING keystone.server.flask.application [None req-2cb0d8e4-0bb2-4e72-a91c-b42db494e51f admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 16:37:43.295152 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 333/652] 10.222.0.58 () {56 vars in 1117 bytes} [Tue Oct 12 16:37:43 2021] GET /identity/v3/roles/admin => generated 83 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:37:43.303465 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee2d720-abde-40ae-a7d6-e1c5bfb121cc None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:43.312423 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee2d720-abde-40ae-a7d6-e1c5bfb121cc None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:43.317701 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815f71ea-91d0-4a7a-b825-481f0e12fe09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:43.318388 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815f71ea-91d0-4a7a-b825-481f0e12fe09 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:43.318667 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815f71ea-91d0-4a7a-b825-481f0e12fe09 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:43.318940 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815f71ea-91d0-4a7a-b825-481f0e12fe09 admin admin] PATH_INFO: `/v3/roles` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:43.319697 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815f71ea-91d0-4a7a-b825-481f0e12fe09 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=85205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:37:43.320031 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815f71ea-91d0-4a7a-b825-481f0e12fe09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:43.321701 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815f71ea-91d0-4a7a-b825-481f0e12fe09 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:43.332016 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 320/653] 10.222.0.58 () {56 vars in 1120 bytes} [Tue Oct 12 16:37:43 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:37:43.338433 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb0d8e4-0bb2-4e72-a91c-b42db494e51f admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:43.350693 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb0d8e4-0bb2-4e72-a91c-b42db494e51f admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:43.355509 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbe0c59-53be-408c-8942-3ec6191bbd1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:43.356404 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbe0c59-53be-408c-8942-3ec6191bbd1e admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:43.356682 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbe0c59-53be-408c-8942-3ec6191bbd1e admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:43.356957 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbe0c59-53be-408c-8942-3ec6191bbd1e admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:43.374009 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbe0c59-53be-408c-8942-3ec6191bbd1e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:43.375983 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbe0c59-53be-408c-8942-3ec6191bbd1e admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:43.399970 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: WARNING keystone.server.flask.application [None req-4bbe0c59-53be-408c-8942-3ec6191bbd1e admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 16:37:43.401591 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 334/654] 10.222.0.58 () {56 vars in 1129 bytes} [Tue Oct 12 16:37:43 2021] GET /identity/v3/domains/Default => generated 87 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:37:43.408005 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815f71ea-91d0-4a7a-b825-481f0e12fe09 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:43.420017 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815f71ea-91d0-4a7a-b825-481f0e12fe09 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:43.425761 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003b6549-17c2-4d44-a136-9309918fc3c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:43.426448 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003b6549-17c2-4d44-a136-9309918fc3c3 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:43.426781 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003b6549-17c2-4d44-a136-9309918fc3c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:43.427111 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003b6549-17c2-4d44-a136-9309918fc3c3 admin admin] PATH_INFO: `/v3/domains` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:43.427844 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003b6549-17c2-4d44-a136-9309918fc3c3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:37:43.428152 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003b6549-17c2-4d44-a136-9309918fc3c3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:43.429725 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003b6549-17c2-4d44-a136-9309918fc3c3 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:43.444905 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 321/655] 10.222.0.58 () {56 vars in 1130 bytes} [Tue Oct 12 16:37:43 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:37:43.451114 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbe0c59-53be-408c-8942-3ec6191bbd1e admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:43.465480 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbe0c59-53be-408c-8942-3ec6191bbd1e admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:43.470079 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d8bb7c-e459-42f2-980e-edb0e10c56bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:43.471436 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d8bb7c-e459-42f2-980e-edb0e10c56bb admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:43.471725 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d8bb7c-e459-42f2-980e-edb0e10c56bb admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:43.471983 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d8bb7c-e459-42f2-980e-edb0e10c56bb admin admin] PATH_INFO: `/v3/users/swift` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:43.481509 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d8bb7c-e459-42f2-980e-edb0e10c56bb admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:43.483534 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d8bb7c-e459-42f2-980e-edb0e10c56bb admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:43.504327 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: WARNING keystone.server.flask.application [None req-93d8bb7c-e459-42f2-980e-edb0e10c56bb admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 12 16:37:43.505815 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 335/656] 10.222.0.58 () {56 vars in 1117 bytes} [Tue Oct 12 16:37:43 2021] GET /identity/v3/users/swift => generated 83 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:37:43.512143 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003b6549-17c2-4d44-a136-9309918fc3c3 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:43.523241 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003b6549-17c2-4d44-a136-9309918fc3c3 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:43.540056 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfff0bd-8655-4ec7-b748-0e47e23e6697 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:43.540741 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfff0bd-8655-4ec7-b748-0e47e23e6697 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:43.541022 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfff0bd-8655-4ec7-b748-0e47e23e6697 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:43.541264 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfff0bd-8655-4ec7-b748-0e47e23e6697 admin admin] PATH_INFO: `/v3/users` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:43.542312 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfff0bd-8655-4ec7-b748-0e47e23e6697 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=85205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:37:43.542622 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfff0bd-8655-4ec7-b748-0e47e23e6697 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:43.544529 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfff0bd-8655-4ec7-b748-0e47e23e6697 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:43.576634 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 322/657] 10.222.0.58 () {56 vars in 1156 bytes} [Tue Oct 12 16:37:43 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:37:43.583382 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d8bb7c-e459-42f2-980e-edb0e10c56bb admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:43.604428 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d8bb7c-e459-42f2-980e-edb0e10c56bb admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:43.613214 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606054fa-9a9c-4757-b2f9-96d7c2d4bc04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:43.613857 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606054fa-9a9c-4757-b2f9-96d7c2d4bc04 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:43.614167 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606054fa-9a9c-4757-b2f9-96d7c2d4bc04 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:43.614437 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606054fa-9a9c-4757-b2f9-96d7c2d4bc04 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:43.630873 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606054fa-9a9c-4757-b2f9-96d7c2d4bc04 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:43.632628 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606054fa-9a9c-4757-b2f9-96d7c2d4bc04 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:43.646791 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 336/658] 10.222.0.58 () {58 vars in 1324 bytes} [Tue Oct 12 16:37:43 2021] GET /identity/v3/auth/tokens => generated 1270 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:37:43.653027 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfff0bd-8655-4ec7-b748-0e47e23e6697 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:43.671167 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfff0bd-8655-4ec7-b748-0e47e23e6697 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:43.680994 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701439bc-6826-48fa-a028-d3158cc09e69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:43.681728 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701439bc-6826-48fa-a028-d3158cc09e69 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:43.682039 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701439bc-6826-48fa-a028-d3158cc09e69 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:43.682312 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701439bc-6826-48fa-a028-d3158cc09e69 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:43.699395 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701439bc-6826-48fa-a028-d3158cc09e69 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:43.701227 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701439bc-6826-48fa-a028-d3158cc09e69 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:43.729755 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: WARNING keystone.server.flask.application [None req-701439bc-6826-48fa-a028-d3158cc09e69 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 16:37:43.733344 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 323/659] 10.222.0.58 () {56 vars in 1129 bytes} [Tue Oct 12 16:37:43 2021] GET /identity/v3/domains/Default => generated 87 bytes in 81 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:37:43.740190 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606054fa-9a9c-4757-b2f9-96d7c2d4bc04 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:43.753929 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606054fa-9a9c-4757-b2f9-96d7c2d4bc04 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:43.762465 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431671cb-4f9a-4487-bd8b-3d44df1680ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:43.763179 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431671cb-4f9a-4487-bd8b-3d44df1680ac admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:43.763460 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431671cb-4f9a-4487-bd8b-3d44df1680ac admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:43.763734 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431671cb-4f9a-4487-bd8b-3d44df1680ac admin admin] PATH_INFO: `/v3/domains` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:43.764518 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431671cb-4f9a-4487-bd8b-3d44df1680ac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:37:43.764827 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431671cb-4f9a-4487-bd8b-3d44df1680ac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:43.766422 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431671cb-4f9a-4487-bd8b-3d44df1680ac admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:43.790819 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 337/660] 10.222.0.58 () {56 vars in 1130 bytes} [Tue Oct 12 16:37:43 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:37:43.796938 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701439bc-6826-48fa-a028-d3158cc09e69 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:43.811709 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701439bc-6826-48fa-a028-d3158cc09e69 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:43.821200 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c658b600-517c-4918-8768-4130b7965c90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:43.822043 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c658b600-517c-4918-8768-4130b7965c90 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:43.822324 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c658b600-517c-4918-8768-4130b7965c90 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:43.822597 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c658b600-517c-4918-8768-4130b7965c90 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:43.833556 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c658b600-517c-4918-8768-4130b7965c90 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:43.835551 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c658b600-517c-4918-8768-4130b7965c90 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:43.855555 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: WARNING keystone.server.flask.application [None req-c658b600-517c-4918-8768-4130b7965c90 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 16:37:43.857043 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 324/661] 10.222.0.58 () {56 vars in 1132 bytes} [Tue Oct 12 16:37:43 2021] GET /identity/v3/projects/service => generated 88 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:37:43.863583 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431671cb-4f9a-4487-bd8b-3d44df1680ac admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:43.879734 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431671cb-4f9a-4487-bd8b-3d44df1680ac admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:43.887383 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b32bc36-5c40-406c-920d-aa5d44904a13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:43.888105 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b32bc36-5c40-406c-920d-aa5d44904a13 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:43.888390 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b32bc36-5c40-406c-920d-aa5d44904a13 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:43.888662 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b32bc36-5c40-406c-920d-aa5d44904a13 admin admin] PATH_INFO: `/v3/projects` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:43.889515 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b32bc36-5c40-406c-920d-aa5d44904a13 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=85204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:37:43.889824 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b32bc36-5c40-406c-920d-aa5d44904a13 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:43.891734 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b32bc36-5c40-406c-920d-aa5d44904a13 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:43.907168 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 338/662] 10.222.0.58 () {56 vars in 1169 bytes} [Tue Oct 12 16:37:43 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:37:43.913447 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c658b600-517c-4918-8768-4130b7965c90 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:43.924562 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c658b600-517c-4918-8768-4130b7965c90 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:43.933077 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feff5a86-ea46-449a-a402-38f39ae646c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:43.933659 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feff5a86-ea46-449a-a402-38f39ae646c2 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:43.933968 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feff5a86-ea46-449a-a402-38f39ae646c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:43.934244 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feff5a86-ea46-449a-a402-38f39ae646c2 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:43.935148 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feff5a86-ea46-449a-a402-38f39ae646c2 admin admin] RBAC: Adding query filter params (role.id=610824e4f50f4fb8954610e98c1de784, scope.project.id=f3531f242eaa43b69562d70bca5ec5a8, user.id=9fdeb0a451344c9987b4134b957ffa22) {{(pid=85205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:37:43.935401 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feff5a86-ea46-449a-a402-38f39ae646c2 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:43.937224 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feff5a86-ea46-449a-a402-38f39ae646c2 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:43.944198 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 325/663] 10.222.0.58 () {56 vars in 1395 bytes} [Tue Oct 12 16:37:43 2021] GET /identity/v3/role_assignments?user.id=9fdeb0a451344c9987b4134b957ffa22&scope.project.id=f3531f242eaa43b69562d70bca5ec5a8&role.id=610824e4f50f4fb8954610e98c1de784 => generated 259 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:37:44.379825 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee11513-6ba0-4d9f-bd10-221b9099bd68 None None] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:44.379825 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee11513-6ba0-4d9f-bd10-221b9099bd68 None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:44.379825 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee11513-6ba0-4d9f-bd10-221b9099bd68 None None] PATH_INFO: `/` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:44.379825 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 339/664] 10.222.0.58 () {54 vars in 926 bytes} [Tue Oct 12 16:37:44 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:37:44.388437 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7197e4-3fd0-43ab-8d3d-7313782f05dd None None] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:44.388917 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7197e4-3fd0-43ab-8d3d-7313782f05dd None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:44.389100 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7197e4-3fd0-43ab-8d3d-7313782f05dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:44.414161 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.auth.core [None req-ae7197e4-3fd0-43ab-8d3d-7313782f05dd None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:37:44.415343 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-ae7197e4-3fd0-43ab-8d3d-7313782f05dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:37:44.429904 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 326/665] 10.222.0.58 () {58 vars in 1023 bytes} [Tue Oct 12 16:37:44 2021] POST /identity/v3/auth/tokens => generated 1270 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:37:44.463802 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee11513-6ba0-4d9f-bd10-221b9099bd68 None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:44.480716 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee11513-6ba0-4d9f-bd10-221b9099bd68 None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:44.485122 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f740be-9af8-4e0f-847b-49ffac605d2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:44.485928 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f740be-9af8-4e0f-847b-49ffac605d2d admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:44.486235 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f740be-9af8-4e0f-847b-49ffac605d2d admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:44.486507 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f740be-9af8-4e0f-847b-49ffac605d2d admin admin] PATH_INFO: `/v3/services/block-storage` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:44.487168 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f740be-9af8-4e0f-847b-49ffac605d2d admin admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:44.488799 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f740be-9af8-4e0f-847b-49ffac605d2d admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:44.506355 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: WARNING keystone.server.flask.application [None req-45f740be-9af8-4e0f-847b-49ffac605d2d admin admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 12 16:37:44.507749 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 340/666] 10.222.0.58 () {56 vars in 1150 bytes} [Tue Oct 12 16:37:44 2021] GET /identity/v3/services/block-storage => generated 94 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:37:44.515264 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7197e4-3fd0-43ab-8d3d-7313782f05dd None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:44.530881 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7197e4-3fd0-43ab-8d3d-7313782f05dd None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:44.536095 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f193e80d-1077-48c6-9aa8-470ec2a1fd65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:44.536750 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f193e80d-1077-48c6-9aa8-470ec2a1fd65 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:44.537033 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f193e80d-1077-48c6-9aa8-470ec2a1fd65 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:44.537300 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f193e80d-1077-48c6-9aa8-470ec2a1fd65 admin admin] PATH_INFO: `/v3/services` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:44.538052 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f193e80d-1077-48c6-9aa8-470ec2a1fd65 admin admin] RBAC: Adding query filter params (name=block-storage) {{(pid=85205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:37:44.538360 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f193e80d-1077-48c6-9aa8-470ec2a1fd65 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:44.539926 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f193e80d-1077-48c6-9aa8-470ec2a1fd65 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:44.550079 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 327/667] 10.222.0.58 () {56 vars in 1145 bytes} [Tue Oct 12 16:37:44 2021] GET /identity/v3/services?name=block-storage => generated 130 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:37:44.556409 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f740be-9af8-4e0f-847b-49ffac605d2d admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:44.571930 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f740be-9af8-4e0f-847b-49ffac605d2d admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:44.576570 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3b0258-6bc2-464d-9152-859411961c01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:44.577217 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3b0258-6bc2-464d-9152-859411961c01 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:44.577495 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3b0258-6bc2-464d-9152-859411961c01 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:44.577821 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3b0258-6bc2-464d-9152-859411961c01 admin admin] PATH_INFO: `/v3/services` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:44.578577 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3b0258-6bc2-464d-9152-859411961c01 admin admin] RBAC: Adding query filter params (type=block-storage) {{(pid=85204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:37:44.578882 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3b0258-6bc2-464d-9152-859411961c01 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:44.580984 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3b0258-6bc2-464d-9152-859411961c01 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:44.590364 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 341/668] 10.222.0.58 () {56 vars in 1145 bytes} [Tue Oct 12 16:37:44 2021] GET /identity/v3/services?type=block-storage => generated 367 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:37:44.597192 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f193e80d-1077-48c6-9aa8-470ec2a1fd65 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:44.610693 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f193e80d-1077-48c6-9aa8-470ec2a1fd65 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:44.617964 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34fb973-166a-42ab-b18b-f14f337829fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:44.618612 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34fb973-166a-42ab-b18b-f14f337829fc admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:44.618896 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34fb973-166a-42ab-b18b-f14f337829fc admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:44.619166 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34fb973-166a-42ab-b18b-f14f337829fc admin admin] PATH_INFO: `/v3/endpoints` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:44.619968 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34fb973-166a-42ab-b18b-f14f337829fc admin admin] RBAC: Adding query filter params (interface=public, service_id=4f74cf1af09a46e1a8329f02d7f4e317, region_id=RegionOne) {{(pid=85205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:37:44.620276 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34fb973-166a-42ab-b18b-f14f337829fc admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:44.621269 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: WARNING py.warnings [None req-c34fb973-166a-42ab-b18b-f14f337829fc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:list_endpoints failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 12 16:37:44.621269 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: warnings.warn(msg) Oct 12 16:37:44.621269 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: Oct 12 16:37:44.622158 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34fb973-166a-42ab-b18b-f14f337829fc admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:44.636433 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 328/669] 10.222.0.58 () {56 vars in 1272 bytes} [Tue Oct 12 16:37:44 2021] GET /identity/v3/endpoints?service_id=4f74cf1af09a46e1a8329f02d7f4e317&interface=public®ion_id=RegionOne => generated 194 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:37:44.643318 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3b0258-6bc2-464d-9152-859411961c01 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:44.660199 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3b0258-6bc2-464d-9152-859411961c01 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:44.670199 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52a91c9-f53f-4866-9932-ca735e8ca691 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:44.670923 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52a91c9-f53f-4866-9932-ca735e8ca691 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:44.671210 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52a91c9-f53f-4866-9932-ca735e8ca691 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:44.671545 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52a91c9-f53f-4866-9932-ca735e8ca691 admin admin] PATH_INFO: `/v3/services` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:44.672246 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52a91c9-f53f-4866-9932-ca735e8ca691 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:44.674013 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52a91c9-f53f-4866-9932-ca735e8ca691 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:44.682718 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 342/670] 10.222.0.58 () {56 vars in 1108 bytes} [Tue Oct 12 16:37:44 2021] GET /identity/v3/services => generated 772 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:37:45.222526 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179df5c9-6dcd-4bf9-9c59-89cb9a84c873 None None] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:45.223032 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179df5c9-6dcd-4bf9-9c59-89cb9a84c873 None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:45.223421 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179df5c9-6dcd-4bf9-9c59-89cb9a84c873 None None] PATH_INFO: `/` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:45.225546 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 329/671] 10.222.0.58 () {54 vars in 926 bytes} [Tue Oct 12 16:37:45 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:37:45.231574 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520a0073-a212-4fd2-95f7-232ae38e106a None None] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:45.231863 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520a0073-a212-4fd2-95f7-232ae38e106a None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:45.232140 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520a0073-a212-4fd2-95f7-232ae38e106a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:45.250611 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.auth.core [None req-520a0073-a212-4fd2-95f7-232ae38e106a None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:37:45.252437 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-520a0073-a212-4fd2-95f7-232ae38e106a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:37:45.260713 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 343/672] 10.222.0.58 () {58 vars in 1023 bytes} [Tue Oct 12 16:37:45 2021] POST /identity/v3/auth/tokens => generated 1270 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:37:45.285040 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179df5c9-6dcd-4bf9-9c59-89cb9a84c873 None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:45.298043 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179df5c9-6dcd-4bf9-9c59-89cb9a84c873 None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:45.310148 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2440a139-e607-4cec-b4c9-636262794e6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:45.310951 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2440a139-e607-4cec-b4c9-636262794e6e admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:45.311235 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2440a139-e607-4cec-b4c9-636262794e6e admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:45.311512 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2440a139-e607-4cec-b4c9-636262794e6e admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:45.325567 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2440a139-e607-4cec-b4c9-636262794e6e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 16:37:45.332571 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: WARNING keystone.server.flask.application [None req-2440a139-e607-4cec-b4c9-636262794e6e admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 16:37:45.333774 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 330/673] 10.222.0.58 () {56 vars in 1117 bytes} [Tue Oct 12 16:37:45 2021] GET /identity/v3/roles/admin => generated 83 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:37:45.340249 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520a0073-a212-4fd2-95f7-232ae38e106a None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:45.350339 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520a0073-a212-4fd2-95f7-232ae38e106a None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:45.351057 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f339db3b-2ae1-452c-a8d6-696fbeec2835 None None] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:45.351354 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f339db3b-2ae1-452c-a8d6-696fbeec2835 None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:45.351627 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f339db3b-2ae1-452c-a8d6-696fbeec2835 None None] PATH_INFO: `/` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:45.355392 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 331/674] 10.222.0.58 () {54 vars in 926 bytes} [Tue Oct 12 16:37:45 2021] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:37:45.357916 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3d8aa9-d745-4816-84ba-3e08c1bb7ab0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:45.358591 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3d8aa9-d745-4816-84ba-3e08c1bb7ab0 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:45.358874 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3d8aa9-d745-4816-84ba-3e08c1bb7ab0 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:45.359152 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3d8aa9-d745-4816-84ba-3e08c1bb7ab0 admin admin] PATH_INFO: `/v3/roles` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:45.359918 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3d8aa9-d745-4816-84ba-3e08c1bb7ab0 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=85204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:37:45.360225 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3d8aa9-d745-4816-84ba-3e08c1bb7ab0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:45.362759 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a77039-92ab-4c2b-8b12-e01ca300ff1f None None] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:45.363045 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a77039-92ab-4c2b-8b12-e01ca300ff1f None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:45.363316 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a77039-92ab-4c2b-8b12-e01ca300ff1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:45.366378 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3d8aa9-d745-4816-84ba-3e08c1bb7ab0 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:45.386789 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 344/675] 10.222.0.58 () {56 vars in 1120 bytes} [Tue Oct 12 16:37:45 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:37:45.390977 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.auth.core [None req-31a77039-92ab-4c2b-8b12-e01ca300ff1f None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:37:45.391966 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3d8aa9-d745-4816-84ba-3e08c1bb7ab0 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:45.398042 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-31a77039-92ab-4c2b-8b12-e01ca300ff1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:37:45.404962 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3d8aa9-d745-4816-84ba-3e08c1bb7ab0 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:45.414426 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8cf708-70a6-42e5-843d-be70a23a3a21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:45.414728 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 332/676] 10.222.0.58 () {58 vars in 1023 bytes} [Tue Oct 12 16:37:45 2021] POST /identity/v3/auth/tokens => generated 1270 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:37:45.415627 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8cf708-70a6-42e5-843d-be70a23a3a21 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:45.415917 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8cf708-70a6-42e5-843d-be70a23a3a21 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:45.416191 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8cf708-70a6-42e5-843d-be70a23a3a21 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:45.432364 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8cf708-70a6-42e5-843d-be70a23a3a21 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:45.434340 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8cf708-70a6-42e5-843d-be70a23a3a21 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:45.442936 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a77039-92ab-4c2b-8b12-e01ca300ff1f None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:45.454647 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a77039-92ab-4c2b-8b12-e01ca300ff1f None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:45.463157 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0390365-f05a-4da0-a516-34e6aaf3d8d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:45.463949 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0390365-f05a-4da0-a516-34e6aaf3d8d9 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:45.464269 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0390365-f05a-4da0-a516-34e6aaf3d8d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:45.464542 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0390365-f05a-4da0-a516-34e6aaf3d8d9 admin admin] PATH_INFO: `/v3/services/network` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:45.465263 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0390365-f05a-4da0-a516-34e6aaf3d8d9 admin admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:45.470018 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0390365-f05a-4da0-a516-34e6aaf3d8d9 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:45.477273 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: WARNING keystone.server.flask.application [None req-bf8cf708-70a6-42e5-843d-be70a23a3a21 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 16:37:45.478484 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 345/677] 10.222.0.58 () {56 vars in 1129 bytes} [Tue Oct 12 16:37:45 2021] GET /identity/v3/domains/Default => generated 87 bytes in 87 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 16:37:45.485040 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8cf708-70a6-42e5-843d-be70a23a3a21 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:45.487284 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: WARNING keystone.server.flask.application [None req-d0390365-f05a-4da0-a516-34e6aaf3d8d9 admin admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 12 16:37:45.488746 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 333/678] 10.222.0.58 () {56 vars in 1132 bytes} [Tue Oct 12 16:37:45 2021] GET /identity/v3/services/network => generated 88 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 16:37:45.500329 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0390365-f05a-4da0-a516-34e6aaf3d8d9 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:45.500618 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8cf708-70a6-42e5-843d-be70a23a3a21 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:45.509509 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9b2c89-48be-454a-907a-24e6318348aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:45.509856 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0390365-f05a-4da0-a516-34e6aaf3d8d9 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:45.510660 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9b2c89-48be-454a-907a-24e6318348aa admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:45.511146 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9b2c89-48be-454a-907a-24e6318348aa admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:45.511696 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9b2c89-48be-454a-907a-24e6318348aa admin admin] PATH_INFO: `/v3/domains` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:45.512621 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9b2c89-48be-454a-907a-24e6318348aa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:37:45.513121 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9b2c89-48be-454a-907a-24e6318348aa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:45.514918 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9b2c89-48be-454a-907a-24e6318348aa admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:45.523611 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7412506c-f4ca-4baa-bb9d-7fa5974b08f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:45.524729 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7412506c-f4ca-4baa-bb9d-7fa5974b08f2 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:45.525017 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7412506c-f4ca-4baa-bb9d-7fa5974b08f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:45.525299 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7412506c-f4ca-4baa-bb9d-7fa5974b08f2 admin admin] PATH_INFO: `/v3/services` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:45.526129 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7412506c-f4ca-4baa-bb9d-7fa5974b08f2 admin admin] RBAC: Adding query filter params (name=network) {{(pid=85205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:37:45.527676 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7412506c-f4ca-4baa-bb9d-7fa5974b08f2 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:45.529280 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7412506c-f4ca-4baa-bb9d-7fa5974b08f2 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:45.533977 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 346/679] 10.222.0.58 () {56 vars in 1130 bytes} [Tue Oct 12 16:37:45 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:37:45.536758 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9b2c89-48be-454a-907a-24e6318348aa admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:45.545593 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 334/680] 10.222.0.58 () {56 vars in 1133 bytes} [Tue Oct 12 16:37:45 2021] GET /identity/v3/services?name=network => generated 124 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:37:45.554612 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9b2c89-48be-454a-907a-24e6318348aa admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:45.559744 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7412506c-f4ca-4baa-bb9d-7fa5974b08f2 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:45.571260 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7412506c-f4ca-4baa-bb9d-7fa5974b08f2 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:45.574547 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a3010a-cb27-4586-a40a-50f0dac11bb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:45.575367 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a3010a-cb27-4586-a40a-50f0dac11bb9 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:45.575635 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a3010a-cb27-4586-a40a-50f0dac11bb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:45.575919 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a3010a-cb27-4586-a40a-50f0dac11bb9 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:45.577092 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2cfe53-eb6f-4a18-b193-a3b6a0e6cafd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:45.578224 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2cfe53-eb6f-4a18-b193-a3b6a0e6cafd admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:45.578775 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2cfe53-eb6f-4a18-b193-a3b6a0e6cafd admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:45.579872 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2cfe53-eb6f-4a18-b193-a3b6a0e6cafd admin admin] PATH_INFO: `/v3/services` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:45.580829 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2cfe53-eb6f-4a18-b193-a3b6a0e6cafd admin admin] RBAC: Adding query filter params (type=network) {{(pid=85205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:37:45.581333 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2cfe53-eb6f-4a18-b193-a3b6a0e6cafd admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:45.583471 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2cfe53-eb6f-4a18-b193-a3b6a0e6cafd admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:45.587813 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a3010a-cb27-4586-a40a-50f0dac11bb9 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:45.591102 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 335/681] 10.222.0.58 () {56 vars in 1133 bytes} [Tue Oct 12 16:37:45 2021] GET /identity/v3/services?type=network => generated 350 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:37:45.592565 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a3010a-cb27-4586-a40a-50f0dac11bb9 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:45.597909 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2cfe53-eb6f-4a18-b193-a3b6a0e6cafd admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:45.616433 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: WARNING keystone.server.flask.application [None req-46a3010a-cb27-4586-a40a-50f0dac11bb9 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 12 16:37:45.621903 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2cfe53-eb6f-4a18-b193-a3b6a0e6cafd admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:45.622184 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 347/682] 10.222.0.58 () {56 vars in 1114 bytes} [Tue Oct 12 16:37:45 2021] GET /identity/v3/users/nova => generated 82 bytes in 82 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 16:37:45.625221 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a3010a-cb27-4586-a40a-50f0dac11bb9 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:45.635648 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a3010a-cb27-4586-a40a-50f0dac11bb9 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:45.640689 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b444d8-f166-4a8b-a8a0-79fa6d1c90c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:45.641650 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b444d8-f166-4a8b-a8a0-79fa6d1c90c4 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:45.642204 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b444d8-f166-4a8b-a8a0-79fa6d1c90c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:45.642563 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357873a0-dfb9-4b99-b762-e89ba63b522c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:45.642945 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b444d8-f166-4a8b-a8a0-79fa6d1c90c4 admin admin] PATH_INFO: `/v3/users` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:45.643229 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357873a0-dfb9-4b99-b762-e89ba63b522c admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:45.643517 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357873a0-dfb9-4b99-b762-e89ba63b522c admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:45.643790 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357873a0-dfb9-4b99-b762-e89ba63b522c admin admin] PATH_INFO: `/v3/endpoints` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:45.644605 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357873a0-dfb9-4b99-b762-e89ba63b522c admin admin] RBAC: Adding query filter params (interface=public, service_id=3b125aca9ca742fda6ef70aeca2d353e, region_id=RegionOne) {{(pid=85205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:37:45.644849 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b444d8-f166-4a8b-a8a0-79fa6d1c90c4 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=85204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:37:45.644948 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357873a0-dfb9-4b99-b762-e89ba63b522c admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:45.645547 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b444d8-f166-4a8b-a8a0-79fa6d1c90c4 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:45.646545 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357873a0-dfb9-4b99-b762-e89ba63b522c admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:45.647971 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b444d8-f166-4a8b-a8a0-79fa6d1c90c4 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:45.664302 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 336/683] 10.222.0.58 () {56 vars in 1272 bytes} [Tue Oct 12 16:37:45 2021] GET /identity/v3/endpoints?service_id=3b125aca9ca742fda6ef70aeca2d353e&interface=public®ion_id=RegionOne => generated 194 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 16:37:45.670526 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357873a0-dfb9-4b99-b762-e89ba63b522c admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:45.677469 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 348/684] 10.222.0.58 () {56 vars in 1154 bytes} [Tue Oct 12 16:37:45 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:37:45.679172 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b444d8-f166-4a8b-a8a0-79fa6d1c90c4 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:45.689820 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b444d8-f166-4a8b-a8a0-79fa6d1c90c4 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:45.694962 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab95b54-9315-4b40-8596-a097f1754dbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:45.695951 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab95b54-9315-4b40-8596-a097f1754dbd admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:45.696342 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357873a0-dfb9-4b99-b762-e89ba63b522c admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:45.696680 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab95b54-9315-4b40-8596-a097f1754dbd admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:45.697148 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab95b54-9315-4b40-8596-a097f1754dbd admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:45.705926 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab95b54-9315-4b40-8596-a097f1754dbd admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:45.708378 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab95b54-9315-4b40-8596-a097f1754dbd admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:45.721918 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f8bc13-875b-41ad-9a17-d1ec23bbae8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:45.721918 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f8bc13-875b-41ad-9a17-d1ec23bbae8d admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:45.721918 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f8bc13-875b-41ad-9a17-d1ec23bbae8d admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:45.721918 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f8bc13-875b-41ad-9a17-d1ec23bbae8d admin admin] PATH_INFO: `/v3/services` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:45.722277 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f8bc13-875b-41ad-9a17-d1ec23bbae8d admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:45.722572 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f8bc13-875b-41ad-9a17-d1ec23bbae8d admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:45.722768 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 349/685] 10.222.0.58 () {58 vars in 1324 bytes} [Tue Oct 12 16:37:45 2021] GET /identity/v3/auth/tokens => generated 1270 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 12 16:37:45.726339 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab95b54-9315-4b40-8596-a097f1754dbd admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:45.735805 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab95b54-9315-4b40-8596-a097f1754dbd admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:45.741485 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc41069-39e6-4147-8b20-42e2ca4f6f63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:45.742661 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc41069-39e6-4147-8b20-42e2ca4f6f63 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:45.743155 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc41069-39e6-4147-8b20-42e2ca4f6f63 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:45.743666 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc41069-39e6-4147-8b20-42e2ca4f6f63 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:45.745255 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 337/686] 10.222.0.58 () {56 vars in 1108 bytes} [Tue Oct 12 16:37:45 2021] GET /identity/v3/services => generated 772 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 16:37:45.756506 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc41069-39e6-4147-8b20-42e2ca4f6f63 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:45.758769 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc41069-39e6-4147-8b20-42e2ca4f6f63 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:45.777003 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: WARNING keystone.server.flask.application [None req-2cc41069-39e6-4147-8b20-42e2ca4f6f63 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 16:37:45.783985 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 350/687] 10.222.0.58 () {56 vars in 1129 bytes} [Tue Oct 12 16:37:45 2021] GET /identity/v3/domains/Default => generated 87 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 16:37:45.786531 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f8bc13-875b-41ad-9a17-d1ec23bbae8d admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:45.797430 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f8bc13-875b-41ad-9a17-d1ec23bbae8d admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:45.803335 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a57881-4568-4c67-8599-84ff75dedc65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:45.804320 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a57881-4568-4c67-8599-84ff75dedc65 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:45.804797 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a57881-4568-4c67-8599-84ff75dedc65 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:45.805263 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a57881-4568-4c67-8599-84ff75dedc65 admin admin] PATH_INFO: `/v3/domains` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:45.806250 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a57881-4568-4c67-8599-84ff75dedc65 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:37:45.806807 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a57881-4568-4c67-8599-84ff75dedc65 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:45.808630 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a57881-4568-4c67-8599-84ff75dedc65 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:45.811172 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72668f1b-99a8-42b3-b217-4b0d31caf453 None None] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:45.811700 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72668f1b-99a8-42b3-b217-4b0d31caf453 None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:45.812191 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72668f1b-99a8-42b3-b217-4b0d31caf453 None None] PATH_INFO: `/` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:45.814303 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 351/688] 10.222.0.58 () {54 vars in 926 bytes} [Tue Oct 12 16:37:45 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 12 16:37:45.821353 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99795a8-a03e-4d83-916d-7217c72be626 None None] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:45.821643 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99795a8-a03e-4d83-916d-7217c72be626 None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:45.821935 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99795a8-a03e-4d83-916d-7217c72be626 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:45.838386 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 338/689] 10.222.0.58 () {56 vars in 1130 bytes} [Tue Oct 12 16:37:45 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 16:37:45.847474 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.auth.core [None req-b99795a8-a03e-4d83-916d-7217c72be626 None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:37:45.848707 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-b99795a8-a03e-4d83-916d-7217c72be626 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:37:45.850931 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a57881-4568-4c67-8599-84ff75dedc65 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:45.857464 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 352/690] 10.222.0.58 () {58 vars in 1023 bytes} [Tue Oct 12 16:37:45 2021] POST /identity/v3/auth/tokens => generated 1270 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:37:45.864162 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a57881-4568-4c67-8599-84ff75dedc65 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:45.871662 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef90aa60-d4ec-4dba-a0a6-7944e0d07111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:45.872489 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef90aa60-d4ec-4dba-a0a6-7944e0d07111 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:45.872777 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef90aa60-d4ec-4dba-a0a6-7944e0d07111 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:45.873058 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef90aa60-d4ec-4dba-a0a6-7944e0d07111 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:45.895159 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99795a8-a03e-4d83-916d-7217c72be626 None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:45.895351 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef90aa60-d4ec-4dba-a0a6-7944e0d07111 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:45.897445 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef90aa60-d4ec-4dba-a0a6-7944e0d07111 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:45.904710 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99795a8-a03e-4d83-916d-7217c72be626 None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:45.914781 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5641cc-ef8c-4019-a078-743350741ad5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:45.915596 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5641cc-ef8c-4019-a078-743350741ad5 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:45.915935 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5641cc-ef8c-4019-a078-743350741ad5 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:45.916257 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5641cc-ef8c-4019-a078-743350741ad5 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:45.927269 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: WARNING keystone.server.flask.application [None req-ef90aa60-d4ec-4dba-a0a6-7944e0d07111 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 16:37:45.934339 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 339/691] 10.222.0.58 () {56 vars in 1132 bytes} [Tue Oct 12 16:37:45 2021] GET /identity/v3/projects/service => generated 88 bytes in 79 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:37:45.941733 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5641cc-ef8c-4019-a078-743350741ad5 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 16:37:45.949033 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: WARNING keystone.server.flask.application [None req-9b5641cc-ef8c-4019-a078-743350741ad5 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 12 16:37:45.951956 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 353/692] 10.222.0.58 () {56 vars in 1123 bytes} [Tue Oct 12 16:37:45 2021] GET /identity/v3/roles/service => generated 85 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:37:45.952993 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef90aa60-d4ec-4dba-a0a6-7944e0d07111 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:45.960380 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5641cc-ef8c-4019-a078-743350741ad5 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:45.967727 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef90aa60-d4ec-4dba-a0a6-7944e0d07111 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:45.976335 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb4f2fa-d909-4fc3-bd7b-71c0e3f0b2e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:45.977010 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb4f2fa-d909-4fc3-bd7b-71c0e3f0b2e5 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:45.978442 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb4f2fa-d909-4fc3-bd7b-71c0e3f0b2e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:45.978722 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb4f2fa-d909-4fc3-bd7b-71c0e3f0b2e5 admin admin] PATH_INFO: `/v3/projects` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:45.980971 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb4f2fa-d909-4fc3-bd7b-71c0e3f0b2e5 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=85205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:37:45.981295 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb4f2fa-d909-4fc3-bd7b-71c0e3f0b2e5 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:45.985591 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5641cc-ef8c-4019-a078-743350741ad5 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:45.986654 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb4f2fa-d909-4fc3-bd7b-71c0e3f0b2e5 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:45.995247 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea06331-8c88-4928-9fe1-795cc2939ee2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:45.995964 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea06331-8c88-4928-9fe1-795cc2939ee2 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:45.996244 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea06331-8c88-4928-9fe1-795cc2939ee2 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:45.996515 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea06331-8c88-4928-9fe1-795cc2939ee2 admin admin] PATH_INFO: `/v3/roles` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:45.997976 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea06331-8c88-4928-9fe1-795cc2939ee2 admin admin] RBAC: Adding query filter params (name=service) {{(pid=85204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:37:45.998286 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea06331-8c88-4928-9fe1-795cc2939ee2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:45.999911 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea06331-8c88-4928-9fe1-795cc2939ee2 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:46.004196 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 340/693] 10.222.0.58 () {56 vars in 1169 bytes} [Tue Oct 12 16:37:45 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:37:46.016984 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 354/694] 10.222.0.58 () {56 vars in 1124 bytes} [Tue Oct 12 16:37:45 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:37:46.018913 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb4f2fa-d909-4fc3-bd7b-71c0e3f0b2e5 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:46.023856 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea06331-8c88-4928-9fe1-795cc2939ee2 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:46.032407 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb4f2fa-d909-4fc3-bd7b-71c0e3f0b2e5 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:46.034074 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea06331-8c88-4928-9fe1-795cc2939ee2 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:46.041233 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91299d37-8ede-4077-adec-c30ed47d9af6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:46.041647 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1578ba9-690e-4c95-bb54-eb72ac251a98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:46.041895 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91299d37-8ede-4077-adec-c30ed47d9af6 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:46.042195 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91299d37-8ede-4077-adec-c30ed47d9af6 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:46.042470 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91299d37-8ede-4077-adec-c30ed47d9af6 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:46.042635 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1578ba9-690e-4c95-bb54-eb72ac251a98 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:46.042806 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1578ba9-690e-4c95-bb54-eb72ac251a98 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:46.043137 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1578ba9-690e-4c95-bb54-eb72ac251a98 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:46.043301 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91299d37-8ede-4077-adec-c30ed47d9af6 admin admin] RBAC: Adding query filter params (role.id=610824e4f50f4fb8954610e98c1de784, scope.project.id=f3531f242eaa43b69562d70bca5ec5a8, user.id=29d30b574eec4ad3990d77d235c8b424) {{(pid=85205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:37:46.043607 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91299d37-8ede-4077-adec-c30ed47d9af6 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:46.045676 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91299d37-8ede-4077-adec-c30ed47d9af6 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:46.054906 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1578ba9-690e-4c95-bb54-eb72ac251a98 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:46.056741 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1578ba9-690e-4c95-bb54-eb72ac251a98 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:46.058777 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 341/695] 10.222.0.58 () {56 vars in 1395 bytes} [Tue Oct 12 16:37:46 2021] GET /identity/v3/role_assignments?user.id=29d30b574eec4ad3990d77d235c8b424&scope.project.id=f3531f242eaa43b69562d70bca5ec5a8&role.id=610824e4f50f4fb8954610e98c1de784 => generated 608 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 16:37:46.076834 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: WARNING keystone.server.flask.application [None req-f1578ba9-690e-4c95-bb54-eb72ac251a98 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 16:37:46.078476 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 355/696] 10.222.0.58 () {56 vars in 1129 bytes} [Tue Oct 12 16:37:46 2021] GET /identity/v3/domains/Default => generated 87 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 16:37:46.085545 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91299d37-8ede-4077-adec-c30ed47d9af6 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:46.096410 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91299d37-8ede-4077-adec-c30ed47d9af6 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:46.101174 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3c9934-2a29-4914-a4d0-4d93b78527b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:46.101853 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3c9934-2a29-4914-a4d0-4d93b78527b8 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:46.102169 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3c9934-2a29-4914-a4d0-4d93b78527b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:46.102453 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3c9934-2a29-4914-a4d0-4d93b78527b8 admin admin] PATH_INFO: `/v3/domains` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:46.103212 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3c9934-2a29-4914-a4d0-4d93b78527b8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:37:46.103524 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3c9934-2a29-4914-a4d0-4d93b78527b8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:46.105135 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3c9934-2a29-4914-a4d0-4d93b78527b8 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:46.118641 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 342/697] 10.222.0.58 () {56 vars in 1130 bytes} [Tue Oct 12 16:37:46 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:37:46.125023 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1578ba9-690e-4c95-bb54-eb72ac251a98 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:46.135733 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1578ba9-690e-4c95-bb54-eb72ac251a98 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:46.140592 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c09c56-d57d-4cfb-a4e2-45e696170b96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:46.141478 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c09c56-d57d-4cfb-a4e2-45e696170b96 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:46.141767 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c09c56-d57d-4cfb-a4e2-45e696170b96 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:46.142700 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c09c56-d57d-4cfb-a4e2-45e696170b96 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:46.155725 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c09c56-d57d-4cfb-a4e2-45e696170b96 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:46.158475 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c09c56-d57d-4cfb-a4e2-45e696170b96 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:46.176700 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: WARNING keystone.server.flask.application [None req-07c09c56-d57d-4cfb-a4e2-45e696170b96 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 12 16:37:46.178205 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 356/698] 10.222.0.58 () {56 vars in 1138 bytes} [Tue Oct 12 16:37:46 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:37:46.184624 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3c9934-2a29-4914-a4d0-4d93b78527b8 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:46.196858 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3c9934-2a29-4914-a4d0-4d93b78527b8 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:46.201636 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874d3b6c-86af-45bd-9ca1-30c6a29453b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:46.202334 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874d3b6c-86af-45bd-9ca1-30c6a29453b0 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:46.202624 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874d3b6c-86af-45bd-9ca1-30c6a29453b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:46.202905 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874d3b6c-86af-45bd-9ca1-30c6a29453b0 admin admin] PATH_INFO: `/v3/users` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:46.203774 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874d3b6c-86af-45bd-9ca1-30c6a29453b0 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=85205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:37:46.204089 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874d3b6c-86af-45bd-9ca1-30c6a29453b0 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:46.209435 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874d3b6c-86af-45bd-9ca1-30c6a29453b0 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:46.233609 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 343/699] 10.222.0.58 () {56 vars in 1170 bytes} [Tue Oct 12 16:37:46 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:37:46.240111 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c09c56-d57d-4cfb-a4e2-45e696170b96 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:46.255830 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c09c56-d57d-4cfb-a4e2-45e696170b96 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:46.260688 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81ecaee-15fd-4474-a682-81d775350e5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:46.261554 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81ecaee-15fd-4474-a682-81d775350e5e admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:46.261845 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81ecaee-15fd-4474-a682-81d775350e5e admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:46.262160 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81ecaee-15fd-4474-a682-81d775350e5e admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:46.274554 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81ecaee-15fd-4474-a682-81d775350e5e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:46.276504 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81ecaee-15fd-4474-a682-81d775350e5e admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:46.295400 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: WARNING keystone.server.flask.application [None req-f81ecaee-15fd-4474-a682-81d775350e5e admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 16:37:46.296974 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 357/700] 10.222.0.58 () {56 vars in 1129 bytes} [Tue Oct 12 16:37:46 2021] GET /identity/v3/domains/Default => generated 87 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:37:46.303203 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874d3b6c-86af-45bd-9ca1-30c6a29453b0 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:46.313427 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874d3b6c-86af-45bd-9ca1-30c6a29453b0 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:46.322268 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37826c6-32fd-4b93-8d04-c12716fcd70d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:46.322933 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37826c6-32fd-4b93-8d04-c12716fcd70d admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:46.323211 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37826c6-32fd-4b93-8d04-c12716fcd70d admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:46.323484 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37826c6-32fd-4b93-8d04-c12716fcd70d admin admin] PATH_INFO: `/v3/domains` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:46.324221 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37826c6-32fd-4b93-8d04-c12716fcd70d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:37:46.324528 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37826c6-32fd-4b93-8d04-c12716fcd70d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:46.326182 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37826c6-32fd-4b93-8d04-c12716fcd70d admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:46.338904 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 344/701] 10.222.0.58 () {56 vars in 1130 bytes} [Tue Oct 12 16:37:46 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:37:46.344913 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81ecaee-15fd-4474-a682-81d775350e5e admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:46.355389 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81ecaee-15fd-4474-a682-81d775350e5e admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:46.360205 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9097500-2dba-4f43-8bf3-ea18bf3967cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:46.361026 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9097500-2dba-4f43-8bf3-ea18bf3967cf admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:46.361417 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9097500-2dba-4f43-8bf3-ea18bf3967cf admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:46.361697 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9097500-2dba-4f43-8bf3-ea18bf3967cf admin admin] PATH_INFO: `/v3/projects/service` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:46.369142 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9097500-2dba-4f43-8bf3-ea18bf3967cf admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:46.371128 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9097500-2dba-4f43-8bf3-ea18bf3967cf admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:46.386713 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: WARNING keystone.server.flask.application [None req-f9097500-2dba-4f43-8bf3-ea18bf3967cf admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 16:37:46.388120 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 358/702] 10.222.0.58 () {56 vars in 1132 bytes} [Tue Oct 12 16:37:46 2021] GET /identity/v3/projects/service => generated 88 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 16:37:46.394807 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37826c6-32fd-4b93-8d04-c12716fcd70d admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:46.405829 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37826c6-32fd-4b93-8d04-c12716fcd70d admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:46.411045 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e224de0-055b-469b-be7a-1b8efb79320e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:46.411987 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e224de0-055b-469b-be7a-1b8efb79320e admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:46.412465 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e224de0-055b-469b-be7a-1b8efb79320e admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:46.412985 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e224de0-055b-469b-be7a-1b8efb79320e admin admin] PATH_INFO: `/v3/projects` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:46.414061 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e224de0-055b-469b-be7a-1b8efb79320e admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=85205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:37:46.414567 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e224de0-055b-469b-be7a-1b8efb79320e admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:46.416562 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e224de0-055b-469b-be7a-1b8efb79320e admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:46.431430 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 345/703] 10.222.0.58 () {56 vars in 1169 bytes} [Tue Oct 12 16:37:46 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:37:46.441189 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9097500-2dba-4f43-8bf3-ea18bf3967cf admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:46.457787 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9097500-2dba-4f43-8bf3-ea18bf3967cf admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:46.462529 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0c287f-7bf9-40d7-84ca-dde44018fdf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:46.463463 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0c287f-7bf9-40d7-84ca-dde44018fdf1 admin admin] REQUEST_METHOD: `PUT` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:46.463745 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0c287f-7bf9-40d7-84ca-dde44018fdf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:46.464072 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0c287f-7bf9-40d7-84ca-dde44018fdf1 admin admin] PATH_INFO: `/v3/projects/f3531f242eaa43b69562d70bca5ec5a8/users/387a65d2bfb142499c9b3b0ac946f48b/roles/dea461b7131b413590d73da4994002ca` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:46.478871 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0c287f-7bf9-40d7-84ca-dde44018fdf1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3531f242eaa43b69562d70bca5ec5a8, user_id=387a65d2bfb142499c9b3b0ac946f48b, role_id=dea461b7131b413590d73da4994002ca)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:46.481559 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0c287f-7bf9-40d7-84ca-dde44018fdf1 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:46.497101 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 359/704] 10.222.0.58 () {58 vars in 1460 bytes} [Tue Oct 12 16:37:46 2021] PUT /identity/v3/projects/f3531f242eaa43b69562d70bca5ec5a8/users/387a65d2bfb142499c9b3b0ac946f48b/roles/dea461b7131b413590d73da4994002ca => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:37:46.835533 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351a78f7-e749-4a57-b031-54a83b7f5822 None None] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:46.835838 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351a78f7-e749-4a57-b031-54a83b7f5822 None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:46.836089 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351a78f7-e749-4a57-b031-54a83b7f5822 None None] PATH_INFO: `/` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:46.838176 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 346/705] 10.222.0.58 () {54 vars in 926 bytes} [Tue Oct 12 16:37:46 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:37:46.844391 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f082007-2ee3-48c3-8960-42c074f44784 None None] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:46.844754 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f082007-2ee3-48c3-8960-42c074f44784 None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:46.844972 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f082007-2ee3-48c3-8960-42c074f44784 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:46.867320 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.auth.core [None req-2f082007-2ee3-48c3-8960-42c074f44784 None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:37:46.868595 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-2f082007-2ee3-48c3-8960-42c074f44784 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:37:46.936401 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 360/706] 10.222.0.58 () {58 vars in 1023 bytes} [Tue Oct 12 16:37:46 2021] POST /identity/v3/auth/tokens => generated 1270 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:37:46.983332 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351a78f7-e749-4a57-b031-54a83b7f5822 None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:46.999888 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351a78f7-e749-4a57-b031-54a83b7f5822 None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:47.005867 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0424a8b-17f3-4ece-9e90-900a918ed88d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:47.006718 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0424a8b-17f3-4ece-9e90-900a918ed88d admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:47.007010 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0424a8b-17f3-4ece-9e90-900a918ed88d admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:47.007289 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0424a8b-17f3-4ece-9e90-900a918ed88d admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:47.021842 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0424a8b-17f3-4ece-9e90-900a918ed88d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 16:37:47.028776 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: WARNING keystone.server.flask.application [None req-c0424a8b-17f3-4ece-9e90-900a918ed88d admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 16:37:47.029982 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 347/707] 10.222.0.58 () {56 vars in 1117 bytes} [Tue Oct 12 16:37:46 2021] GET /identity/v3/roles/admin => generated 83 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:37:47.036499 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f082007-2ee3-48c3-8960-42c074f44784 None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:47.045665 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f082007-2ee3-48c3-8960-42c074f44784 None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:47.054150 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c118e5-99b0-4b57-b89d-1b1bca5a7afa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:47.054747 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c118e5-99b0-4b57-b89d-1b1bca5a7afa admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:47.055031 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c118e5-99b0-4b57-b89d-1b1bca5a7afa admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:47.055308 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c118e5-99b0-4b57-b89d-1b1bca5a7afa admin admin] PATH_INFO: `/v3/roles` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:47.056075 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c118e5-99b0-4b57-b89d-1b1bca5a7afa admin admin] RBAC: Adding query filter params (name=admin) {{(pid=85204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:37:47.056444 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c118e5-99b0-4b57-b89d-1b1bca5a7afa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:47.058112 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c118e5-99b0-4b57-b89d-1b1bca5a7afa admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:47.067943 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 361/708] 10.222.0.58 () {56 vars in 1120 bytes} [Tue Oct 12 16:37:47 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:37:47.073963 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0424a8b-17f3-4ece-9e90-900a918ed88d admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:47.083878 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0424a8b-17f3-4ece-9e90-900a918ed88d admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:47.090872 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8b8646-71f1-4c72-a560-f771cf54b377 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:47.091651 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8b8646-71f1-4c72-a560-f771cf54b377 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:47.091938 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8b8646-71f1-4c72-a560-f771cf54b377 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:47.092275 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8b8646-71f1-4c72-a560-f771cf54b377 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:47.107012 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8b8646-71f1-4c72-a560-f771cf54b377 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:47.108859 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8b8646-71f1-4c72-a560-f771cf54b377 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:47.130675 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: WARNING keystone.server.flask.application [None req-ab8b8646-71f1-4c72-a560-f771cf54b377 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 16:37:47.132184 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 348/709] 10.222.0.58 () {56 vars in 1129 bytes} [Tue Oct 12 16:37:47 2021] GET /identity/v3/domains/Default => generated 87 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:37:47.138397 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c118e5-99b0-4b57-b89d-1b1bca5a7afa admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:47.153353 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c118e5-99b0-4b57-b89d-1b1bca5a7afa admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:47.160569 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67f18ac-7123-4272-851e-9c49b98adcf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:47.161238 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67f18ac-7123-4272-851e-9c49b98adcf5 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:47.161523 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67f18ac-7123-4272-851e-9c49b98adcf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:47.161801 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67f18ac-7123-4272-851e-9c49b98adcf5 admin admin] PATH_INFO: `/v3/domains` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:47.162630 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67f18ac-7123-4272-851e-9c49b98adcf5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:37:47.162944 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67f18ac-7123-4272-851e-9c49b98adcf5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:47.164586 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67f18ac-7123-4272-851e-9c49b98adcf5 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:47.186009 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 362/710] 10.222.0.58 () {56 vars in 1130 bytes} [Tue Oct 12 16:37:47 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:37:47.192134 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8b8646-71f1-4c72-a560-f771cf54b377 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:47.207186 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8b8646-71f1-4c72-a560-f771cf54b377 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:47.222591 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0111ba-51de-461d-8956-85325e0b63e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:47.223407 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0111ba-51de-461d-8956-85325e0b63e4 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:47.223688 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0111ba-51de-461d-8956-85325e0b63e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:47.223959 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0111ba-51de-461d-8956-85325e0b63e4 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:47.232804 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0111ba-51de-461d-8956-85325e0b63e4 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:47.234831 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0111ba-51de-461d-8956-85325e0b63e4 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:47.256063 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: WARNING keystone.server.flask.application [None req-0d0111ba-51de-461d-8956-85325e0b63e4 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 12 16:37:47.257561 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 349/711] 10.222.0.58 () {56 vars in 1117 bytes} [Tue Oct 12 16:37:47 2021] GET /identity/v3/users/swift => generated 83 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:37:47.263906 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67f18ac-7123-4272-851e-9c49b98adcf5 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:47.276569 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67f18ac-7123-4272-851e-9c49b98adcf5 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:47.289866 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a969e2-e1d6-44a4-926e-ed3a5cd61ae2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:47.290561 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a969e2-e1d6-44a4-926e-ed3a5cd61ae2 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:47.290845 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a969e2-e1d6-44a4-926e-ed3a5cd61ae2 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:47.291123 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a969e2-e1d6-44a4-926e-ed3a5cd61ae2 admin admin] PATH_INFO: `/v3/users` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:47.291978 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a969e2-e1d6-44a4-926e-ed3a5cd61ae2 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=85204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:37:47.292327 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a969e2-e1d6-44a4-926e-ed3a5cd61ae2 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:47.294262 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a969e2-e1d6-44a4-926e-ed3a5cd61ae2 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:47.324131 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0111ba-51de-461d-8956-85325e0b63e4 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:47.326187 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 363/712] 10.222.0.58 () {56 vars in 1156 bytes} [Tue Oct 12 16:37:47 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:37:47.335413 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0111ba-51de-461d-8956-85325e0b63e4 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:47.349995 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a29ba81-2a12-4d1f-8398-0aac9af352b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:47.350791 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a29ba81-2a12-4d1f-8398-0aac9af352b2 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:47.351069 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a29ba81-2a12-4d1f-8398-0aac9af352b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:47.351336 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a29ba81-2a12-4d1f-8398-0aac9af352b2 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:47.370675 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a29ba81-2a12-4d1f-8398-0aac9af352b2 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:47.372608 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a29ba81-2a12-4d1f-8398-0aac9af352b2 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:47.395392 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: WARNING keystone.server.flask.application [None req-0a29ba81-2a12-4d1f-8398-0aac9af352b2 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 16:37:47.396872 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 350/713] 10.222.0.58 () {56 vars in 1129 bytes} [Tue Oct 12 16:37:47 2021] GET /identity/v3/domains/Default => generated 87 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:37:47.403001 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a969e2-e1d6-44a4-926e-ed3a5cd61ae2 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:47.416140 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a969e2-e1d6-44a4-926e-ed3a5cd61ae2 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:47.429507 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08fca0f-98eb-4b27-ab6c-24fa5f2cea59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:47.430257 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08fca0f-98eb-4b27-ab6c-24fa5f2cea59 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:47.430545 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08fca0f-98eb-4b27-ab6c-24fa5f2cea59 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:47.430828 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08fca0f-98eb-4b27-ab6c-24fa5f2cea59 admin admin] PATH_INFO: `/v3/domains` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:47.431575 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08fca0f-98eb-4b27-ab6c-24fa5f2cea59 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:37:47.431885 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08fca0f-98eb-4b27-ab6c-24fa5f2cea59 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:47.433532 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08fca0f-98eb-4b27-ab6c-24fa5f2cea59 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:47.455493 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 364/714] 10.222.0.58 () {56 vars in 1130 bytes} [Tue Oct 12 16:37:47 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:37:47.461428 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a29ba81-2a12-4d1f-8398-0aac9af352b2 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:47.476365 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a29ba81-2a12-4d1f-8398-0aac9af352b2 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:47.489060 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a4f0ed-028d-4d05-830a-d1be8b352e24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:47.489982 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a4f0ed-028d-4d05-830a-d1be8b352e24 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:47.490269 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a4f0ed-028d-4d05-830a-d1be8b352e24 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:47.490541 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a4f0ed-028d-4d05-830a-d1be8b352e24 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:47.501049 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a4f0ed-028d-4d05-830a-d1be8b352e24 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:47.507208 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a4f0ed-028d-4d05-830a-d1be8b352e24 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:47.522148 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: WARNING keystone.server.flask.application [None req-f2a4f0ed-028d-4d05-830a-d1be8b352e24 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 16:37:47.528938 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 351/715] 10.222.0.58 () {56 vars in 1132 bytes} [Tue Oct 12 16:37:47 2021] GET /identity/v3/projects/service => generated 88 bytes in 68 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:37:47.530023 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08fca0f-98eb-4b27-ab6c-24fa5f2cea59 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:47.543641 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08fca0f-98eb-4b27-ab6c-24fa5f2cea59 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:47.555417 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241e50ac-ac14-4d00-afff-98439d1a497b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:47.556088 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241e50ac-ac14-4d00-afff-98439d1a497b admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:47.556372 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241e50ac-ac14-4d00-afff-98439d1a497b admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:47.556647 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241e50ac-ac14-4d00-afff-98439d1a497b admin admin] PATH_INFO: `/v3/projects` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:47.557457 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241e50ac-ac14-4d00-afff-98439d1a497b admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=85204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:37:47.557769 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241e50ac-ac14-4d00-afff-98439d1a497b admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:47.559753 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241e50ac-ac14-4d00-afff-98439d1a497b admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:47.577805 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 365/716] 10.222.0.58 () {56 vars in 1169 bytes} [Tue Oct 12 16:37:47 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 16:37:47.584573 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a4f0ed-028d-4d05-830a-d1be8b352e24 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:47.599481 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a4f0ed-028d-4d05-830a-d1be8b352e24 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:47.614495 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef0eaeb-9218-4586-ab0b-affc9267c9ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:47.615384 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef0eaeb-9218-4586-ab0b-affc9267c9ae admin admin] REQUEST_METHOD: `PUT` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:47.615666 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef0eaeb-9218-4586-ab0b-affc9267c9ae admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:47.615947 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef0eaeb-9218-4586-ab0b-affc9267c9ae admin admin] PATH_INFO: `/v3/projects/f3531f242eaa43b69562d70bca5ec5a8/users/9fdeb0a451344c9987b4134b957ffa22/roles/610824e4f50f4fb8954610e98c1de784` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:47.618002 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef0eaeb-9218-4586-ab0b-affc9267c9ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3531f242eaa43b69562d70bca5ec5a8, user_id=9fdeb0a451344c9987b4134b957ffa22, role_id=610824e4f50f4fb8954610e98c1de784)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:47.620592 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef0eaeb-9218-4586-ab0b-affc9267c9ae admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:47.644854 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 352/717] 10.222.0.58 () {58 vars in 1460 bytes} [Tue Oct 12 16:37:47 2021] PUT /identity/v3/projects/f3531f242eaa43b69562d70bca5ec5a8/users/9fdeb0a451344c9987b4134b957ffa22/roles/610824e4f50f4fb8954610e98c1de784 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:37:47.685722 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598e5dc9-df7d-4e9f-bdab-7202b240ab22 None None] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:47.686097 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598e5dc9-df7d-4e9f-bdab-7202b240ab22 None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:47.686302 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598e5dc9-df7d-4e9f-bdab-7202b240ab22 None None] PATH_INFO: `/` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:47.688402 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 366/718] 10.222.0.58 () {54 vars in 926 bytes} [Tue Oct 12 16:37:47 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:37:47.702831 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17507195-d2c2-43c3-9717-ebacd1254143 None None] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:47.703154 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17507195-d2c2-43c3-9717-ebacd1254143 None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:47.703373 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17507195-d2c2-43c3-9717-ebacd1254143 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:47.731227 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.auth.core [None req-17507195-d2c2-43c3-9717-ebacd1254143 None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:37:47.732479 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-17507195-d2c2-43c3-9717-ebacd1254143 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:37:47.804792 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 353/719] 10.222.0.58 () {58 vars in 1023 bytes} [Tue Oct 12 16:37:47 2021] POST /identity/v3/auth/tokens => generated 1270 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:37:47.841443 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598e5dc9-df7d-4e9f-bdab-7202b240ab22 None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:47.862537 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598e5dc9-df7d-4e9f-bdab-7202b240ab22 None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:47.870543 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd19cea3-90e2-4678-8f0b-7aeaea9f5695 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:47.871380 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd19cea3-90e2-4678-8f0b-7aeaea9f5695 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:47.871656 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd19cea3-90e2-4678-8f0b-7aeaea9f5695 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:47.871929 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd19cea3-90e2-4678-8f0b-7aeaea9f5695 admin admin] PATH_INFO: `/v3/services/block-storage` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:47.872601 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd19cea3-90e2-4678-8f0b-7aeaea9f5695 admin admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:47.874246 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd19cea3-90e2-4678-8f0b-7aeaea9f5695 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:47.887041 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: WARNING keystone.server.flask.application [None req-cd19cea3-90e2-4678-8f0b-7aeaea9f5695 admin admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 12 16:37:47.888223 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 367/720] 10.222.0.58 () {56 vars in 1150 bytes} [Tue Oct 12 16:37:47 2021] GET /identity/v3/services/block-storage => generated 94 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:37:47.895519 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17507195-d2c2-43c3-9717-ebacd1254143 None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:47.904622 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17507195-d2c2-43c3-9717-ebacd1254143 None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:47.915046 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16441368-bce3-411e-aab3-db6fde269624 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:47.915046 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16441368-bce3-411e-aab3-db6fde269624 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:47.915046 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16441368-bce3-411e-aab3-db6fde269624 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:47.915046 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16441368-bce3-411e-aab3-db6fde269624 admin admin] PATH_INFO: `/v3/services` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:47.917535 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16441368-bce3-411e-aab3-db6fde269624 admin admin] RBAC: Adding query filter params (name=block-storage) {{(pid=85205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:37:47.917535 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16441368-bce3-411e-aab3-db6fde269624 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:47.919103 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16441368-bce3-411e-aab3-db6fde269624 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:47.923564 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 354/721] 10.222.0.58 () {56 vars in 1145 bytes} [Tue Oct 12 16:37:47 2021] GET /identity/v3/services?name=block-storage => generated 130 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:37:47.933948 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd19cea3-90e2-4678-8f0b-7aeaea9f5695 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:47.941550 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd19cea3-90e2-4678-8f0b-7aeaea9f5695 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:47.949033 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd01846-5918-4ab9-9fac-e92e51591e6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:47.949798 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd01846-5918-4ab9-9fac-e92e51591e6a admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:47.950116 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd01846-5918-4ab9-9fac-e92e51591e6a admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:47.950394 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd01846-5918-4ab9-9fac-e92e51591e6a admin admin] PATH_INFO: `/v3/services` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:47.951124 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd01846-5918-4ab9-9fac-e92e51591e6a admin admin] RBAC: Adding query filter params (type=block-storage) {{(pid=85204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:37:47.951431 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd01846-5918-4ab9-9fac-e92e51591e6a admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:47.953138 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd01846-5918-4ab9-9fac-e92e51591e6a admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:47.960763 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 368/722] 10.222.0.58 () {56 vars in 1145 bytes} [Tue Oct 12 16:37:47 2021] GET /identity/v3/services?type=block-storage => generated 367 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:37:47.966553 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16441368-bce3-411e-aab3-db6fde269624 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:47.979085 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16441368-bce3-411e-aab3-db6fde269624 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:47.989504 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dd373e-cc9a-41a1-9648-d724f465d1d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:47.990358 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dd373e-cc9a-41a1-9648-d724f465d1d8 admin admin] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:47.990784 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dd373e-cc9a-41a1-9648-d724f465d1d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:47.991225 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dd373e-cc9a-41a1-9648-d724f465d1d8 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:47.992126 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00dd373e-cc9a-41a1-9648-d724f465d1d8 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:47.993265 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: WARNING py.warnings [None req-00dd373e-cc9a-41a1-9648-d724f465d1d8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:create_endpoint failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 12 16:37:47.993265 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: warnings.warn(msg) Oct 12 16:37:47.993265 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: Oct 12 16:37:47.994417 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00dd373e-cc9a-41a1-9648-d724f465d1d8 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:48.029019 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 355/723] 10.222.0.58 () {60 vars in 1165 bytes} [Tue Oct 12 16:37:47 2021] POST /identity/v3/endpoints => generated 346 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:37:48.679533 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127bea6e-563f-4c24-b6b5-24ad964c8e9e None None] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:48.680074 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127bea6e-563f-4c24-b6b5-24ad964c8e9e None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:48.680074 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127bea6e-563f-4c24-b6b5-24ad964c8e9e None None] PATH_INFO: `/` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:48.682129 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 369/724] 10.222.0.58 () {54 vars in 926 bytes} [Tue Oct 12 16:37:48 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:37:48.687799 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce74a36-ca61-4f9b-8beb-c61b9b00f6e2 None None] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:48.688247 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce74a36-ca61-4f9b-8beb-c61b9b00f6e2 None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:48.688427 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce74a36-ca61-4f9b-8beb-c61b9b00f6e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:48.708129 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.auth.core [None req-7ce74a36-ca61-4f9b-8beb-c61b9b00f6e2 None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:37:48.709318 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-7ce74a36-ca61-4f9b-8beb-c61b9b00f6e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:37:48.739925 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 356/725] 10.222.0.58 () {58 vars in 1023 bytes} [Tue Oct 12 16:37:48 2021] POST /identity/v3/auth/tokens => generated 1456 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:37:48.779215 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127bea6e-563f-4c24-b6b5-24ad964c8e9e None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:48.799067 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127bea6e-563f-4c24-b6b5-24ad964c8e9e None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:48.803595 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e8e988-8e7c-4c65-ab70-d37aa1da741d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:48.804381 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e8e988-8e7c-4c65-ab70-d37aa1da741d admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:48.804664 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e8e988-8e7c-4c65-ab70-d37aa1da741d admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:48.804941 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e8e988-8e7c-4c65-ab70-d37aa1da741d admin admin] PATH_INFO: `/v3/services/network` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:48.805611 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e8e988-8e7c-4c65-ab70-d37aa1da741d admin admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:48.807251 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e8e988-8e7c-4c65-ab70-d37aa1da741d admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:48.823679 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: WARNING keystone.server.flask.application [None req-67e8e988-8e7c-4c65-ab70-d37aa1da741d admin admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 12 16:37:48.825196 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 370/726] 10.222.0.58 () {56 vars in 1132 bytes} [Tue Oct 12 16:37:48 2021] GET /identity/v3/services/network => generated 88 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:37:48.831295 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce74a36-ca61-4f9b-8beb-c61b9b00f6e2 None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:48.840362 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce74a36-ca61-4f9b-8beb-c61b9b00f6e2 None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:48.853678 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cd431c-175d-4bad-a33f-0f53f64f1cb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:48.854370 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cd431c-175d-4bad-a33f-0f53f64f1cb2 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:48.854653 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cd431c-175d-4bad-a33f-0f53f64f1cb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:48.854922 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cd431c-175d-4bad-a33f-0f53f64f1cb2 admin admin] PATH_INFO: `/v3/services` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:48.855645 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cd431c-175d-4bad-a33f-0f53f64f1cb2 admin admin] RBAC: Adding query filter params (name=network) {{(pid=85205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:37:48.855950 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cd431c-175d-4bad-a33f-0f53f64f1cb2 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:48.857518 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cd431c-175d-4bad-a33f-0f53f64f1cb2 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:48.863062 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 357/727] 10.222.0.58 () {56 vars in 1133 bytes} [Tue Oct 12 16:37:48 2021] GET /identity/v3/services?name=network => generated 124 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:37:48.869149 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e8e988-8e7c-4c65-ab70-d37aa1da741d admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:48.884188 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e8e988-8e7c-4c65-ab70-d37aa1da741d admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:48.892319 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58712e2-7b50-446e-8943-1ddfbc97496b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:48.892986 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58712e2-7b50-446e-8943-1ddfbc97496b admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:48.893270 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58712e2-7b50-446e-8943-1ddfbc97496b admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:48.893548 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58712e2-7b50-446e-8943-1ddfbc97496b admin admin] PATH_INFO: `/v3/services` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:48.894307 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58712e2-7b50-446e-8943-1ddfbc97496b admin admin] RBAC: Adding query filter params (type=network) {{(pid=85204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:37:48.894618 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58712e2-7b50-446e-8943-1ddfbc97496b admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:48.896323 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58712e2-7b50-446e-8943-1ddfbc97496b admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:48.904695 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 371/728] 10.222.0.58 () {56 vars in 1133 bytes} [Tue Oct 12 16:37:48 2021] GET /identity/v3/services?type=network => generated 350 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:37:48.911218 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cd431c-175d-4bad-a33f-0f53f64f1cb2 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:48.921086 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cd431c-175d-4bad-a33f-0f53f64f1cb2 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:48.934332 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77875d8b-4ac6-40d8-b2eb-75b50557af13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:48.934929 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77875d8b-4ac6-40d8-b2eb-75b50557af13 admin admin] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:48.935212 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77875d8b-4ac6-40d8-b2eb-75b50557af13 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:48.935487 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77875d8b-4ac6-40d8-b2eb-75b50557af13 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:48.936262 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77875d8b-4ac6-40d8-b2eb-75b50557af13 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:48.937897 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77875d8b-4ac6-40d8-b2eb-75b50557af13 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:48.981215 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 358/729] 10.222.0.58 () {60 vars in 1165 bytes} [Tue Oct 12 16:37:48 2021] POST /identity/v3/endpoints => generated 327 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:37:49.107667 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c355c12-9f49-4baf-bd49-7cee40c7ee95 None None] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:49.107999 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c355c12-9f49-4baf-bd49-7cee40c7ee95 None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:49.108211 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c355c12-9f49-4baf-bd49-7cee40c7ee95 None None] PATH_INFO: `/` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:49.110356 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 372/730] 10.222.0.58 () {54 vars in 926 bytes} [Tue Oct 12 16:37:49 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:37:49.116454 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d222e8d6-50a8-4330-9966-e3881434cad5 None None] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:49.116748 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d222e8d6-50a8-4330-9966-e3881434cad5 None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:49.117008 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d222e8d6-50a8-4330-9966-e3881434cad5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:49.143485 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.auth.core [None req-d222e8d6-50a8-4330-9966-e3881434cad5 None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:37:49.144709 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-d222e8d6-50a8-4330-9966-e3881434cad5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:37:49.164187 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 359/731] 10.222.0.58 () {58 vars in 1023 bytes} [Tue Oct 12 16:37:49 2021] POST /identity/v3/auth/tokens => generated 1605 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:37:49.200754 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c355c12-9f49-4baf-bd49-7cee40c7ee95 None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:49.219616 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c355c12-9f49-4baf-bd49-7cee40c7ee95 None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:49.227287 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067121d1-c402-4183-8d5b-baf77038203a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:49.228105 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067121d1-c402-4183-8d5b-baf77038203a admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:49.228429 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067121d1-c402-4183-8d5b-baf77038203a admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:49.228703 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067121d1-c402-4183-8d5b-baf77038203a admin admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:49.229431 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067121d1-c402-4183-8d5b-baf77038203a admin admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:49.231098 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067121d1-c402-4183-8d5b-baf77038203a admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:49.252271 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: WARNING keystone.server.flask.application [None req-067121d1-c402-4183-8d5b-baf77038203a admin admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 12 16:37:49.254089 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 373/732] 10.222.0.58 () {56 vars in 1153 bytes} [Tue Oct 12 16:37:49 2021] GET /identity/v3/services/compute_legacy => generated 95 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:37:49.260442 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d222e8d6-50a8-4330-9966-e3881434cad5 None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:49.270475 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d222e8d6-50a8-4330-9966-e3881434cad5 None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:49.279488 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9a556b-3182-47ef-bf8f-9bc9b515db2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:49.280148 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9a556b-3182-47ef-bf8f-9bc9b515db2c admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:49.280426 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9a556b-3182-47ef-bf8f-9bc9b515db2c admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:49.280696 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9a556b-3182-47ef-bf8f-9bc9b515db2c admin admin] PATH_INFO: `/v3/services` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:49.281417 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9a556b-3182-47ef-bf8f-9bc9b515db2c admin admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=85205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:37:49.281719 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9a556b-3182-47ef-bf8f-9bc9b515db2c admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:49.283890 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9a556b-3182-47ef-bf8f-9bc9b515db2c admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:49.290986 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 360/733] 10.222.0.58 () {56 vars in 1147 bytes} [Tue Oct 12 16:37:49 2021] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:37:49.297023 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067121d1-c402-4183-8d5b-baf77038203a admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:49.307743 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067121d1-c402-4183-8d5b-baf77038203a admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:49.314404 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28929083-c533-4f69-b37f-12003d745c23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:49.315053 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28929083-c533-4f69-b37f-12003d745c23 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:49.315335 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28929083-c533-4f69-b37f-12003d745c23 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:49.315610 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28929083-c533-4f69-b37f-12003d745c23 admin admin] PATH_INFO: `/v3/services` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:49.316326 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28929083-c533-4f69-b37f-12003d745c23 admin admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=85204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:37:49.316631 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28929083-c533-4f69-b37f-12003d745c23 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:49.318231 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28929083-c533-4f69-b37f-12003d745c23 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:49.324942 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 374/734] 10.222.0.58 () {56 vars in 1147 bytes} [Tue Oct 12 16:37:49 2021] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:37:49.565562 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6121f8-f668-4278-94d3-f9921ca46b5d None None] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:49.565562 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6121f8-f668-4278-94d3-f9921ca46b5d None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:49.565562 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6121f8-f668-4278-94d3-f9921ca46b5d None None] PATH_INFO: `/` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:49.567078 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 361/735] 10.222.0.58 () {54 vars in 926 bytes} [Tue Oct 12 16:37:49 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 12 16:37:49.572960 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69953460-0ce9-4d80-93ec-000bd98d3125 None None] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:49.573443 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69953460-0ce9-4d80-93ec-000bd98d3125 None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:49.573858 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69953460-0ce9-4d80-93ec-000bd98d3125 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:49.592759 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.auth.core [None req-69953460-0ce9-4d80-93ec-000bd98d3125 None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:37:49.594190 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-69953460-0ce9-4d80-93ec-000bd98d3125 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:37:49.602349 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 375/736] 10.222.0.58 () {58 vars in 1023 bytes} [Tue Oct 12 16:37:49 2021] POST /identity/v3/auth/tokens => generated 1605 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:37:49.627006 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6121f8-f668-4278-94d3-f9921ca46b5d None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:49.639530 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6121f8-f668-4278-94d3-f9921ca46b5d None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:49.644820 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b606cf2-6a9d-4265-aa6d-3bf969f0ad34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:49.645758 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b606cf2-6a9d-4265-aa6d-3bf969f0ad34 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:49.646226 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b606cf2-6a9d-4265-aa6d-3bf969f0ad34 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:49.646661 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b606cf2-6a9d-4265-aa6d-3bf969f0ad34 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:49.657081 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b606cf2-6a9d-4265-aa6d-3bf969f0ad34 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 16:37:49.664131 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: WARNING keystone.server.flask.application [None req-4b606cf2-6a9d-4265-aa6d-3bf969f0ad34 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 12 16:37:49.665753 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 362/737] 10.222.0.58 () {56 vars in 1123 bytes} [Tue Oct 12 16:37:49 2021] GET /identity/v3/roles/service => generated 85 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:37:49.672226 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69953460-0ce9-4d80-93ec-000bd98d3125 None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:49.682041 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69953460-0ce9-4d80-93ec-000bd98d3125 None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:49.687247 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dc7049-1162-4d71-9bf4-f4cd454a3565 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:49.688185 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dc7049-1162-4d71-9bf4-f4cd454a3565 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:49.689371 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dc7049-1162-4d71-9bf4-f4cd454a3565 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:49.689861 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dc7049-1162-4d71-9bf4-f4cd454a3565 admin admin] PATH_INFO: `/v3/roles` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:49.690852 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5dc7049-1162-4d71-9bf4-f4cd454a3565 admin admin] RBAC: Adding query filter params (name=service) {{(pid=85204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:37:49.691399 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5dc7049-1162-4d71-9bf4-f4cd454a3565 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:49.693232 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5dc7049-1162-4d71-9bf4-f4cd454a3565 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:49.706232 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 376/738] 10.222.0.58 () {56 vars in 1124 bytes} [Tue Oct 12 16:37:49 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:37:49.708619 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b606cf2-6a9d-4265-aa6d-3bf969f0ad34 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:49.719469 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b606cf2-6a9d-4265-aa6d-3bf969f0ad34 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:49.724427 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a5386b-beb2-4d5d-a5e4-46ada64bc8c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:49.725520 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a5386b-beb2-4d5d-a5e4-46ada64bc8c0 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:49.726024 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a5386b-beb2-4d5d-a5e4-46ada64bc8c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:49.726531 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a5386b-beb2-4d5d-a5e4-46ada64bc8c0 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:49.737738 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a5386b-beb2-4d5d-a5e4-46ada64bc8c0 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:49.739835 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a5386b-beb2-4d5d-a5e4-46ada64bc8c0 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:49.760258 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: WARNING keystone.server.flask.application [None req-31a5386b-beb2-4d5d-a5e4-46ada64bc8c0 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 16:37:49.762204 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 363/739] 10.222.0.58 () {56 vars in 1129 bytes} [Tue Oct 12 16:37:49 2021] GET /identity/v3/domains/Default => generated 87 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:37:49.768508 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dc7049-1162-4d71-9bf4-f4cd454a3565 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:49.778688 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dc7049-1162-4d71-9bf4-f4cd454a3565 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:49.783625 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12640bc3-4be4-49e2-94f5-6dd02ccbb20c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:49.784516 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12640bc3-4be4-49e2-94f5-6dd02ccbb20c admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:49.785012 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12640bc3-4be4-49e2-94f5-6dd02ccbb20c admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:49.785492 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12640bc3-4be4-49e2-94f5-6dd02ccbb20c admin admin] PATH_INFO: `/v3/domains` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:49.786447 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12640bc3-4be4-49e2-94f5-6dd02ccbb20c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:37:49.786962 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12640bc3-4be4-49e2-94f5-6dd02ccbb20c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:49.788728 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12640bc3-4be4-49e2-94f5-6dd02ccbb20c admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:49.802230 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 377/740] 10.222.0.58 () {56 vars in 1130 bytes} [Tue Oct 12 16:37:49 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:37:49.812215 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a5386b-beb2-4d5d-a5e4-46ada64bc8c0 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:49.822865 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a5386b-beb2-4d5d-a5e4-46ada64bc8c0 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:49.827685 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865001e2-8300-4b6e-afde-44dc64aae0e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:49.828735 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865001e2-8300-4b6e-afde-44dc64aae0e0 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:49.829253 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865001e2-8300-4b6e-afde-44dc64aae0e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:49.829719 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865001e2-8300-4b6e-afde-44dc64aae0e0 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:49.837350 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865001e2-8300-4b6e-afde-44dc64aae0e0 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:49.839643 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865001e2-8300-4b6e-afde-44dc64aae0e0 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:49.853988 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: WARNING keystone.server.flask.application [None req-865001e2-8300-4b6e-afde-44dc64aae0e0 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 12 16:37:49.855705 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 364/741] 10.222.0.58 () {56 vars in 1138 bytes} [Tue Oct 12 16:37:49 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:37:49.862684 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12640bc3-4be4-49e2-94f5-6dd02ccbb20c admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:49.872751 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12640bc3-4be4-49e2-94f5-6dd02ccbb20c admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:49.878756 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af2a978-4fb8-48d8-9d30-4090938c7d75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:49.879817 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af2a978-4fb8-48d8-9d30-4090938c7d75 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:49.880299 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af2a978-4fb8-48d8-9d30-4090938c7d75 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:49.880828 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af2a978-4fb8-48d8-9d30-4090938c7d75 admin admin] PATH_INFO: `/v3/users` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:49.882007 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af2a978-4fb8-48d8-9d30-4090938c7d75 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=85204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:37:49.882531 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af2a978-4fb8-48d8-9d30-4090938c7d75 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:49.884616 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af2a978-4fb8-48d8-9d30-4090938c7d75 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:49.903193 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 378/742] 10.222.0.58 () {56 vars in 1170 bytes} [Tue Oct 12 16:37:49 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:37:49.909585 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865001e2-8300-4b6e-afde-44dc64aae0e0 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:49.919484 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865001e2-8300-4b6e-afde-44dc64aae0e0 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:49.924822 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8bf00d-8806-4e37-9a23-4000e52d51a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:49.925757 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8bf00d-8806-4e37-9a23-4000e52d51a3 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:49.926268 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8bf00d-8806-4e37-9a23-4000e52d51a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:49.926733 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8bf00d-8806-4e37-9a23-4000e52d51a3 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:49.934742 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8bf00d-8806-4e37-9a23-4000e52d51a3 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:49.936679 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8bf00d-8806-4e37-9a23-4000e52d51a3 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:49.946494 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 365/743] 10.222.0.58 () {58 vars in 1324 bytes} [Tue Oct 12 16:37:49 2021] GET /identity/v3/auth/tokens => generated 1605 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 12 16:37:49.952818 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af2a978-4fb8-48d8-9d30-4090938c7d75 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:49.963942 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af2a978-4fb8-48d8-9d30-4090938c7d75 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:49.968750 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cbf185-056d-41fc-99c9-3906d9e2f11f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:49.969825 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cbf185-056d-41fc-99c9-3906d9e2f11f admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:49.970377 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cbf185-056d-41fc-99c9-3906d9e2f11f admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:49.970904 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cbf185-056d-41fc-99c9-3906d9e2f11f admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:49.981656 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7cbf185-056d-41fc-99c9-3906d9e2f11f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:49.983828 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7cbf185-056d-41fc-99c9-3906d9e2f11f admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:50.003746 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: WARNING keystone.server.flask.application [None req-c7cbf185-056d-41fc-99c9-3906d9e2f11f admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 16:37:50.005802 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 379/744] 10.222.0.58 () {56 vars in 1129 bytes} [Tue Oct 12 16:37:49 2021] GET /identity/v3/domains/Default => generated 87 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:37:50.016291 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8bf00d-8806-4e37-9a23-4000e52d51a3 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:50.021692 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8bf00d-8806-4e37-9a23-4000e52d51a3 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:50.026817 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b359bb-13d2-4f84-a685-d3137e45b0bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:50.027727 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b359bb-13d2-4f84-a685-d3137e45b0bf admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:50.028181 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b359bb-13d2-4f84-a685-d3137e45b0bf admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:50.028623 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b359bb-13d2-4f84-a685-d3137e45b0bf admin admin] PATH_INFO: `/v3/domains` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:50.029547 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b359bb-13d2-4f84-a685-d3137e45b0bf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:37:50.030025 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b359bb-13d2-4f84-a685-d3137e45b0bf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:50.031812 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b359bb-13d2-4f84-a685-d3137e45b0bf admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:50.049737 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 366/745] 10.222.0.58 () {56 vars in 1130 bytes} [Tue Oct 12 16:37:50 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:37:50.051254 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cbf185-056d-41fc-99c9-3906d9e2f11f admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:50.061428 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cbf185-056d-41fc-99c9-3906d9e2f11f admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:50.066903 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe408be-c9c3-49a6-bd83-9b2890680a5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:50.067805 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe408be-c9c3-49a6-bd83-9b2890680a5c admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:50.068184 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe408be-c9c3-49a6-bd83-9b2890680a5c admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:50.068554 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe408be-c9c3-49a6-bd83-9b2890680a5c admin admin] PATH_INFO: `/v3/projects/service` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:50.075909 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe408be-c9c3-49a6-bd83-9b2890680a5c admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:50.077954 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe408be-c9c3-49a6-bd83-9b2890680a5c admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:50.090948 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: WARNING keystone.server.flask.application [None req-6fe408be-c9c3-49a6-bd83-9b2890680a5c admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 16:37:50.092563 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 380/746] 10.222.0.58 () {56 vars in 1132 bytes} [Tue Oct 12 16:37:50 2021] GET /identity/v3/projects/service => generated 88 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:37:50.099489 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b359bb-13d2-4f84-a685-d3137e45b0bf admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:50.109364 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b359bb-13d2-4f84-a685-d3137e45b0bf admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:50.114776 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ded44f-090a-480b-8766-83f39ebd3473 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:50.115637 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ded44f-090a-480b-8766-83f39ebd3473 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:50.116153 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ded44f-090a-480b-8766-83f39ebd3473 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:50.116617 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ded44f-090a-480b-8766-83f39ebd3473 admin admin] PATH_INFO: `/v3/projects` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:50.117596 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ded44f-090a-480b-8766-83f39ebd3473 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=85205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:37:50.118131 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ded44f-090a-480b-8766-83f39ebd3473 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:50.120119 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ded44f-090a-480b-8766-83f39ebd3473 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:50.137991 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 367/747] 10.222.0.58 () {56 vars in 1169 bytes} [Tue Oct 12 16:37:50 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:37:50.140231 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe408be-c9c3-49a6-bd83-9b2890680a5c admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:50.141788 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad02c02f-aea4-48cf-8da1-f10d66fc775e None None] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:50.142334 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad02c02f-aea4-48cf-8da1-f10d66fc775e None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:50.142805 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad02c02f-aea4-48cf-8da1-f10d66fc775e None None] PATH_INFO: `/` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:50.145056 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 368/748] 10.222.0.58 () {54 vars in 926 bytes} [Tue Oct 12 16:37:50 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 12 16:37:50.150483 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93f6a7a-fb80-4246-8f6f-777d33761f0e None None] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:50.151325 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93f6a7a-fb80-4246-8f6f-777d33761f0e None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:50.151601 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93f6a7a-fb80-4246-8f6f-777d33761f0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:50.154813 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe408be-c9c3-49a6-bd83-9b2890680a5c admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:50.162854 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e6a8e0-167f-4a15-9e80-adc933b8409d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:50.163788 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e6a8e0-167f-4a15-9e80-adc933b8409d admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:50.164275 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e6a8e0-167f-4a15-9e80-adc933b8409d admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:50.164819 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e6a8e0-167f-4a15-9e80-adc933b8409d admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:50.165930 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e6a8e0-167f-4a15-9e80-adc933b8409d admin admin] RBAC: Adding query filter params (role.id=dea461b7131b413590d73da4994002ca, scope.project.id=f3531f242eaa43b69562d70bca5ec5a8, user.id=387a65d2bfb142499c9b3b0ac946f48b) {{(pid=85204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:37:50.166515 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e6a8e0-167f-4a15-9e80-adc933b8409d admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:50.168653 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e6a8e0-167f-4a15-9e80-adc933b8409d admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:50.171394 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.auth.core [None req-e93f6a7a-fb80-4246-8f6f-777d33761f0e None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:37:50.173561 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-e93f6a7a-fb80-4246-8f6f-777d33761f0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:37:50.176299 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 381/749] 10.222.0.58 () {56 vars in 1395 bytes} [Tue Oct 12 16:37:50 2021] GET /identity/v3/role_assignments?user.id=387a65d2bfb142499c9b3b0ac946f48b&scope.project.id=f3531f242eaa43b69562d70bca5ec5a8&role.id=dea461b7131b413590d73da4994002ca => generated 608 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:37:50.198121 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 369/750] 10.222.0.58 () {58 vars in 1023 bytes} [Tue Oct 12 16:37:50 2021] POST /identity/v3/auth/tokens => generated 1605 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:37:50.217164 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e6a8e0-167f-4a15-9e80-adc933b8409d admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:50.228453 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e6a8e0-167f-4a15-9e80-adc933b8409d admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:50.233689 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a1c265-d4ef-43e0-b5b2-d613fbbdd277 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:50.234896 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a1c265-d4ef-43e0-b5b2-d613fbbdd277 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:50.236017 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a1c265-d4ef-43e0-b5b2-d613fbbdd277 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:50.236513 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a1c265-d4ef-43e0-b5b2-d613fbbdd277 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:50.249009 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a1c265-d4ef-43e0-b5b2-d613fbbdd277 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 16:37:50.257285 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: WARNING keystone.server.flask.application [None req-d7a1c265-d4ef-43e0-b5b2-d613fbbdd277 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 16:37:50.258957 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 382/751] 10.222.0.58 () {56 vars in 1117 bytes} [Tue Oct 12 16:37:50 2021] GET /identity/v3/roles/admin => generated 83 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:37:50.266008 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93f6a7a-fb80-4246-8f6f-777d33761f0e None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:50.275515 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93f6a7a-fb80-4246-8f6f-777d33761f0e None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:50.280301 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d0883c-52f6-4ce7-b718-5a8405b5de82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:50.280992 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d0883c-52f6-4ce7-b718-5a8405b5de82 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:50.281277 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d0883c-52f6-4ce7-b718-5a8405b5de82 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:50.281562 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d0883c-52f6-4ce7-b718-5a8405b5de82 admin admin] PATH_INFO: `/v3/roles` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:50.283057 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d0883c-52f6-4ce7-b718-5a8405b5de82 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=85205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:37:50.283371 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d0883c-52f6-4ce7-b718-5a8405b5de82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:50.284989 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d0883c-52f6-4ce7-b718-5a8405b5de82 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:50.294396 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 370/752] 10.222.0.58 () {56 vars in 1120 bytes} [Tue Oct 12 16:37:50 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:37:50.301213 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a1c265-d4ef-43e0-b5b2-d613fbbdd277 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:50.311514 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a1c265-d4ef-43e0-b5b2-d613fbbdd277 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:50.316346 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030e58c5-716e-4f4d-96fa-63c4036a63b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:50.317211 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030e58c5-716e-4f4d-96fa-63c4036a63b1 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:50.317496 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030e58c5-716e-4f4d-96fa-63c4036a63b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:50.317776 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030e58c5-716e-4f4d-96fa-63c4036a63b1 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:50.331316 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030e58c5-716e-4f4d-96fa-63c4036a63b1 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:50.333079 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030e58c5-716e-4f4d-96fa-63c4036a63b1 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:50.351855 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: WARNING keystone.server.flask.application [None req-030e58c5-716e-4f4d-96fa-63c4036a63b1 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 16:37:50.353445 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 383/753] 10.222.0.58 () {56 vars in 1129 bytes} [Tue Oct 12 16:37:50 2021] GET /identity/v3/domains/Default => generated 87 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:37:50.360102 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d0883c-52f6-4ce7-b718-5a8405b5de82 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:50.370861 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d0883c-52f6-4ce7-b718-5a8405b5de82 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:50.375813 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92ba4a0-1e6a-4262-ab3d-3ca949e18c61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:50.376527 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92ba4a0-1e6a-4262-ab3d-3ca949e18c61 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:50.376815 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92ba4a0-1e6a-4262-ab3d-3ca949e18c61 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:50.377093 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92ba4a0-1e6a-4262-ab3d-3ca949e18c61 admin admin] PATH_INFO: `/v3/domains` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:50.378145 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92ba4a0-1e6a-4262-ab3d-3ca949e18c61 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:37:50.378526 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92ba4a0-1e6a-4262-ab3d-3ca949e18c61 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:50.380204 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92ba4a0-1e6a-4262-ab3d-3ca949e18c61 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:50.395127 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 371/754] 10.222.0.58 () {56 vars in 1130 bytes} [Tue Oct 12 16:37:50 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:37:50.401526 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030e58c5-716e-4f4d-96fa-63c4036a63b1 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:50.412627 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030e58c5-716e-4f4d-96fa-63c4036a63b1 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:50.417232 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9b8fdc-f7ca-4ece-a8b7-a156df946a74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:50.418096 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9b8fdc-f7ca-4ece-a8b7-a156df946a74 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:50.418692 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9b8fdc-f7ca-4ece-a8b7-a156df946a74 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:50.419136 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9b8fdc-f7ca-4ece-a8b7-a156df946a74 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:50.428468 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9b8fdc-f7ca-4ece-a8b7-a156df946a74 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:50.430511 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9b8fdc-f7ca-4ece-a8b7-a156df946a74 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:50.444285 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: WARNING keystone.server.flask.application [None req-8d9b8fdc-f7ca-4ece-a8b7-a156df946a74 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 12 16:37:50.445832 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 384/755] 10.222.0.58 () {56 vars in 1117 bytes} [Tue Oct 12 16:37:50 2021] GET /identity/v3/users/swift => generated 83 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:37:50.453558 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92ba4a0-1e6a-4262-ab3d-3ca949e18c61 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:50.464190 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92ba4a0-1e6a-4262-ab3d-3ca949e18c61 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:50.469490 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ec283b-9ae7-4028-8c59-5ff2863abe14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:50.470794 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ec283b-9ae7-4028-8c59-5ff2863abe14 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:50.471082 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ec283b-9ae7-4028-8c59-5ff2863abe14 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:50.471356 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ec283b-9ae7-4028-8c59-5ff2863abe14 admin admin] PATH_INFO: `/v3/users` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:50.472273 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ec283b-9ae7-4028-8c59-5ff2863abe14 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=85205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:37:50.472587 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ec283b-9ae7-4028-8c59-5ff2863abe14 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:50.474641 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ec283b-9ae7-4028-8c59-5ff2863abe14 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:50.493663 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 372/756] 10.222.0.58 () {56 vars in 1156 bytes} [Tue Oct 12 16:37:50 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 16:37:50.500008 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9b8fdc-f7ca-4ece-a8b7-a156df946a74 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:50.510962 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9b8fdc-f7ca-4ece-a8b7-a156df946a74 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:50.517908 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3a199e-4cc2-4d6e-9f43-df263ee1bacf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:50.518728 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3a199e-4cc2-4d6e-9f43-df263ee1bacf admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:50.519178 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3a199e-4cc2-4d6e-9f43-df263ee1bacf admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:50.519594 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3a199e-4cc2-4d6e-9f43-df263ee1bacf admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:50.528187 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3a199e-4cc2-4d6e-9f43-df263ee1bacf admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:50.530220 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3a199e-4cc2-4d6e-9f43-df263ee1bacf admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:50.542780 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 385/757] 10.222.0.58 () {58 vars in 1324 bytes} [Tue Oct 12 16:37:50 2021] GET /identity/v3/auth/tokens => generated 1605 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:37:50.547119 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ec283b-9ae7-4028-8c59-5ff2863abe14 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:50.557407 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ec283b-9ae7-4028-8c59-5ff2863abe14 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:50.562492 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ac98d2-0c95-4006-a707-286304872bd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:50.563563 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ac98d2-0c95-4006-a707-286304872bd1 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:50.564026 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ac98d2-0c95-4006-a707-286304872bd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:50.564533 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ac98d2-0c95-4006-a707-286304872bd1 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:50.575671 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ac98d2-0c95-4006-a707-286304872bd1 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:50.577754 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ac98d2-0c95-4006-a707-286304872bd1 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:50.596396 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: WARNING keystone.server.flask.application [None req-f0ac98d2-0c95-4006-a707-286304872bd1 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 16:37:50.598191 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 373/758] 10.222.0.58 () {56 vars in 1129 bytes} [Tue Oct 12 16:37:50 2021] GET /identity/v3/domains/Default => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 16:37:50.605960 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3a199e-4cc2-4d6e-9f43-df263ee1bacf admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:50.614093 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3a199e-4cc2-4d6e-9f43-df263ee1bacf admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:50.618771 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9b8aef-c0c1-4cd8-b104-f6a71946291f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:50.619442 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9b8aef-c0c1-4cd8-b104-f6a71946291f admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:50.619723 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9b8aef-c0c1-4cd8-b104-f6a71946291f admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:50.619995 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9b8aef-c0c1-4cd8-b104-f6a71946291f admin admin] PATH_INFO: `/v3/domains` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:50.620734 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9b8aef-c0c1-4cd8-b104-f6a71946291f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:37:50.621041 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9b8aef-c0c1-4cd8-b104-f6a71946291f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:50.622638 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9b8aef-c0c1-4cd8-b104-f6a71946291f admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:50.640693 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 386/759] 10.222.0.58 () {56 vars in 1130 bytes} [Tue Oct 12 16:37:50 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:37:50.642555 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ac98d2-0c95-4006-a707-286304872bd1 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:50.652543 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ac98d2-0c95-4006-a707-286304872bd1 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:50.657969 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda1f49f-e838-4a2d-baef-35cfd0eb0b3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:50.658967 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda1f49f-e838-4a2d-baef-35cfd0eb0b3a admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:50.659430 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda1f49f-e838-4a2d-baef-35cfd0eb0b3a admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:50.659906 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda1f49f-e838-4a2d-baef-35cfd0eb0b3a admin admin] PATH_INFO: `/v3/projects/service` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:50.667270 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda1f49f-e838-4a2d-baef-35cfd0eb0b3a admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:50.669441 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda1f49f-e838-4a2d-baef-35cfd0eb0b3a admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:50.683182 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: WARNING keystone.server.flask.application [None req-eda1f49f-e838-4a2d-baef-35cfd0eb0b3a admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 16:37:50.684882 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 374/760] 10.222.0.58 () {56 vars in 1132 bytes} [Tue Oct 12 16:37:50 2021] GET /identity/v3/projects/service => generated 88 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 16:37:50.691250 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9b8aef-c0c1-4cd8-b104-f6a71946291f admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:50.701154 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9b8aef-c0c1-4cd8-b104-f6a71946291f admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:50.706436 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ccbd96-2752-4b07-966f-456ac9112bfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:50.707212 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ccbd96-2752-4b07-966f-456ac9112bfb admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:50.707560 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ccbd96-2752-4b07-966f-456ac9112bfb admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:50.707901 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ccbd96-2752-4b07-966f-456ac9112bfb admin admin] PATH_INFO: `/v3/projects` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:50.708801 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ccbd96-2752-4b07-966f-456ac9112bfb admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=85204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:37:50.709218 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ccbd96-2752-4b07-966f-456ac9112bfb admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:50.711207 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ccbd96-2752-4b07-966f-456ac9112bfb admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:50.727945 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 387/761] 10.222.0.58 () {56 vars in 1169 bytes} [Tue Oct 12 16:37:50 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:37:50.731423 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda1f49f-e838-4a2d-baef-35cfd0eb0b3a admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:50.744855 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda1f49f-e838-4a2d-baef-35cfd0eb0b3a admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:50.748653 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82456ff5-8441-41a9-84a4-440ecab48524 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:50.749519 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82456ff5-8441-41a9-84a4-440ecab48524 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:50.749807 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82456ff5-8441-41a9-84a4-440ecab48524 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:50.750160 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82456ff5-8441-41a9-84a4-440ecab48524 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:50.751033 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82456ff5-8441-41a9-84a4-440ecab48524 admin admin] RBAC: Adding query filter params (role.id=610824e4f50f4fb8954610e98c1de784, scope.project.id=f3531f242eaa43b69562d70bca5ec5a8, user.id=9fdeb0a451344c9987b4134b957ffa22) {{(pid=85205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:37:50.751341 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82456ff5-8441-41a9-84a4-440ecab48524 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:50.753506 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82456ff5-8441-41a9-84a4-440ecab48524 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:50.766056 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 375/762] 10.222.0.58 () {56 vars in 1395 bytes} [Tue Oct 12 16:37:50 2021] GET /identity/v3/role_assignments?user.id=9fdeb0a451344c9987b4134b957ffa22&scope.project.id=f3531f242eaa43b69562d70bca5ec5a8&role.id=610824e4f50f4fb8954610e98c1de784 => generated 608 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:37:50.995103 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7268c2a-5381-41a7-9356-7ba63209e805 None None] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:50.995469 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7268c2a-5381-41a7-9356-7ba63209e805 None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:50.995668 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7268c2a-5381-41a7-9356-7ba63209e805 None None] PATH_INFO: `/` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:50.997437 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 388/763] 10.222.0.58 () {54 vars in 926 bytes} [Tue Oct 12 16:37:50 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:37:51.004132 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3543b3c0-3f0c-4c5b-992a-22ede0a8b3a8 None None] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:51.004427 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3543b3c0-3f0c-4c5b-992a-22ede0a8b3a8 None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:51.004707 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3543b3c0-3f0c-4c5b-992a-22ede0a8b3a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:51.022702 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.auth.core [None req-3543b3c0-3f0c-4c5b-992a-22ede0a8b3a8 None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:37:51.023883 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-3543b3c0-3f0c-4c5b-992a-22ede0a8b3a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:37:51.031877 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 376/764] 10.222.0.58 () {58 vars in 1023 bytes} [Tue Oct 12 16:37:51 2021] POST /identity/v3/auth/tokens => generated 1605 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:37:51.054415 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7268c2a-5381-41a7-9356-7ba63209e805 None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:51.067357 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7268c2a-5381-41a7-9356-7ba63209e805 None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:51.071757 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10d6434-f36d-42bf-92c3-185938399c42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:51.072538 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10d6434-f36d-42bf-92c3-185938399c42 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:51.072821 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10d6434-f36d-42bf-92c3-185938399c42 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:51.073121 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10d6434-f36d-42bf-92c3-185938399c42 admin admin] PATH_INFO: `/v3/services/volumev3` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:51.073834 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10d6434-f36d-42bf-92c3-185938399c42 admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:51.075492 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10d6434-f36d-42bf-92c3-185938399c42 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:51.087409 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: WARNING keystone.server.flask.application [None req-e10d6434-f36d-42bf-92c3-185938399c42 admin admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 12 16:37:51.088897 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 389/765] 10.222.0.58 () {56 vars in 1135 bytes} [Tue Oct 12 16:37:51 2021] GET /identity/v3/services/volumev3 => generated 89 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:37:51.095509 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3543b3c0-3f0c-4c5b-992a-22ede0a8b3a8 None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:51.104597 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3543b3c0-3f0c-4c5b-992a-22ede0a8b3a8 None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:51.109281 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6318ca1a-9c81-4383-9b69-a139bc571d1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:51.109966 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6318ca1a-9c81-4383-9b69-a139bc571d1c admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:51.110286 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6318ca1a-9c81-4383-9b69-a139bc571d1c admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:51.110566 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6318ca1a-9c81-4383-9b69-a139bc571d1c admin admin] PATH_INFO: `/v3/services` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:51.111294 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6318ca1a-9c81-4383-9b69-a139bc571d1c admin admin] RBAC: Adding query filter params (name=volumev3) {{(pid=85205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:37:51.111605 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6318ca1a-9c81-4383-9b69-a139bc571d1c admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:51.113195 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6318ca1a-9c81-4383-9b69-a139bc571d1c admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:51.118402 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 377/766] 10.222.0.58 () {56 vars in 1135 bytes} [Tue Oct 12 16:37:51 2021] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:37:51.124621 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10d6434-f36d-42bf-92c3-185938399c42 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:51.135388 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10d6434-f36d-42bf-92c3-185938399c42 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:51.140020 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921729d6-2533-43c2-90d1-04523c6c4b24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:51.140669 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921729d6-2533-43c2-90d1-04523c6c4b24 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:51.140954 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921729d6-2533-43c2-90d1-04523c6c4b24 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:51.141230 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921729d6-2533-43c2-90d1-04523c6c4b24 admin admin] PATH_INFO: `/v3/services` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:51.142581 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921729d6-2533-43c2-90d1-04523c6c4b24 admin admin] RBAC: Adding query filter params (type=volumev3) {{(pid=85204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:37:51.142893 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921729d6-2533-43c2-90d1-04523c6c4b24 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:51.144535 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921729d6-2533-43c2-90d1-04523c6c4b24 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:51.149545 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 390/767] 10.222.0.58 () {56 vars in 1135 bytes} [Tue Oct 12 16:37:51 2021] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:37:51.697634 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c9008f-17d7-499c-91aa-f590899279bc None None] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:51.698039 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c9008f-17d7-499c-91aa-f590899279bc None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:51.698235 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c9008f-17d7-499c-91aa-f590899279bc None None] PATH_INFO: `/` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:51.700195 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 378/768] 10.222.0.58 () {54 vars in 926 bytes} [Tue Oct 12 16:37:51 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:37:51.706039 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d0ec97-51ff-4351-a478-a2c6b9dee7dd None None] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:51.706560 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d0ec97-51ff-4351-a478-a2c6b9dee7dd None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:51.706713 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d0ec97-51ff-4351-a478-a2c6b9dee7dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:51.728519 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.auth.core [None req-08d0ec97-51ff-4351-a478-a2c6b9dee7dd None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:37:51.729702 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-08d0ec97-51ff-4351-a478-a2c6b9dee7dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:37:51.744866 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 391/769] 10.222.0.58 () {58 vars in 1023 bytes} [Tue Oct 12 16:37:51 2021] POST /identity/v3/auth/tokens => generated 1605 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:37:51.768439 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c9008f-17d7-499c-91aa-f590899279bc None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:51.780877 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c9008f-17d7-499c-91aa-f590899279bc None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:51.785418 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8236bfab-1206-4708-84c7-71518080a84c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:51.786096 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8236bfab-1206-4708-84c7-71518080a84c admin admin] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:51.786374 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8236bfab-1206-4708-84c7-71518080a84c admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:51.786649 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8236bfab-1206-4708-84c7-71518080a84c admin admin] PATH_INFO: `/v3/services` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:51.787384 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8236bfab-1206-4708-84c7-71518080a84c admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:51.788935 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8236bfab-1206-4708-84c7-71518080a84c admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:51.804265 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 379/770] 10.222.0.58 () {60 vars in 1162 bytes} [Tue Oct 12 16:37:51 2021] POST /identity/v3/services => generated 269 bytes in 36 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:37:52.670367 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15975915-c158-4ed8-82a6-7c595c1d53a1 None None] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:52.670722 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15975915-c158-4ed8-82a6-7c595c1d53a1 None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:52.670896 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15975915-c158-4ed8-82a6-7c595c1d53a1 None None] PATH_INFO: `/` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:52.673495 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 392/771] 10.222.0.58 () {54 vars in 926 bytes} [Tue Oct 12 16:37:52 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:37:52.679315 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c2855b-7003-4a6e-82c3-8bfbe40e6b92 None None] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:52.679612 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c2855b-7003-4a6e-82c3-8bfbe40e6b92 None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:52.679895 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c2855b-7003-4a6e-82c3-8bfbe40e6b92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:52.699306 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.auth.core [None req-a9c2855b-7003-4a6e-82c3-8bfbe40e6b92 None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:37:52.700806 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-a9c2855b-7003-4a6e-82c3-8bfbe40e6b92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:37:52.718827 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 380/772] 10.222.0.58 () {58 vars in 1023 bytes} [Tue Oct 12 16:37:52 2021] POST /identity/v3/auth/tokens => generated 1715 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:37:52.746253 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15975915-c158-4ed8-82a6-7c595c1d53a1 None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:52.759360 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15975915-c158-4ed8-82a6-7c595c1d53a1 None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:52.763984 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2dbc19-b736-4ba6-ac34-e61a1aa9a5f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:52.764998 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2dbc19-b736-4ba6-ac34-e61a1aa9a5f4 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:52.765499 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2dbc19-b736-4ba6-ac34-e61a1aa9a5f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:52.766032 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2dbc19-b736-4ba6-ac34-e61a1aa9a5f4 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:52.777217 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2dbc19-b736-4ba6-ac34-e61a1aa9a5f4 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 16:37:52.785446 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: WARNING keystone.server.flask.application [None req-6f2dbc19-b736-4ba6-ac34-e61a1aa9a5f4 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 12 16:37:52.787154 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 393/773] 10.222.0.58 () {56 vars in 1141 bytes} [Tue Oct 12 16:37:52 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:37:52.793787 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c2855b-7003-4a6e-82c3-8bfbe40e6b92 None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:52.803576 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c2855b-7003-4a6e-82c3-8bfbe40e6b92 None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:52.810838 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cfc3b9-fb8a-4d7c-90f8-5adc674c491f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:52.811789 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cfc3b9-fb8a-4d7c-90f8-5adc674c491f admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:52.812319 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cfc3b9-fb8a-4d7c-90f8-5adc674c491f admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:52.812792 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cfc3b9-fb8a-4d7c-90f8-5adc674c491f admin admin] PATH_INFO: `/v3/roles` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:52.813779 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cfc3b9-fb8a-4d7c-90f8-5adc674c491f admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=85205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:37:52.814314 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cfc3b9-fb8a-4d7c-90f8-5adc674c491f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:52.816090 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cfc3b9-fb8a-4d7c-90f8-5adc674c491f admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:52.825254 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 381/774] 10.222.0.58 () {56 vars in 1136 bytes} [Tue Oct 12 16:37:52 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:37:52.832211 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2dbc19-b736-4ba6-ac34-e61a1aa9a5f4 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:52.842085 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2dbc19-b736-4ba6-ac34-e61a1aa9a5f4 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:52.847495 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4d70af-532f-4a04-9f26-131277b73816 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:52.848487 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4d70af-532f-4a04-9f26-131277b73816 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:52.848944 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4d70af-532f-4a04-9f26-131277b73816 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:52.849367 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4d70af-532f-4a04-9f26-131277b73816 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:52.860844 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4d70af-532f-4a04-9f26-131277b73816 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:52.862965 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4d70af-532f-4a04-9f26-131277b73816 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:52.880005 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: WARNING keystone.server.flask.application [None req-ae4d70af-532f-4a04-9f26-131277b73816 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 16:37:52.881798 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 394/775] 10.222.0.58 () {56 vars in 1129 bytes} [Tue Oct 12 16:37:52 2021] GET /identity/v3/domains/Default => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:37:52.891741 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cfc3b9-fb8a-4d7c-90f8-5adc674c491f admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:52.902101 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cfc3b9-fb8a-4d7c-90f8-5adc674c491f admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:52.907526 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e135b1f-74b1-4d68-b80c-cce55c190f7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:52.908423 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e135b1f-74b1-4d68-b80c-cce55c190f7d admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:52.908981 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e135b1f-74b1-4d68-b80c-cce55c190f7d admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:52.909460 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e135b1f-74b1-4d68-b80c-cce55c190f7d admin admin] PATH_INFO: `/v3/domains` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:52.910446 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e135b1f-74b1-4d68-b80c-cce55c190f7d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:37:52.910979 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e135b1f-74b1-4d68-b80c-cce55c190f7d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:52.912746 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e135b1f-74b1-4d68-b80c-cce55c190f7d admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:52.925522 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 382/776] 10.222.0.58 () {56 vars in 1130 bytes} [Tue Oct 12 16:37:52 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:37:52.931918 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4d70af-532f-4a04-9f26-131277b73816 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:52.941969 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4d70af-532f-4a04-9f26-131277b73816 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:52.946742 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a1c981-c48d-4a02-a988-684fd00f5738 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:52.947775 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a1c981-c48d-4a02-a988-684fd00f5738 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:52.948301 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a1c981-c48d-4a02-a988-684fd00f5738 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:52.948774 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a1c981-c48d-4a02-a988-684fd00f5738 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:52.958440 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a1c981-c48d-4a02-a988-684fd00f5738 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:52.960890 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a1c981-c48d-4a02-a988-684fd00f5738 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:52.977151 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: WARNING keystone.server.flask.application [None req-69a1c981-c48d-4a02-a988-684fd00f5738 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 12 16:37:52.979319 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 395/777] 10.222.0.58 () {56 vars in 1138 bytes} [Tue Oct 12 16:37:52 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:37:52.985994 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e135b1f-74b1-4d68-b80c-cce55c190f7d admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:52.996719 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e135b1f-74b1-4d68-b80c-cce55c190f7d admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:53.001672 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e4f412-2a6b-47f8-afb6-002274629bb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:53.002876 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e4f412-2a6b-47f8-afb6-002274629bb7 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:53.003387 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e4f412-2a6b-47f8-afb6-002274629bb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:53.003856 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e4f412-2a6b-47f8-afb6-002274629bb7 admin admin] PATH_INFO: `/v3/users` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:53.004902 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e4f412-2a6b-47f8-afb6-002274629bb7 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=85205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:37:53.005413 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e4f412-2a6b-47f8-afb6-002274629bb7 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:53.007589 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e4f412-2a6b-47f8-afb6-002274629bb7 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:53.028519 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 383/778] 10.222.0.58 () {56 vars in 1170 bytes} [Tue Oct 12 16:37:52 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:37:53.035670 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a1c981-c48d-4a02-a988-684fd00f5738 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:53.045691 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a1c981-c48d-4a02-a988-684fd00f5738 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:53.050479 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2777802e-7ec1-4e52-b95d-8edcf8a4696a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:53.051433 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2777802e-7ec1-4e52-b95d-8edcf8a4696a admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:53.051937 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2777802e-7ec1-4e52-b95d-8edcf8a4696a admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:53.052438 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2777802e-7ec1-4e52-b95d-8edcf8a4696a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:53.060878 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2777802e-7ec1-4e52-b95d-8edcf8a4696a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:53.063556 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2777802e-7ec1-4e52-b95d-8edcf8a4696a admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:53.073167 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 396/779] 10.222.0.58 () {58 vars in 1324 bytes} [Tue Oct 12 16:37:53 2021] GET /identity/v3/auth/tokens => generated 1715 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:37:53.080257 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e4f412-2a6b-47f8-afb6-002274629bb7 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:53.090339 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e4f412-2a6b-47f8-afb6-002274629bb7 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:53.095230 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73a1d61-4c60-4d69-b004-cb0d75b5c8c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:53.096309 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73a1d61-4c60-4d69-b004-cb0d75b5c8c8 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:53.096837 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73a1d61-4c60-4d69-b004-cb0d75b5c8c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:53.097323 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73a1d61-4c60-4d69-b004-cb0d75b5c8c8 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:53.108373 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73a1d61-4c60-4d69-b004-cb0d75b5c8c8 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:53.110638 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73a1d61-4c60-4d69-b004-cb0d75b5c8c8 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:53.112364 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f4947a-098a-4b52-8a6b-3fdfaf4b454e None None] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:53.112749 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f4947a-098a-4b52-8a6b-3fdfaf4b454e None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:53.113133 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f4947a-098a-4b52-8a6b-3fdfaf4b454e None None] PATH_INFO: `/` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:53.116375 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 397/780] 10.222.0.58 () {54 vars in 926 bytes} [Tue Oct 12 16:37:53 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:37:53.121345 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ab3ac3-c556-4730-bc2a-1c528ad3f17e None None] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:53.121796 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ab3ac3-c556-4730-bc2a-1c528ad3f17e None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:53.122212 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ab3ac3-c556-4730-bc2a-1c528ad3f17e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:53.131133 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: WARNING keystone.server.flask.application [None req-b73a1d61-4c60-4d69-b004-cb0d75b5c8c8 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 16:37:53.132901 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 384/781] 10.222.0.58 () {56 vars in 1129 bytes} [Tue Oct 12 16:37:53 2021] GET /identity/v3/domains/Default => generated 87 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 16:37:53.139122 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73a1d61-4c60-4d69-b004-cb0d75b5c8c8 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:53.142151 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.auth.core [None req-33ab3ac3-c556-4730-bc2a-1c528ad3f17e None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:37:53.143415 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-33ab3ac3-c556-4730-bc2a-1c528ad3f17e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:37:53.151157 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73a1d61-4c60-4d69-b004-cb0d75b5c8c8 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:53.155788 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfe8a18-cd86-44a8-91b2-4824d2ae3df2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:53.156670 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfe8a18-cd86-44a8-91b2-4824d2ae3df2 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:53.157185 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfe8a18-cd86-44a8-91b2-4824d2ae3df2 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:53.157658 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfe8a18-cd86-44a8-91b2-4824d2ae3df2 admin admin] PATH_INFO: `/v3/domains` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:53.157993 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 398/782] 10.222.0.58 () {58 vars in 1023 bytes} [Tue Oct 12 16:37:53 2021] POST /identity/v3/auth/tokens => generated 1715 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:37:53.158857 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfe8a18-cd86-44a8-91b2-4824d2ae3df2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:37:53.159374 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfe8a18-cd86-44a8-91b2-4824d2ae3df2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:53.161158 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfe8a18-cd86-44a8-91b2-4824d2ae3df2 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:53.173645 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 385/783] 10.222.0.58 () {56 vars in 1130 bytes} [Tue Oct 12 16:37:53 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:37:53.178033 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ab3ac3-c556-4730-bc2a-1c528ad3f17e None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:53.180061 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfe8a18-cd86-44a8-91b2-4824d2ae3df2 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:53.185159 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ab3ac3-c556-4730-bc2a-1c528ad3f17e None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:53.190757 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f93eed3-950c-425c-b138-86463675aabb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:53.192357 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfe8a18-cd86-44a8-91b2-4824d2ae3df2 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:53.193249 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f93eed3-950c-425c-b138-86463675aabb admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:53.193529 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f93eed3-950c-425c-b138-86463675aabb admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:53.193796 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f93eed3-950c-425c-b138-86463675aabb admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:53.194764 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f93eed3-950c-425c-b138-86463675aabb admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:53.197223 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f93eed3-950c-425c-b138-86463675aabb admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:53.202764 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a522fcb8-3630-42d7-a1f9-65bd82846242 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:53.203642 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a522fcb8-3630-42d7-a1f9-65bd82846242 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:53.204494 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a522fcb8-3630-42d7-a1f9-65bd82846242 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:53.204765 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a522fcb8-3630-42d7-a1f9-65bd82846242 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:53.212101 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a522fcb8-3630-42d7-a1f9-65bd82846242 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:53.214063 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a522fcb8-3630-42d7-a1f9-65bd82846242 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:53.214880 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: WARNING keystone.server.flask.application [None req-6f93eed3-950c-425c-b138-86463675aabb admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 12 16:37:53.217019 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 399/784] 10.222.0.58 () {56 vars in 1147 bytes} [Tue Oct 12 16:37:53 2021] GET /identity/v3/services/object-store => generated 93 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 16:37:53.223551 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f93eed3-950c-425c-b138-86463675aabb admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:53.232600 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: WARNING keystone.server.flask.application [None req-a522fcb8-3630-42d7-a1f9-65bd82846242 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 16:37:53.233022 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f93eed3-950c-425c-b138-86463675aabb admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:53.234875 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 386/785] 10.222.0.58 () {56 vars in 1132 bytes} [Tue Oct 12 16:37:53 2021] GET /identity/v3/projects/service => generated 88 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 16:37:53.246536 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765fb1ad-df8f-4401-b2fc-279081bc6eda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:53.247686 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765fb1ad-df8f-4401-b2fc-279081bc6eda admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:53.248001 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a522fcb8-3630-42d7-a1f9-65bd82846242 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:53.248507 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765fb1ad-df8f-4401-b2fc-279081bc6eda admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:53.249085 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765fb1ad-df8f-4401-b2fc-279081bc6eda admin admin] PATH_INFO: `/v3/services` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:53.253734 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765fb1ad-df8f-4401-b2fc-279081bc6eda admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=85204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:37:53.254293 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765fb1ad-df8f-4401-b2fc-279081bc6eda admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:53.256367 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765fb1ad-df8f-4401-b2fc-279081bc6eda admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:53.260305 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a522fcb8-3630-42d7-a1f9-65bd82846242 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:53.268645 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 400/786] 10.222.0.58 () {56 vars in 1143 bytes} [Tue Oct 12 16:37:53 2021] GET /identity/v3/services?name=object-store => generated 129 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 16:37:53.270200 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765fb1ad-df8f-4401-b2fc-279081bc6eda admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:53.276057 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002f7df3-6434-4746-8a23-d8a666b659ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:53.277805 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002f7df3-6434-4746-8a23-d8a666b659ba admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:53.278747 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002f7df3-6434-4746-8a23-d8a666b659ba admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:53.279669 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002f7df3-6434-4746-8a23-d8a666b659ba admin admin] PATH_INFO: `/v3/projects` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:53.280506 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765fb1ad-df8f-4401-b2fc-279081bc6eda admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:53.280948 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002f7df3-6434-4746-8a23-d8a666b659ba admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=85205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:37:53.281622 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002f7df3-6434-4746-8a23-d8a666b659ba admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:53.284295 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002f7df3-6434-4746-8a23-d8a666b659ba admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:53.285094 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78adaa04-56bd-4cd4-9639-d303b79e7403 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:53.285733 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78adaa04-56bd-4cd4-9639-d303b79e7403 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:53.286047 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78adaa04-56bd-4cd4-9639-d303b79e7403 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:53.286324 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78adaa04-56bd-4cd4-9639-d303b79e7403 admin admin] PATH_INFO: `/v3/services` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:53.287034 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78adaa04-56bd-4cd4-9639-d303b79e7403 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=85204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:37:53.287525 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78adaa04-56bd-4cd4-9639-d303b79e7403 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:53.289480 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78adaa04-56bd-4cd4-9639-d303b79e7403 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:53.300088 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 401/787] 10.222.0.58 () {56 vars in 1143 bytes} [Tue Oct 12 16:37:53 2021] GET /identity/v3/services?type=object-store => generated 129 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:37:53.302805 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 387/788] 10.222.0.58 () {56 vars in 1169 bytes} [Tue Oct 12 16:37:53 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 16:37:53.309671 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78adaa04-56bd-4cd4-9639-d303b79e7403 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:53.321198 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78adaa04-56bd-4cd4-9639-d303b79e7403 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:53.326209 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673b66ff-7215-4cd0-b1c4-ab7cabf228ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:53.326941 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673b66ff-7215-4cd0-b1c4-ab7cabf228ca admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:53.327278 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673b66ff-7215-4cd0-b1c4-ab7cabf228ca admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:53.327553 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673b66ff-7215-4cd0-b1c4-ab7cabf228ca admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:53.328514 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673b66ff-7215-4cd0-b1c4-ab7cabf228ca admin admin] RBAC: Adding query filter params (role.id=5ad80b06c65f492a927df805eb69866c, scope.project.id=f3531f242eaa43b69562d70bca5ec5a8, user.id=387a65d2bfb142499c9b3b0ac946f48b) {{(pid=85204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:37:53.329407 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673b66ff-7215-4cd0-b1c4-ab7cabf228ca admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:53.331500 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673b66ff-7215-4cd0-b1c4-ab7cabf228ca admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:53.338657 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 402/789] 10.222.0.58 () {56 vars in 1395 bytes} [Tue Oct 12 16:37:53 2021] GET /identity/v3/role_assignments?user.id=387a65d2bfb142499c9b3b0ac946f48b&scope.project.id=f3531f242eaa43b69562d70bca5ec5a8&role.id=5ad80b06c65f492a927df805eb69866c => generated 259 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:37:53.470282 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09154762-23db-41dc-bdd3-53f9c3464487 None None] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:53.470475 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09154762-23db-41dc-bdd3-53f9c3464487 None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:53.470918 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09154762-23db-41dc-bdd3-53f9c3464487 None None] PATH_INFO: `/` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:53.476744 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 388/790] 10.222.0.58 () {54 vars in 926 bytes} [Tue Oct 12 16:37:53 2021] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:37:53.483400 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90792fa9-9bd7-47a4-a85f-a608a74587aa None None] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:53.483711 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90792fa9-9bd7-47a4-a85f-a608a74587aa None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:53.483960 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90792fa9-9bd7-47a4-a85f-a608a74587aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:53.503880 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.auth.core [None req-90792fa9-9bd7-47a4-a85f-a608a74587aa None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:37:53.505130 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-90792fa9-9bd7-47a4-a85f-a608a74587aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:37:53.513631 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 403/791] 10.222.0.58 () {58 vars in 1023 bytes} [Tue Oct 12 16:37:53 2021] POST /identity/v3/auth/tokens => generated 1715 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:37:53.538681 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09154762-23db-41dc-bdd3-53f9c3464487 None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:53.556070 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09154762-23db-41dc-bdd3-53f9c3464487 None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:53.563460 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4a7bcc-cf6a-4dcc-807b-5b43d4fe9947 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:53.564137 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4a7bcc-cf6a-4dcc-807b-5b43d4fe9947 admin admin] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:53.564424 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4a7bcc-cf6a-4dcc-807b-5b43d4fe9947 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:53.564710 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4a7bcc-cf6a-4dcc-807b-5b43d4fe9947 admin admin] PATH_INFO: `/v3/services` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:53.565470 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4a7bcc-cf6a-4dcc-807b-5b43d4fe9947 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:53.567100 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4a7bcc-cf6a-4dcc-807b-5b43d4fe9947 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:53.582507 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 389/792] 10.222.0.58 () {60 vars in 1162 bytes} [Tue Oct 12 16:37:53 2021] POST /identity/v3/services => generated 251 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 16:37:54.122370 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69be773-0471-4247-98af-83897ca570cd None None] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:54.123355 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69be773-0471-4247-98af-83897ca570cd None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:54.123843 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69be773-0471-4247-98af-83897ca570cd None None] PATH_INFO: `/` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:54.126646 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 404/793] 10.222.0.58 () {54 vars in 926 bytes} [Tue Oct 12 16:37:54 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:37:54.133000 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d795321f-9dc4-4d84-81cf-54beaf421374 None None] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:54.133812 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d795321f-9dc4-4d84-81cf-54beaf421374 None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:54.134320 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d795321f-9dc4-4d84-81cf-54beaf421374 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:54.152765 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.auth.core [None req-d795321f-9dc4-4d84-81cf-54beaf421374 None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:37:54.154264 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-d795321f-9dc4-4d84-81cf-54beaf421374 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:37:54.170768 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 390/794] 10.222.0.58 () {58 vars in 1023 bytes} [Tue Oct 12 16:37:54 2021] POST /identity/v3/auth/tokens => generated 1816 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:37:54.195605 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69be773-0471-4247-98af-83897ca570cd None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:54.208390 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69be773-0471-4247-98af-83897ca570cd None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:54.213902 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dce407-778a-473e-89f5-f25f9d153ad7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:54.214717 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dce407-778a-473e-89f5-f25f9d153ad7 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:54.214995 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dce407-778a-473e-89f5-f25f9d153ad7 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:54.215267 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dce407-778a-473e-89f5-f25f9d153ad7 admin admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:54.215938 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71dce407-778a-473e-89f5-f25f9d153ad7 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:54.217510 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71dce407-778a-473e-89f5-f25f9d153ad7 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:54.229037 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: WARNING keystone.server.flask.application [None req-71dce407-778a-473e-89f5-f25f9d153ad7 admin admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 12 16:37:54.230522 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 405/795] 10.222.0.58 () {56 vars in 1153 bytes} [Tue Oct 12 16:37:54 2021] GET /identity/v3/services/compute_legacy => generated 95 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:37:54.240672 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d795321f-9dc4-4d84-81cf-54beaf421374 None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:54.253790 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d795321f-9dc4-4d84-81cf-54beaf421374 None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:54.258870 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0406e5b-8864-4df1-9904-77f2011fdd74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:54.259765 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0406e5b-8864-4df1-9904-77f2011fdd74 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:54.260254 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0406e5b-8864-4df1-9904-77f2011fdd74 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:54.260753 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0406e5b-8864-4df1-9904-77f2011fdd74 admin admin] PATH_INFO: `/v3/services` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:54.261697 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0406e5b-8864-4df1-9904-77f2011fdd74 admin admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=85205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:37:54.262310 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0406e5b-8864-4df1-9904-77f2011fdd74 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:54.264352 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0406e5b-8864-4df1-9904-77f2011fdd74 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:54.270146 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 391/796] 10.222.0.58 () {56 vars in 1147 bytes} [Tue Oct 12 16:37:54 2021] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:37:54.277025 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dce407-778a-473e-89f5-f25f9d153ad7 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:54.287759 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dce407-778a-473e-89f5-f25f9d153ad7 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:54.292740 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3269b01-9765-438f-bb06-eac794cfc9c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:54.293625 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3269b01-9765-438f-bb06-eac794cfc9c2 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:54.294177 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3269b01-9765-438f-bb06-eac794cfc9c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:54.294711 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3269b01-9765-438f-bb06-eac794cfc9c2 admin admin] PATH_INFO: `/v3/services` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:54.295679 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3269b01-9765-438f-bb06-eac794cfc9c2 admin admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=85204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:37:54.296239 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3269b01-9765-438f-bb06-eac794cfc9c2 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:54.298637 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3269b01-9765-438f-bb06-eac794cfc9c2 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:54.304469 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 406/797] 10.222.0.58 () {56 vars in 1147 bytes} [Tue Oct 12 16:37:54 2021] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:37:54.311247 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0406e5b-8864-4df1-9904-77f2011fdd74 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:54.322309 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0406e5b-8864-4df1-9904-77f2011fdd74 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:54.327445 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f5c6b0-0363-4cde-8fbc-09766fe2584a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:54.328386 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f5c6b0-0363-4cde-8fbc-09766fe2584a admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:54.328951 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f5c6b0-0363-4cde-8fbc-09766fe2584a admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:54.329522 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f5c6b0-0363-4cde-8fbc-09766fe2584a admin admin] PATH_INFO: `/v3/endpoints` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:54.330563 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f5c6b0-0363-4cde-8fbc-09766fe2584a admin admin] RBAC: Adding query filter params (interface=public, service_id=683d2e90189441c68d82b8f6aaf89bca, region_id=RegionOne) {{(pid=85205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:37:54.331133 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f5c6b0-0363-4cde-8fbc-09766fe2584a admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:54.332974 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f5c6b0-0363-4cde-8fbc-09766fe2584a admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:54.338929 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 392/798] 10.222.0.58 () {56 vars in 1272 bytes} [Tue Oct 12 16:37:54 2021] GET /identity/v3/endpoints?service_id=683d2e90189441c68d82b8f6aaf89bca&interface=public®ion_id=RegionOne => generated 194 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:37:54.345436 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3269b01-9765-438f-bb06-eac794cfc9c2 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:54.355848 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3269b01-9765-438f-bb06-eac794cfc9c2 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:54.361335 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312f28f9-ac14-4848-b666-433fa060277c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:54.362348 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312f28f9-ac14-4848-b666-433fa060277c admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:54.362858 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312f28f9-ac14-4848-b666-433fa060277c admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:54.363386 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312f28f9-ac14-4848-b666-433fa060277c admin admin] PATH_INFO: `/v3/services` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:54.364285 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312f28f9-ac14-4848-b666-433fa060277c admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:54.366174 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312f28f9-ac14-4848-b666-433fa060277c admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:54.372687 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 407/799] 10.222.0.58 () {56 vars in 1108 bytes} [Tue Oct 12 16:37:54 2021] GET /identity/v3/services => generated 1268 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:37:55.648970 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89822e97-f697-4569-9f70-42b66c95d3ef None None] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:55.649517 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89822e97-f697-4569-9f70-42b66c95d3ef None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:55.649517 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89822e97-f697-4569-9f70-42b66c95d3ef None None] PATH_INFO: `/` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:55.651563 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 393/800] 10.222.0.58 () {54 vars in 926 bytes} [Tue Oct 12 16:37:55 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:37:55.657782 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105e7343-334a-4068-bc52-7ea549ee2c90 None None] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:55.658241 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105e7343-334a-4068-bc52-7ea549ee2c90 None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:55.658415 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105e7343-334a-4068-bc52-7ea549ee2c90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:55.670644 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10795b3b-e71c-4fac-b930-4dc3482c09fc None None] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:55.670956 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10795b3b-e71c-4fac-b930-4dc3482c09fc None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:55.671198 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10795b3b-e71c-4fac-b930-4dc3482c09fc None None] PATH_INFO: `/` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:55.673757 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 394/801] 10.222.0.58 () {54 vars in 926 bytes} [Tue Oct 12 16:37:55 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 12 16:37:55.677053 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.auth.core [None req-105e7343-334a-4068-bc52-7ea549ee2c90 None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:37:55.678361 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-105e7343-334a-4068-bc52-7ea549ee2c90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:37:55.679332 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a0297d-51e2-458b-9993-04331ca0f96f None None] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:55.679617 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a0297d-51e2-458b-9993-04331ca0f96f None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:55.679886 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a0297d-51e2-458b-9993-04331ca0f96f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:55.686250 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 408/802] 10.222.0.58 () {58 vars in 1023 bytes} [Tue Oct 12 16:37:55 2021] POST /identity/v3/auth/tokens => generated 1816 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:37:55.699160 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.auth.core [None req-69a0297d-51e2-458b-9993-04331ca0f96f None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:37:55.700339 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-69a0297d-51e2-458b-9993-04331ca0f96f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:37:55.710153 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105e7343-334a-4068-bc52-7ea549ee2c90 None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:55.713972 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 395/803] 10.222.0.58 () {58 vars in 1023 bytes} [Tue Oct 12 16:37:55 2021] POST /identity/v3/auth/tokens => generated 1816 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:37:55.719267 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105e7343-334a-4068-bc52-7ea549ee2c90 None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:55.723849 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0770287a-6627-42d8-9693-682e89fc8886 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:55.724502 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0770287a-6627-42d8-9693-682e89fc8886 admin admin] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:55.724786 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0770287a-6627-42d8-9693-682e89fc8886 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:55.725063 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0770287a-6627-42d8-9693-682e89fc8886 admin admin] PATH_INFO: `/v3/services` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:55.725801 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0770287a-6627-42d8-9693-682e89fc8886 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:55.727407 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0770287a-6627-42d8-9693-682e89fc8886 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:55.732200 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a0297d-51e2-458b-9993-04331ca0f96f None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:55.743113 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a0297d-51e2-458b-9993-04331ca0f96f None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:55.747701 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e37a3d-8200-4ea2-a8f8-9fb24827c75a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:55.748383 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 409/804] 10.222.0.58 () {60 vars in 1162 bytes} [Tue Oct 12 16:37:55 2021] POST /identity/v3/services => generated 241 bytes in 39 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 16:37:55.748576 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e37a3d-8200-4ea2-a8f8-9fb24827c75a admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:55.748909 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e37a3d-8200-4ea2-a8f8-9fb24827c75a admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:55.749187 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e37a3d-8200-4ea2-a8f8-9fb24827c75a admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:55.762139 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e37a3d-8200-4ea2-a8f8-9fb24827c75a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 16:37:55.770420 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: WARNING keystone.server.flask.application [None req-56e37a3d-8200-4ea2-a8f8-9fb24827c75a admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 12 16:37:55.777783 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 396/805] 10.222.0.58 () {56 vars in 1141 bytes} [Tue Oct 12 16:37:55 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:37:55.779229 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0770287a-6627-42d8-9693-682e89fc8886 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:55.805333 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0770287a-6627-42d8-9693-682e89fc8886 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:55.810772 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7de0ea-1fd2-4091-8588-9b5e743e681b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:55.811811 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7de0ea-1fd2-4091-8588-9b5e743e681b admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:55.812322 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7de0ea-1fd2-4091-8588-9b5e743e681b admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:55.813353 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7de0ea-1fd2-4091-8588-9b5e743e681b admin admin] PATH_INFO: `/v3/roles` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:55.814355 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7de0ea-1fd2-4091-8588-9b5e743e681b admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=85204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:37:55.814895 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7de0ea-1fd2-4091-8588-9b5e743e681b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:55.817404 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7de0ea-1fd2-4091-8588-9b5e743e681b admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:55.831436 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 410/806] 10.222.0.58 () {56 vars in 1136 bytes} [Tue Oct 12 16:37:55 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:37:55.834983 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e37a3d-8200-4ea2-a8f8-9fb24827c75a admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:55.845502 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e37a3d-8200-4ea2-a8f8-9fb24827c75a admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:55.850689 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27c65fd-985a-4191-ad6a-614d7881a8db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:55.851757 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27c65fd-985a-4191-ad6a-614d7881a8db admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:55.852237 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27c65fd-985a-4191-ad6a-614d7881a8db admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:55.852677 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27c65fd-985a-4191-ad6a-614d7881a8db admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:55.867418 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27c65fd-985a-4191-ad6a-614d7881a8db admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:55.869758 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27c65fd-985a-4191-ad6a-614d7881a8db admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:55.890951 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: WARNING keystone.server.flask.application [None req-f27c65fd-985a-4191-ad6a-614d7881a8db admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 16:37:55.897968 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 397/807] 10.222.0.58 () {56 vars in 1129 bytes} [Tue Oct 12 16:37:55 2021] GET /identity/v3/domains/Default => generated 87 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:37:55.899726 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7de0ea-1fd2-4091-8588-9b5e743e681b admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:55.910231 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7de0ea-1fd2-4091-8588-9b5e743e681b admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:55.915559 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2364c4f-592f-4e60-9540-6805b5d6db5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:55.916549 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2364c4f-592f-4e60-9540-6805b5d6db5e admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:55.917006 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2364c4f-592f-4e60-9540-6805b5d6db5e admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:55.917451 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2364c4f-592f-4e60-9540-6805b5d6db5e admin admin] PATH_INFO: `/v3/domains` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:55.918432 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2364c4f-592f-4e60-9540-6805b5d6db5e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:37:55.918932 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2364c4f-592f-4e60-9540-6805b5d6db5e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:55.920692 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2364c4f-592f-4e60-9540-6805b5d6db5e admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:55.939582 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 411/808] 10.222.0.58 () {56 vars in 1130 bytes} [Tue Oct 12 16:37:55 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:37:55.942229 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7bda17-02ce-48a1-8606-6353a809c778 None None] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:55.942735 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7bda17-02ce-48a1-8606-6353a809c778 None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:55.943185 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7bda17-02ce-48a1-8606-6353a809c778 None None] PATH_INFO: `/` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:55.943653 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2364c4f-592f-4e60-9540-6805b5d6db5e admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:55.945747 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 398/809] 10.222.0.58 () {54 vars in 926 bytes} [Tue Oct 12 16:37:55 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:37:55.956289 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000356c4-3ee4-4a8f-bbb1-dbc6a62ee351 None None] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:55.956931 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000356c4-3ee4-4a8f-bbb1-dbc6a62ee351 None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:55.957723 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000356c4-3ee4-4a8f-bbb1-dbc6a62ee351 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:55.959650 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2364c4f-592f-4e60-9540-6805b5d6db5e admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:55.964345 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b478b3-54dd-492c-914f-65b14fa345b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:55.965157 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b478b3-54dd-492c-914f-65b14fa345b0 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:55.965444 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b478b3-54dd-492c-914f-65b14fa345b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:55.965720 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b478b3-54dd-492c-914f-65b14fa345b0 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:55.974299 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b478b3-54dd-492c-914f-65b14fa345b0 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:55.976311 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b478b3-54dd-492c-914f-65b14fa345b0 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:55.978564 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.auth.core [None req-000356c4-3ee4-4a8f-bbb1-dbc6a62ee351 None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:37:55.979811 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-000356c4-3ee4-4a8f-bbb1-dbc6a62ee351 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:37:55.988930 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 399/810] 10.222.0.58 () {58 vars in 1023 bytes} [Tue Oct 12 16:37:55 2021] POST /identity/v3/auth/tokens => generated 1918 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:37:55.994635 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: WARNING keystone.server.flask.application [None req-e9b478b3-54dd-492c-914f-65b14fa345b0 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 12 16:37:55.995923 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 412/811] 10.222.0.58 () {56 vars in 1138 bytes} [Tue Oct 12 16:37:55 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 16:37:56.002578 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000356c4-3ee4-4a8f-bbb1-dbc6a62ee351 None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:56.012887 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000356c4-3ee4-4a8f-bbb1-dbc6a62ee351 None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:56.016329 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b478b3-54dd-492c-914f-65b14fa345b0 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:56.018724 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677eeb71-d042-4efc-8fcc-22c0a611e455 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:56.019557 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677eeb71-d042-4efc-8fcc-22c0a611e455 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:56.019985 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677eeb71-d042-4efc-8fcc-22c0a611e455 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:56.020423 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677eeb71-d042-4efc-8fcc-22c0a611e455 admin admin] PATH_INFO: `/v3/users` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:56.021663 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677eeb71-d042-4efc-8fcc-22c0a611e455 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=85205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:37:56.021998 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677eeb71-d042-4efc-8fcc-22c0a611e455 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:56.024423 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677eeb71-d042-4efc-8fcc-22c0a611e455 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:56.026713 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b478b3-54dd-492c-914f-65b14fa345b0 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:56.032908 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa8003c-bffe-4f30-8e8e-30c92acc3f31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:56.034319 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa8003c-bffe-4f30-8e8e-30c92acc3f31 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:56.034742 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa8003c-bffe-4f30-8e8e-30c92acc3f31 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:56.035305 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa8003c-bffe-4f30-8e8e-30c92acc3f31 admin admin] PATH_INFO: `/v3/services/volumev3` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:56.036997 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa8003c-bffe-4f30-8e8e-30c92acc3f31 admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:56.038783 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa8003c-bffe-4f30-8e8e-30c92acc3f31 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:56.045217 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 400/812] 10.222.0.58 () {56 vars in 1170 bytes} [Tue Oct 12 16:37:56 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:37:56.051449 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677eeb71-d042-4efc-8fcc-22c0a611e455 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:56.051747 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: WARNING keystone.server.flask.application [None req-2fa8003c-bffe-4f30-8e8e-30c92acc3f31 admin admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 12 16:37:56.053365 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 413/813] 10.222.0.58 () {56 vars in 1135 bytes} [Tue Oct 12 16:37:56 2021] GET /identity/v3/services/volumev3 => generated 89 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:37:56.059577 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa8003c-bffe-4f30-8e8e-30c92acc3f31 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:56.063206 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677eeb71-d042-4efc-8fcc-22c0a611e455 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:56.068143 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1c5ad2-5a14-4a99-b115-85d18264d0a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:56.069132 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1c5ad2-5a14-4a99-b115-85d18264d0a1 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:56.069614 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1c5ad2-5a14-4a99-b115-85d18264d0a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:56.070126 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1c5ad2-5a14-4a99-b115-85d18264d0a1 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:56.070548 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa8003c-bffe-4f30-8e8e-30c92acc3f31 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:56.075232 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e083df0-acd4-4988-b4c1-60165f9744b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:56.075988 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e083df0-acd4-4988-b4c1-60165f9744b3 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:56.076397 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e083df0-acd4-4988-b4c1-60165f9744b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:56.076770 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e083df0-acd4-4988-b4c1-60165f9744b3 admin admin] PATH_INFO: `/v3/services` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:56.077608 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e083df0-acd4-4988-b4c1-60165f9744b3 admin admin] RBAC: Adding query filter params (name=volumev3) {{(pid=85204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:37:56.078066 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e083df0-acd4-4988-b4c1-60165f9744b3 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:56.080311 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e083df0-acd4-4988-b4c1-60165f9744b3 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:56.083927 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1c5ad2-5a14-4a99-b115-85d18264d0a1 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:56.085812 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 414/814] 10.222.0.58 () {56 vars in 1135 bytes} [Tue Oct 12 16:37:56 2021] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 16:37:56.086207 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1c5ad2-5a14-4a99-b115-85d18264d0a1 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:56.091872 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e083df0-acd4-4988-b4c1-60165f9744b3 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:56.101686 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e083df0-acd4-4988-b4c1-60165f9744b3 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:56.105084 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: WARNING keystone.server.flask.application [None req-3b1c5ad2-5a14-4a99-b115-85d18264d0a1 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 16:37:56.106584 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12a5c3e-e974-4d86-a677-1d2b4c490096 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:56.106752 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 401/815] 10.222.0.58 () {56 vars in 1129 bytes} [Tue Oct 12 16:37:56 2021] GET /identity/v3/domains/Default => generated 87 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:37:56.107403 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12a5c3e-e974-4d86-a677-1d2b4c490096 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:56.107762 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12a5c3e-e974-4d86-a677-1d2b4c490096 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:56.108047 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12a5c3e-e974-4d86-a677-1d2b4c490096 admin admin] PATH_INFO: `/v3/services` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:56.108776 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12a5c3e-e974-4d86-a677-1d2b4c490096 admin admin] RBAC: Adding query filter params (type=volumev3) {{(pid=85204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:37:56.109089 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12a5c3e-e974-4d86-a677-1d2b4c490096 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:56.110745 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12a5c3e-e974-4d86-a677-1d2b4c490096 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:56.113680 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1c5ad2-5a14-4a99-b115-85d18264d0a1 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:56.116301 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 415/816] 10.222.0.58 () {56 vars in 1135 bytes} [Tue Oct 12 16:37:56 2021] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 16:37:56.122522 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12a5c3e-e974-4d86-a677-1d2b4c490096 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:56.124101 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1c5ad2-5a14-4a99-b115-85d18264d0a1 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:56.129861 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e404db7-3bee-457a-a8cf-0b549113ab7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:56.130753 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e404db7-3bee-457a-a8cf-0b549113ab7d admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:56.131242 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e404db7-3bee-457a-a8cf-0b549113ab7d admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:56.131671 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e404db7-3bee-457a-a8cf-0b549113ab7d admin admin] PATH_INFO: `/v3/domains` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:56.132599 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e404db7-3bee-457a-a8cf-0b549113ab7d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:37:56.133051 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e404db7-3bee-457a-a8cf-0b549113ab7d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:56.133430 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12a5c3e-e974-4d86-a677-1d2b4c490096 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:56.135473 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e404db7-3bee-457a-a8cf-0b549113ab7d admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:56.138378 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d7a9ea-6037-4fe2-9b34-22bb16334d6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:56.139122 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d7a9ea-6037-4fe2-9b34-22bb16334d6c admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:56.139490 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d7a9ea-6037-4fe2-9b34-22bb16334d6c admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:56.139833 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d7a9ea-6037-4fe2-9b34-22bb16334d6c admin admin] PATH_INFO: `/v3/endpoints` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:56.140751 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d7a9ea-6037-4fe2-9b34-22bb16334d6c admin admin] RBAC: Adding query filter params (interface=public, service_id=62418995f6694f1e86daf9636540419f, region_id=RegionOne) {{(pid=85204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:37:56.141673 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d7a9ea-6037-4fe2-9b34-22bb16334d6c admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:56.142781 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: WARNING py.warnings [None req-d2d7a9ea-6037-4fe2-9b34-22bb16334d6c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:list_endpoints failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 12 16:37:56.142781 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: warnings.warn(msg) Oct 12 16:37:56.142781 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: Oct 12 16:37:56.143800 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d7a9ea-6037-4fe2-9b34-22bb16334d6c admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:56.150446 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 402/817] 10.222.0.58 () {56 vars in 1130 bytes} [Tue Oct 12 16:37:56 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 16:37:56.155489 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 416/818] 10.222.0.58 () {56 vars in 1272 bytes} [Tue Oct 12 16:37:56 2021] GET /identity/v3/endpoints?service_id=62418995f6694f1e86daf9636540419f&interface=public®ion_id=RegionOne => generated 194 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:37:56.160964 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e404db7-3bee-457a-a8cf-0b549113ab7d admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:56.161085 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d7a9ea-6037-4fe2-9b34-22bb16334d6c admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:56.171198 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e404db7-3bee-457a-a8cf-0b549113ab7d admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:56.174135 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d7a9ea-6037-4fe2-9b34-22bb16334d6c admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:56.177366 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8aff73e-4388-4877-b2a2-5521f4946d8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:56.178406 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8aff73e-4388-4877-b2a2-5521f4946d8c admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:56.178985 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8aff73e-4388-4877-b2a2-5521f4946d8c admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:56.179407 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8aff73e-4388-4877-b2a2-5521f4946d8c admin admin] PATH_INFO: `/v3/projects/service` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:56.182599 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f70bda4-9c30-476e-94a7-c59139de2f5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:56.183322 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f70bda4-9c30-476e-94a7-c59139de2f5f admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:56.183609 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f70bda4-9c30-476e-94a7-c59139de2f5f admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:56.183934 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f70bda4-9c30-476e-94a7-c59139de2f5f admin admin] PATH_INFO: `/v3/services` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:56.184724 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f70bda4-9c30-476e-94a7-c59139de2f5f admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:56.186458 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f70bda4-9c30-476e-94a7-c59139de2f5f admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:56.188773 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8aff73e-4388-4877-b2a2-5521f4946d8c admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:56.190878 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8aff73e-4388-4877-b2a2-5521f4946d8c admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:56.202231 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 417/819] 10.222.0.58 () {56 vars in 1108 bytes} [Tue Oct 12 16:37:56 2021] GET /identity/v3/services => generated 1497 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:37:56.206004 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: WARNING keystone.server.flask.application [None req-e8aff73e-4388-4877-b2a2-5521f4946d8c admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 16:37:56.207793 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 403/820] 10.222.0.58 () {56 vars in 1132 bytes} [Tue Oct 12 16:37:56 2021] GET /identity/v3/projects/service => generated 88 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:37:56.214495 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f70bda4-9c30-476e-94a7-c59139de2f5f admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:56.224847 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f70bda4-9c30-476e-94a7-c59139de2f5f admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:56.229848 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2594c2b-0042-41b9-ad8a-92f26edcb22d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:56.230775 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2594c2b-0042-41b9-ad8a-92f26edcb22d admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:56.231238 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2594c2b-0042-41b9-ad8a-92f26edcb22d admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:56.231676 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2594c2b-0042-41b9-ad8a-92f26edcb22d admin admin] PATH_INFO: `/v3/projects` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:56.232646 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2594c2b-0042-41b9-ad8a-92f26edcb22d admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=85204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:37:56.233108 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2594c2b-0042-41b9-ad8a-92f26edcb22d admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:56.235235 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2594c2b-0042-41b9-ad8a-92f26edcb22d admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:56.248301 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 418/821] 10.222.0.58 () {56 vars in 1169 bytes} [Tue Oct 12 16:37:56 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:37:56.256064 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8aff73e-4388-4877-b2a2-5521f4946d8c admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:56.267340 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8aff73e-4388-4877-b2a2-5521f4946d8c admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:56.274611 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab8a964-9355-41c3-92c7-a848e35ba6ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:56.275997 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab8a964-9355-41c3-92c7-a848e35ba6ea admin admin] REQUEST_METHOD: `PUT` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:56.276470 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab8a964-9355-41c3-92c7-a848e35ba6ea admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:56.276903 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab8a964-9355-41c3-92c7-a848e35ba6ea admin admin] PATH_INFO: `/v3/projects/f3531f242eaa43b69562d70bca5ec5a8/users/387a65d2bfb142499c9b3b0ac946f48b/roles/5ad80b06c65f492a927df805eb69866c` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:56.280647 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab8a964-9355-41c3-92c7-a848e35ba6ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3531f242eaa43b69562d70bca5ec5a8, user_id=387a65d2bfb142499c9b3b0ac946f48b, role_id=5ad80b06c65f492a927df805eb69866c)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:56.286381 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab8a964-9355-41c3-92c7-a848e35ba6ea admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:56.304562 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 404/822] 10.222.0.58 () {58 vars in 1460 bytes} [Tue Oct 12 16:37:56 2021] PUT /identity/v3/projects/f3531f242eaa43b69562d70bca5ec5a8/users/387a65d2bfb142499c9b3b0ac946f48b/roles/5ad80b06c65f492a927df805eb69866c => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:37:56.724647 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630adebd-b762-4e08-99be-46065541d39a None None] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:56.725179 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630adebd-b762-4e08-99be-46065541d39a None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:56.725481 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630adebd-b762-4e08-99be-46065541d39a None None] PATH_INFO: `/` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:56.727674 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 419/823] 10.222.0.58 () {54 vars in 926 bytes} [Tue Oct 12 16:37:56 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:37:56.733685 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096512a6-3975-4892-8507-524f45ce2a2f None None] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:56.734134 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096512a6-3975-4892-8507-524f45ce2a2f None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:56.735004 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096512a6-3975-4892-8507-524f45ce2a2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:56.755949 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.auth.core [None req-096512a6-3975-4892-8507-524f45ce2a2f None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:37:56.757280 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-096512a6-3975-4892-8507-524f45ce2a2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:37:56.814835 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 405/824] 10.222.0.58 () {58 vars in 1023 bytes} [Tue Oct 12 16:37:56 2021] POST /identity/v3/auth/tokens => generated 1918 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:37:56.838699 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630adebd-b762-4e08-99be-46065541d39a None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:56.852638 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630adebd-b762-4e08-99be-46065541d39a None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:56.857168 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d5024c-c1bf-4e05-bffe-3038833ff002 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:56.858125 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d5024c-c1bf-4e05-bffe-3038833ff002 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:56.858510 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d5024c-c1bf-4e05-bffe-3038833ff002 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:56.858887 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d5024c-c1bf-4e05-bffe-3038833ff002 admin admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:56.860224 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d5024c-c1bf-4e05-bffe-3038833ff002 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:56.862027 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d5024c-c1bf-4e05-bffe-3038833ff002 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:56.873720 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: WARNING keystone.server.flask.application [None req-10d5024c-c1bf-4e05-bffe-3038833ff002 admin admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 12 16:37:56.875307 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 420/825] 10.222.0.58 () {56 vars in 1153 bytes} [Tue Oct 12 16:37:56 2021] GET /identity/v3/services/compute_legacy => generated 95 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:37:56.882304 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096512a6-3975-4892-8507-524f45ce2a2f None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:56.891364 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096512a6-3975-4892-8507-524f45ce2a2f None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:56.896049 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69021d9c-aee0-43aa-ba88-f3ae6e2689fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:56.896847 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69021d9c-aee0-43aa-ba88-f3ae6e2689fe admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:56.897131 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69021d9c-aee0-43aa-ba88-f3ae6e2689fe admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:56.897462 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69021d9c-aee0-43aa-ba88-f3ae6e2689fe admin admin] PATH_INFO: `/v3/services` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:56.898238 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69021d9c-aee0-43aa-ba88-f3ae6e2689fe admin admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=85205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:37:56.898551 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69021d9c-aee0-43aa-ba88-f3ae6e2689fe admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:56.900123 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69021d9c-aee0-43aa-ba88-f3ae6e2689fe admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:56.905125 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 406/826] 10.222.0.58 () {56 vars in 1147 bytes} [Tue Oct 12 16:37:56 2021] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:37:56.911759 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d5024c-c1bf-4e05-bffe-3038833ff002 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:56.921726 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d5024c-c1bf-4e05-bffe-3038833ff002 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:56.926922 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8444f21-006f-4c46-b67d-081706df588b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:56.927574 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8444f21-006f-4c46-b67d-081706df588b admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:56.927862 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8444f21-006f-4c46-b67d-081706df588b admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:56.928146 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8444f21-006f-4c46-b67d-081706df588b admin admin] PATH_INFO: `/v3/services` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:56.928865 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8444f21-006f-4c46-b67d-081706df588b admin admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=85204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:37:56.929179 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8444f21-006f-4c46-b67d-081706df588b admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:56.930789 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8444f21-006f-4c46-b67d-081706df588b admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:56.936052 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 421/827] 10.222.0.58 () {56 vars in 1147 bytes} [Tue Oct 12 16:37:56 2021] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:37:56.943179 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69021d9c-aee0-43aa-ba88-f3ae6e2689fe admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:56.952964 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69021d9c-aee0-43aa-ba88-f3ae6e2689fe admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:56.957632 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860c9cf4-ede6-46cf-983b-9eb20c795844 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:56.958401 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860c9cf4-ede6-46cf-983b-9eb20c795844 admin admin] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:56.958689 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860c9cf4-ede6-46cf-983b-9eb20c795844 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:56.959017 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860c9cf4-ede6-46cf-983b-9eb20c795844 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:56.959778 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860c9cf4-ede6-46cf-983b-9eb20c795844 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:56.961465 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860c9cf4-ede6-46cf-983b-9eb20c795844 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:56.982923 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 407/828] 10.222.0.58 () {60 vars in 1165 bytes} [Tue Oct 12 16:37:56 2021] POST /identity/v3/endpoints => generated 347 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:37:58.109139 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b63843-af3f-480d-a791-eefd26a0cb94 None None] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:58.109662 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b63843-af3f-480d-a791-eefd26a0cb94 None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:58.109662 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b63843-af3f-480d-a791-eefd26a0cb94 None None] PATH_INFO: `/` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:58.111720 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 422/829] 10.222.0.58 () {54 vars in 926 bytes} [Tue Oct 12 16:37:58 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:37:58.118143 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaec4ba-b1e1-4026-abb6-4962e6bdb079 None None] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:58.118670 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaec4ba-b1e1-4026-abb6-4962e6bdb079 None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:58.118670 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaec4ba-b1e1-4026-abb6-4962e6bdb079 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:58.136358 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.auth.core [None req-dbaec4ba-b1e1-4026-abb6-4962e6bdb079 None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:37:58.137534 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-dbaec4ba-b1e1-4026-abb6-4962e6bdb079 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:37:58.163974 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 408/830] 10.222.0.58 () {58 vars in 1023 bytes} [Tue Oct 12 16:37:58 2021] POST /identity/v3/auth/tokens => generated 2105 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:37:58.186745 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b63843-af3f-480d-a791-eefd26a0cb94 None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:58.199362 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b63843-af3f-480d-a791-eefd26a0cb94 None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:58.204533 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1852890-ada0-4494-a8b5-6cb902e34ef5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:58.205543 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1852890-ada0-4494-a8b5-6cb902e34ef5 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:58.205819 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1852890-ada0-4494-a8b5-6cb902e34ef5 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:58.206124 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1852890-ada0-4494-a8b5-6cb902e34ef5 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:58.206817 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1852890-ada0-4494-a8b5-6cb902e34ef5 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:58.208465 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1852890-ada0-4494-a8b5-6cb902e34ef5 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:58.220888 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: WARNING keystone.server.flask.application [None req-b1852890-ada0-4494-a8b5-6cb902e34ef5 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 12 16:37:58.225978 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 423/831] 10.222.0.58 () {56 vars in 1147 bytes} [Tue Oct 12 16:37:58 2021] GET /identity/v3/services/object-store => generated 93 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:37:58.229218 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbaec4ba-b1e1-4026-abb6-4962e6bdb079 None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:58.238446 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbaec4ba-b1e1-4026-abb6-4962e6bdb079 None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:58.243139 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06596302-2f1c-40c6-b043-af6aab000da9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:58.243793 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06596302-2f1c-40c6-b043-af6aab000da9 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:58.244076 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06596302-2f1c-40c6-b043-af6aab000da9 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:58.244354 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06596302-2f1c-40c6-b043-af6aab000da9 admin admin] PATH_INFO: `/v3/services` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:58.245080 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06596302-2f1c-40c6-b043-af6aab000da9 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=85205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:37:58.245388 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06596302-2f1c-40c6-b043-af6aab000da9 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:58.247023 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06596302-2f1c-40c6-b043-af6aab000da9 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:58.252629 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 409/832] 10.222.0.58 () {56 vars in 1143 bytes} [Tue Oct 12 16:37:58 2021] GET /identity/v3/services?name=object-store => generated 129 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:37:58.258945 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1852890-ada0-4494-a8b5-6cb902e34ef5 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:58.272167 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1852890-ada0-4494-a8b5-6cb902e34ef5 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:58.277070 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93c41c1-55e3-4b79-9fda-c5e046b56c1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:58.278035 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93c41c1-55e3-4b79-9fda-c5e046b56c1c admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:58.278532 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93c41c1-55e3-4b79-9fda-c5e046b56c1c admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:58.279005 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93c41c1-55e3-4b79-9fda-c5e046b56c1c admin admin] PATH_INFO: `/v3/services` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:58.279922 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93c41c1-55e3-4b79-9fda-c5e046b56c1c admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=85204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:37:58.280510 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93c41c1-55e3-4b79-9fda-c5e046b56c1c admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:58.282870 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93c41c1-55e3-4b79-9fda-c5e046b56c1c admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:58.293689 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 424/833] 10.222.0.58 () {56 vars in 1143 bytes} [Tue Oct 12 16:37:58 2021] GET /identity/v3/services?type=object-store => generated 356 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:37:58.295358 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06596302-2f1c-40c6-b043-af6aab000da9 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:58.309700 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06596302-2f1c-40c6-b043-af6aab000da9 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:58.315510 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28cac7f-0841-4d6a-b438-987d016a6b92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:58.316429 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28cac7f-0841-4d6a-b438-987d016a6b92 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:58.316912 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28cac7f-0841-4d6a-b438-987d016a6b92 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:58.317387 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28cac7f-0841-4d6a-b438-987d016a6b92 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:58.318415 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28cac7f-0841-4d6a-b438-987d016a6b92 admin admin] RBAC: Adding query filter params (interface=public, service_id=9eb618776d42489b8d4e5c1bafb4b2e0, region_id=RegionOne) {{(pid=85205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:37:58.318953 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28cac7f-0841-4d6a-b438-987d016a6b92 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:58.320726 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28cac7f-0841-4d6a-b438-987d016a6b92 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:58.331769 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 410/834] 10.222.0.58 () {56 vars in 1272 bytes} [Tue Oct 12 16:37:58 2021] GET /identity/v3/endpoints?service_id=9eb618776d42489b8d4e5c1bafb4b2e0&interface=public®ion_id=RegionOne => generated 194 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:37:58.333437 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93c41c1-55e3-4b79-9fda-c5e046b56c1c admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:58.343448 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93c41c1-55e3-4b79-9fda-c5e046b56c1c admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:58.348799 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdf0b5e-9f70-4eb4-9663-6f3d2a667003 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:58.349686 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdf0b5e-9f70-4eb4-9663-6f3d2a667003 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:58.350202 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdf0b5e-9f70-4eb4-9663-6f3d2a667003 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:58.350671 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdf0b5e-9f70-4eb4-9663-6f3d2a667003 admin admin] PATH_INFO: `/v3/services` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:58.351625 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdf0b5e-9f70-4eb4-9663-6f3d2a667003 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:58.353417 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdf0b5e-9f70-4eb4-9663-6f3d2a667003 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:58.366111 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 425/835] 10.222.0.58 () {56 vars in 1108 bytes} [Tue Oct 12 16:37:58 2021] GET /identity/v3/services => generated 1497 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:37:58.559175 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0e7b3b-5094-4e44-aba5-eda4276dd43f None None] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:58.559541 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0e7b3b-5094-4e44-aba5-eda4276dd43f None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:58.559739 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0e7b3b-5094-4e44-aba5-eda4276dd43f None None] PATH_INFO: `/` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:58.561837 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 411/836] 10.222.0.58 () {54 vars in 926 bytes} [Tue Oct 12 16:37:58 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:37:58.568256 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28a3911-5f1e-4ffb-815b-8a775f99c5aa None None] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:58.568555 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28a3911-5f1e-4ffb-815b-8a775f99c5aa None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:58.568815 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28a3911-5f1e-4ffb-815b-8a775f99c5aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:58.587127 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.auth.core [None req-c28a3911-5f1e-4ffb-815b-8a775f99c5aa None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:37:58.588361 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-c28a3911-5f1e-4ffb-815b-8a775f99c5aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:37:58.597500 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 426/837] 10.222.0.58 () {58 vars in 1023 bytes} [Tue Oct 12 16:37:58 2021] POST /identity/v3/auth/tokens => generated 2105 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:37:58.622176 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0e7b3b-5094-4e44-aba5-eda4276dd43f None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:58.634776 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0e7b3b-5094-4e44-aba5-eda4276dd43f None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:58.639235 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50ac169-90fd-4aa8-be58-69e1674039ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:58.640018 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50ac169-90fd-4aa8-be58-69e1674039ee admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:58.640298 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50ac169-90fd-4aa8-be58-69e1674039ee admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:58.640607 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50ac169-90fd-4aa8-be58-69e1674039ee admin admin] PATH_INFO: `/v3/services/volumev3` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:58.641278 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50ac169-90fd-4aa8-be58-69e1674039ee admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:58.642881 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50ac169-90fd-4aa8-be58-69e1674039ee admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:58.653857 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: WARNING keystone.server.flask.application [None req-a50ac169-90fd-4aa8-be58-69e1674039ee admin admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 12 16:37:58.655335 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 412/838] 10.222.0.58 () {56 vars in 1135 bytes} [Tue Oct 12 16:37:58 2021] GET /identity/v3/services/volumev3 => generated 89 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:37:58.669369 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183a6faf-9536-49c2-98fd-b6625372a8da None None] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:58.669655 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183a6faf-9536-49c2-98fd-b6625372a8da None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:58.669945 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28a3911-5f1e-4ffb-815b-8a775f99c5aa None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:58.670054 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183a6faf-9536-49c2-98fd-b6625372a8da None None] PATH_INFO: `/` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:58.672524 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 413/839] 10.222.0.58 () {54 vars in 926 bytes} [Tue Oct 12 16:37:58 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 12 16:37:58.678304 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c0a01c-94e0-4221-964a-561e92a3ace5 None None] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:58.678590 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c0a01c-94e0-4221-964a-561e92a3ace5 None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:58.678869 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c0a01c-94e0-4221-964a-561e92a3ace5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:58.679956 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28a3911-5f1e-4ffb-815b-8a775f99c5aa None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:58.684972 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c57eb5-2051-434c-acd0-d77f0fdc7340 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:58.685644 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c57eb5-2051-434c-acd0-d77f0fdc7340 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:58.685959 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c57eb5-2051-434c-acd0-d77f0fdc7340 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:58.686242 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c57eb5-2051-434c-acd0-d77f0fdc7340 admin admin] PATH_INFO: `/v3/services` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:58.686964 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c57eb5-2051-434c-acd0-d77f0fdc7340 admin admin] RBAC: Adding query filter params (name=volumev3) {{(pid=85204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:37:58.687305 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c57eb5-2051-434c-acd0-d77f0fdc7340 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:58.688898 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c57eb5-2051-434c-acd0-d77f0fdc7340 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:58.694247 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 427/840] 10.222.0.58 () {56 vars in 1135 bytes} [Tue Oct 12 16:37:58 2021] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:37:58.698956 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.auth.core [None req-b1c0a01c-94e0-4221-964a-561e92a3ace5 None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:37:58.700346 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-b1c0a01c-94e0-4221-964a-561e92a3ace5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:37:58.700456 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c57eb5-2051-434c-acd0-d77f0fdc7340 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:58.709832 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 414/841] 10.222.0.58 () {58 vars in 1023 bytes} [Tue Oct 12 16:37:58 2021] POST /identity/v3/auth/tokens => generated 2105 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:37:58.714003 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c57eb5-2051-434c-acd0-d77f0fdc7340 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:58.717826 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6beff0-1ab6-42ff-bb2d-7329c5095adb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:58.719237 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6beff0-1ab6-42ff-bb2d-7329c5095adb admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:58.719690 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6beff0-1ab6-42ff-bb2d-7329c5095adb admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:58.720124 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6beff0-1ab6-42ff-bb2d-7329c5095adb admin admin] PATH_INFO: `/v3/services` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:58.721046 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6beff0-1ab6-42ff-bb2d-7329c5095adb admin admin] RBAC: Adding query filter params (type=volumev3) {{(pid=85204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:37:58.721500 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6beff0-1ab6-42ff-bb2d-7329c5095adb admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:58.723354 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6beff0-1ab6-42ff-bb2d-7329c5095adb admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:58.729121 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 428/842] 10.222.0.58 () {56 vars in 1135 bytes} [Tue Oct 12 16:37:58 2021] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:37:58.735527 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c0a01c-94e0-4221-964a-561e92a3ace5 None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:58.735781 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6beff0-1ab6-42ff-bb2d-7329c5095adb admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:58.745764 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6beff0-1ab6-42ff-bb2d-7329c5095adb admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:58.746922 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c0a01c-94e0-4221-964a-561e92a3ace5 None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:58.751191 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af80a58-c3d0-49e4-8a38-612fc7b7c14c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:58.752521 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af80a58-c3d0-49e4-8a38-612fc7b7c14c admin admin] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:58.753002 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af80a58-c3d0-49e4-8a38-612fc7b7c14c admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:58.753414 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af80a58-c3d0-49e4-8a38-612fc7b7c14c admin admin] PATH_INFO: `/v3/endpoints` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:58.753787 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092edea0-6453-417c-9625-6df059b395cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:58.754642 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af80a58-c3d0-49e4-8a38-612fc7b7c14c admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:58.754761 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092edea0-6453-417c-9625-6df059b395cb admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:58.755166 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092edea0-6453-417c-9625-6df059b395cb admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:58.755538 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092edea0-6453-417c-9625-6df059b395cb admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:58.756236 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: WARNING py.warnings [None req-6af80a58-c3d0-49e4-8a38-612fc7b7c14c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:create_endpoint failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 12 16:37:58.756236 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: warnings.warn(msg) Oct 12 16:37:58.756236 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: Oct 12 16:37:58.757423 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af80a58-c3d0-49e4-8a38-612fc7b7c14c admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:58.767090 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092edea0-6453-417c-9625-6df059b395cb admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 16:37:58.774619 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: WARNING keystone.server.flask.application [None req-092edea0-6453-417c-9625-6df059b395cb admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 12 16:37:58.782078 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 415/843] 10.222.0.58 () {56 vars in 1141 bytes} [Tue Oct 12 16:37:58 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:37:58.783072 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092edea0-6453-417c-9625-6df059b395cb admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:58.784470 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 429/844] 10.222.0.58 () {60 vars in 1165 bytes} [Tue Oct 12 16:37:58 2021] POST /identity/v3/endpoints => generated 346 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:37:58.793929 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092edea0-6453-417c-9625-6df059b395cb admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:58.818401 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec782c6-8664-4f3f-9f6f-a5226a9a6dab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:58.819574 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec782c6-8664-4f3f-9f6f-a5226a9a6dab admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:58.820078 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec782c6-8664-4f3f-9f6f-a5226a9a6dab admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:58.820638 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec782c6-8664-4f3f-9f6f-a5226a9a6dab admin admin] PATH_INFO: `/v3/roles` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:58.821755 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec782c6-8664-4f3f-9f6f-a5226a9a6dab admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=85205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:37:58.822336 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec782c6-8664-4f3f-9f6f-a5226a9a6dab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:58.824263 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec782c6-8664-4f3f-9f6f-a5226a9a6dab admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:58.835432 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 416/845] 10.222.0.58 () {56 vars in 1136 bytes} [Tue Oct 12 16:37:58 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 16:37:58.841589 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af80a58-c3d0-49e4-8a38-612fc7b7c14c admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:58.857508 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af80a58-c3d0-49e4-8a38-612fc7b7c14c admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:58.862514 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec81670d-fb9e-4cf2-84ab-be62111846da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:58.863317 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec81670d-fb9e-4cf2-84ab-be62111846da admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:58.863598 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec81670d-fb9e-4cf2-84ab-be62111846da admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:58.863929 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec81670d-fb9e-4cf2-84ab-be62111846da admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:58.876297 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec81670d-fb9e-4cf2-84ab-be62111846da admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:58.878695 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec81670d-fb9e-4cf2-84ab-be62111846da admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:58.897773 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: WARNING keystone.server.flask.application [None req-ec81670d-fb9e-4cf2-84ab-be62111846da admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 16:37:58.899254 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 430/846] 10.222.0.58 () {56 vars in 1129 bytes} [Tue Oct 12 16:37:58 2021] GET /identity/v3/domains/Default => generated 87 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:37:58.906815 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec782c6-8664-4f3f-9f6f-a5226a9a6dab admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:58.917630 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec782c6-8664-4f3f-9f6f-a5226a9a6dab admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:58.923062 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca86f878-7e02-4b97-a3f1-6e8b96326902 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:58.924110 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca86f878-7e02-4b97-a3f1-6e8b96326902 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:58.924589 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca86f878-7e02-4b97-a3f1-6e8b96326902 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:58.925117 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca86f878-7e02-4b97-a3f1-6e8b96326902 admin admin] PATH_INFO: `/v3/domains` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:58.926195 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca86f878-7e02-4b97-a3f1-6e8b96326902 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:37:58.926715 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca86f878-7e02-4b97-a3f1-6e8b96326902 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:58.928619 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca86f878-7e02-4b97-a3f1-6e8b96326902 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:58.942313 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 417/847] 10.222.0.58 () {56 vars in 1130 bytes} [Tue Oct 12 16:37:58 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:37:58.948972 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec81670d-fb9e-4cf2-84ab-be62111846da admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:58.963589 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec81670d-fb9e-4cf2-84ab-be62111846da admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:58.969527 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95f9945-907e-47ae-a220-53811e7ef31f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:58.970829 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95f9945-907e-47ae-a220-53811e7ef31f admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:58.971374 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95f9945-907e-47ae-a220-53811e7ef31f admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:58.971845 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95f9945-907e-47ae-a220-53811e7ef31f admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:58.981297 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95f9945-907e-47ae-a220-53811e7ef31f admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:58.983750 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95f9945-907e-47ae-a220-53811e7ef31f admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:58.999149 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: WARNING keystone.server.flask.application [None req-c95f9945-907e-47ae-a220-53811e7ef31f admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 12 16:37:59.000749 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 431/848] 10.222.0.58 () {56 vars in 1138 bytes} [Tue Oct 12 16:37:58 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:37:59.007477 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca86f878-7e02-4b97-a3f1-6e8b96326902 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:59.018153 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca86f878-7e02-4b97-a3f1-6e8b96326902 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:59.023117 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ca719a-3eef-4b8a-a99e-68482b0348aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:59.024090 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ca719a-3eef-4b8a-a99e-68482b0348aa admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:59.024569 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ca719a-3eef-4b8a-a99e-68482b0348aa admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:59.025050 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ca719a-3eef-4b8a-a99e-68482b0348aa admin admin] PATH_INFO: `/v3/users` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:59.026138 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ca719a-3eef-4b8a-a99e-68482b0348aa admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=85205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:37:59.026701 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ca719a-3eef-4b8a-a99e-68482b0348aa admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:59.028774 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ca719a-3eef-4b8a-a99e-68482b0348aa admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:59.047425 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 418/849] 10.222.0.58 () {56 vars in 1170 bytes} [Tue Oct 12 16:37:59 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 16:37:59.054492 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95f9945-907e-47ae-a220-53811e7ef31f admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:59.065862 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95f9945-907e-47ae-a220-53811e7ef31f admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:59.073077 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c9d373-71d1-409c-9276-1ab89700a064 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:59.073752 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c9d373-71d1-409c-9276-1ab89700a064 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:59.074100 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c9d373-71d1-409c-9276-1ab89700a064 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:59.074388 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c9d373-71d1-409c-9276-1ab89700a064 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:59.083382 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c9d373-71d1-409c-9276-1ab89700a064 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:59.085127 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c9d373-71d1-409c-9276-1ab89700a064 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:59.095180 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 432/850] 10.222.0.58 () {58 vars in 1324 bytes} [Tue Oct 12 16:37:59 2021] GET /identity/v3/auth/tokens => generated 2291 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:37:59.101305 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ca719a-3eef-4b8a-a99e-68482b0348aa admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:59.115902 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ca719a-3eef-4b8a-a99e-68482b0348aa admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:59.120525 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac32fe17-4af1-4795-8634-f5cae2027a6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:59.121309 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac32fe17-4af1-4795-8634-f5cae2027a6a admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:59.121579 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac32fe17-4af1-4795-8634-f5cae2027a6a admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:59.121846 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac32fe17-4af1-4795-8634-f5cae2027a6a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:59.132594 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac32fe17-4af1-4795-8634-f5cae2027a6a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:59.134387 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac32fe17-4af1-4795-8634-f5cae2027a6a admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:59.152353 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: WARNING keystone.server.flask.application [None req-ac32fe17-4af1-4795-8634-f5cae2027a6a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 16:37:59.153852 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 419/851] 10.222.0.58 () {56 vars in 1129 bytes} [Tue Oct 12 16:37:59 2021] GET /identity/v3/domains/Default => generated 87 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:37:59.160645 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c9d373-71d1-409c-9276-1ab89700a064 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:59.170736 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c9d373-71d1-409c-9276-1ab89700a064 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:59.176286 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90988bd-d03c-48c5-b032-4c6c09baffaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:59.177107 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90988bd-d03c-48c5-b032-4c6c09baffaa admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:59.177561 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90988bd-d03c-48c5-b032-4c6c09baffaa admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:59.178020 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90988bd-d03c-48c5-b032-4c6c09baffaa admin admin] PATH_INFO: `/v3/domains` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:59.178907 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90988bd-d03c-48c5-b032-4c6c09baffaa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:37:59.179361 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90988bd-d03c-48c5-b032-4c6c09baffaa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:59.181086 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90988bd-d03c-48c5-b032-4c6c09baffaa admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:59.194286 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 433/852] 10.222.0.58 () {56 vars in 1130 bytes} [Tue Oct 12 16:37:59 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:37:59.200591 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac32fe17-4af1-4795-8634-f5cae2027a6a admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:59.210855 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac32fe17-4af1-4795-8634-f5cae2027a6a admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:59.215604 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c93784c-7254-478e-b108-942be2c79d3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:59.216557 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c93784c-7254-478e-b108-942be2c79d3f admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:59.217011 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c93784c-7254-478e-b108-942be2c79d3f admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:59.217428 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c93784c-7254-478e-b108-942be2c79d3f admin admin] PATH_INFO: `/v3/projects/service` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:59.226196 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c93784c-7254-478e-b108-942be2c79d3f admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:59.228443 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c93784c-7254-478e-b108-942be2c79d3f admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:59.243798 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: WARNING keystone.server.flask.application [None req-0c93784c-7254-478e-b108-942be2c79d3f admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 16:37:59.245675 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 420/853] 10.222.0.58 () {56 vars in 1132 bytes} [Tue Oct 12 16:37:59 2021] GET /identity/v3/projects/service => generated 88 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:37:59.252848 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90988bd-d03c-48c5-b032-4c6c09baffaa admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:59.263634 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90988bd-d03c-48c5-b032-4c6c09baffaa admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:59.268503 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fc7586-f92c-4cf7-9d41-154f58bab4f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:59.269333 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fc7586-f92c-4cf7-9d41-154f58bab4f6 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:59.269792 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fc7586-f92c-4cf7-9d41-154f58bab4f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:59.270401 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fc7586-f92c-4cf7-9d41-154f58bab4f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:59.271362 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fc7586-f92c-4cf7-9d41-154f58bab4f6 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=85204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:37:59.271838 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fc7586-f92c-4cf7-9d41-154f58bab4f6 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:59.273801 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fc7586-f92c-4cf7-9d41-154f58bab4f6 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:59.287170 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 434/854] 10.222.0.58 () {56 vars in 1169 bytes} [Tue Oct 12 16:37:59 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:37:59.293977 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c93784c-7254-478e-b108-942be2c79d3f admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:59.305415 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c93784c-7254-478e-b108-942be2c79d3f admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:59.310192 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8937bc37-d190-4466-80a1-1fa631c062a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:59.311144 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8937bc37-d190-4466-80a1-1fa631c062a5 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:59.311621 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8937bc37-d190-4466-80a1-1fa631c062a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:59.312048 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8937bc37-d190-4466-80a1-1fa631c062a5 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:59.313114 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8937bc37-d190-4466-80a1-1fa631c062a5 admin admin] RBAC: Adding query filter params (role.id=5ad80b06c65f492a927df805eb69866c, scope.project.id=f3531f242eaa43b69562d70bca5ec5a8, user.id=387a65d2bfb142499c9b3b0ac946f48b) {{(pid=85205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:37:59.313572 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8937bc37-d190-4466-80a1-1fa631c062a5 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:59.315573 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8937bc37-d190-4466-80a1-1fa631c062a5 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:59.322436 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 421/855] 10.222.0.58 () {56 vars in 1395 bytes} [Tue Oct 12 16:37:59 2021] GET /identity/v3/role_assignments?user.id=387a65d2bfb142499c9b3b0ac946f48b&scope.project.id=f3531f242eaa43b69562d70bca5ec5a8&role.id=5ad80b06c65f492a927df805eb69866c => generated 608 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:37:59.378852 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f29528-712a-4947-bf79-cb6a38559b72 None None] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:59.379304 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f29528-712a-4947-bf79-cb6a38559b72 None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:59.379680 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f29528-712a-4947-bf79-cb6a38559b72 None None] PATH_INFO: `/` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:59.381960 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 435/856] 10.222.0.58 () {54 vars in 926 bytes} [Tue Oct 12 16:37:59 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:37:59.388734 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5179f304-6ede-468f-b4ac-ba500412eb50 None None] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:59.389080 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5179f304-6ede-468f-b4ac-ba500412eb50 None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:59.389453 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5179f304-6ede-468f-b4ac-ba500412eb50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:59.408271 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.auth.core [None req-5179f304-6ede-468f-b4ac-ba500412eb50 None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:37:59.409643 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-5179f304-6ede-468f-b4ac-ba500412eb50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:37:59.418224 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 422/857] 10.222.0.58 () {58 vars in 1023 bytes} [Tue Oct 12 16:37:59 2021] POST /identity/v3/auth/tokens => generated 2291 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:37:59.442471 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f29528-712a-4947-bf79-cb6a38559b72 None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:59.456385 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f29528-712a-4947-bf79-cb6a38559b72 None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:59.461335 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec51114-20da-4ffc-8b0d-508bbcb8d8ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:59.462354 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec51114-20da-4ffc-8b0d-508bbcb8d8ac admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:59.462793 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec51114-20da-4ffc-8b0d-508bbcb8d8ac admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:59.463161 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec51114-20da-4ffc-8b0d-508bbcb8d8ac admin admin] PATH_INFO: `/v3/services/compute` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:59.463984 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec51114-20da-4ffc-8b0d-508bbcb8d8ac admin admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:59.465724 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec51114-20da-4ffc-8b0d-508bbcb8d8ac admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:59.478414 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: WARNING keystone.server.flask.application [None req-1ec51114-20da-4ffc-8b0d-508bbcb8d8ac admin admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 12 16:37:59.480140 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 436/858] 10.222.0.58 () {56 vars in 1132 bytes} [Tue Oct 12 16:37:59 2021] GET /identity/v3/services/compute => generated 88 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:37:59.487051 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5179f304-6ede-468f-b4ac-ba500412eb50 None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:59.496477 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5179f304-6ede-468f-b4ac-ba500412eb50 None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:59.501409 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b57a5b-e14c-4a2a-9daf-18ae9e215313 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:59.502552 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b57a5b-e14c-4a2a-9daf-18ae9e215313 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:59.502834 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b57a5b-e14c-4a2a-9daf-18ae9e215313 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:59.503164 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b57a5b-e14c-4a2a-9daf-18ae9e215313 admin admin] PATH_INFO: `/v3/services` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:59.503898 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b57a5b-e14c-4a2a-9daf-18ae9e215313 admin admin] RBAC: Adding query filter params (name=compute) {{(pid=85205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:37:59.504209 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b57a5b-e14c-4a2a-9daf-18ae9e215313 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:59.505868 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b57a5b-e14c-4a2a-9daf-18ae9e215313 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:59.511356 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 423/859] 10.222.0.58 () {56 vars in 1133 bytes} [Tue Oct 12 16:37:59 2021] GET /identity/v3/services?name=compute => generated 124 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 16:37:59.518710 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec51114-20da-4ffc-8b0d-508bbcb8d8ac admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:59.530117 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec51114-20da-4ffc-8b0d-508bbcb8d8ac admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:59.540108 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c44da6e-b03d-4218-9ad7-48d147fbb684 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:59.540783 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c44da6e-b03d-4218-9ad7-48d147fbb684 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:59.541106 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c44da6e-b03d-4218-9ad7-48d147fbb684 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:59.541495 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c44da6e-b03d-4218-9ad7-48d147fbb684 admin admin] PATH_INFO: `/v3/services` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:59.542301 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c44da6e-b03d-4218-9ad7-48d147fbb684 admin admin] RBAC: Adding query filter params (type=compute) {{(pid=85204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:37:59.542609 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c44da6e-b03d-4218-9ad7-48d147fbb684 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:59.544192 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c44da6e-b03d-4218-9ad7-48d147fbb684 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:59.551367 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 437/860] 10.222.0.58 () {56 vars in 1133 bytes} [Tue Oct 12 16:37:59 2021] GET /identity/v3/services?type=compute => generated 124 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:38:00.736103 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07192e9-f628-4c58-9e29-04fcb88506e9 None None] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:00.736991 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07192e9-f628-4c58-9e29-04fcb88506e9 None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:00.737412 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07192e9-f628-4c58-9e29-04fcb88506e9 None None] PATH_INFO: `/` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:00.739833 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 424/861] 10.222.0.58 () {54 vars in 926 bytes} [Tue Oct 12 16:38:00 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:38:00.747469 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2e4bf2-80e7-49c5-a119-9280c7ed9424 None None] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:00.748314 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2e4bf2-80e7-49c5-a119-9280c7ed9424 None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:00.748716 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2e4bf2-80e7-49c5-a119-9280c7ed9424 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:00.772176 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.auth.core [None req-4a2e4bf2-80e7-49c5-a119-9280c7ed9424 None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:38:00.773516 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-4a2e4bf2-80e7-49c5-a119-9280c7ed9424 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:38:00.781971 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 438/862] 10.222.0.58 () {58 vars in 1023 bytes} [Tue Oct 12 16:38:00 2021] POST /identity/v3/auth/tokens => generated 2291 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:38:00.805397 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07192e9-f628-4c58-9e29-04fcb88506e9 None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:38:00.820145 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07192e9-f628-4c58-9e29-04fcb88506e9 None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:38:00.824708 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7c14f9-ca7e-42ff-b598-e62013295e1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:38:00.825612 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7c14f9-ca7e-42ff-b598-e62013295e1e admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:00.826040 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7c14f9-ca7e-42ff-b598-e62013295e1e admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:00.826417 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7c14f9-ca7e-42ff-b598-e62013295e1e admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:00.827189 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7c14f9-ca7e-42ff-b598-e62013295e1e admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:38:00.829434 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7c14f9-ca7e-42ff-b598-e62013295e1e admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:38:00.841208 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: WARNING keystone.server.flask.application [None req-4b7c14f9-ca7e-42ff-b598-e62013295e1e admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 12 16:38:00.842874 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 425/863] 10.222.0.58 () {56 vars in 1147 bytes} [Tue Oct 12 16:38:00 2021] GET /identity/v3/services/object-store => generated 93 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:38:00.849559 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2e4bf2-80e7-49c5-a119-9280c7ed9424 None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:38:00.858509 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2e4bf2-80e7-49c5-a119-9280c7ed9424 None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:38:00.863111 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35214a0d-03a9-43e6-885f-c5bd31c49c1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:38:00.863765 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35214a0d-03a9-43e6-885f-c5bd31c49c1a admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:00.864046 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35214a0d-03a9-43e6-885f-c5bd31c49c1a admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:00.864317 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35214a0d-03a9-43e6-885f-c5bd31c49c1a admin admin] PATH_INFO: `/v3/services` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:00.865030 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35214a0d-03a9-43e6-885f-c5bd31c49c1a admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=85204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:38:00.865338 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35214a0d-03a9-43e6-885f-c5bd31c49c1a admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:38:00.866945 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35214a0d-03a9-43e6-885f-c5bd31c49c1a admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:38:00.877622 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 439/864] 10.222.0.58 () {56 vars in 1143 bytes} [Tue Oct 12 16:38:00 2021] GET /identity/v3/services?name=object-store => generated 129 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:38:00.878945 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7c14f9-ca7e-42ff-b598-e62013295e1e admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:38:00.888784 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7c14f9-ca7e-42ff-b598-e62013295e1e admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:38:00.897201 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1324857a-a36a-4b5d-ac86-e142adb9a862 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:38:00.898127 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1324857a-a36a-4b5d-ac86-e142adb9a862 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:00.898619 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1324857a-a36a-4b5d-ac86-e142adb9a862 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:00.899102 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1324857a-a36a-4b5d-ac86-e142adb9a862 admin admin] PATH_INFO: `/v3/services` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:00.900007 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1324857a-a36a-4b5d-ac86-e142adb9a862 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=85205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:38:00.900528 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1324857a-a36a-4b5d-ac86-e142adb9a862 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:38:00.902324 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1324857a-a36a-4b5d-ac86-e142adb9a862 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:38:00.912891 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 426/865] 10.222.0.58 () {56 vars in 1143 bytes} [Tue Oct 12 16:38:00 2021] GET /identity/v3/services?type=object-store => generated 356 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 16:38:00.914812 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35214a0d-03a9-43e6-885f-c5bd31c49c1a admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:38:00.925289 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35214a0d-03a9-43e6-885f-c5bd31c49c1a admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:38:00.929991 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235981ca-a21a-4615-b51c-7beb36ca3254 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:38:00.930867 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235981ca-a21a-4615-b51c-7beb36ca3254 admin admin] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:00.931346 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235981ca-a21a-4615-b51c-7beb36ca3254 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:00.931833 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235981ca-a21a-4615-b51c-7beb36ca3254 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:00.932780 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235981ca-a21a-4615-b51c-7beb36ca3254 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:38:00.934580 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235981ca-a21a-4615-b51c-7beb36ca3254 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:38:00.962058 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 440/866] 10.222.0.58 () {60 vars in 1165 bytes} [Tue Oct 12 16:38:00 2021] POST /identity/v3/endpoints => generated 349 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 16:38:01.175850 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28735c4-832c-4e53-bdba-8a4cd7823953 None None] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:01.176190 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28735c4-832c-4e53-bdba-8a4cd7823953 None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:01.176417 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28735c4-832c-4e53-bdba-8a4cd7823953 None None] PATH_INFO: `/` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:01.178506 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 427/867] 10.222.0.58 () {54 vars in 926 bytes} [Tue Oct 12 16:38:01 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:38:01.184475 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16d8408-fe8c-42c6-8d7b-76b045f04e6c None None] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:01.184777 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16d8408-fe8c-42c6-8d7b-76b045f04e6c None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:01.185058 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16d8408-fe8c-42c6-8d7b-76b045f04e6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:01.203613 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.auth.core [None req-c16d8408-fe8c-42c6-8d7b-76b045f04e6c None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:38:01.204855 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-c16d8408-fe8c-42c6-8d7b-76b045f04e6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:38:01.222245 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 441/868] 10.222.0.58 () {58 vars in 1023 bytes} [Tue Oct 12 16:38:01 2021] POST /identity/v3/auth/tokens => generated 2480 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:38:01.247188 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28735c4-832c-4e53-bdba-8a4cd7823953 None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:38:01.260551 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28735c4-832c-4e53-bdba-8a4cd7823953 None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:38:01.265383 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e18abc-58bf-445a-9b50-4d2f24eaaefd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:38:01.266080 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e18abc-58bf-445a-9b50-4d2f24eaaefd admin admin] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:01.266365 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e18abc-58bf-445a-9b50-4d2f24eaaefd admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:01.266643 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e18abc-58bf-445a-9b50-4d2f24eaaefd admin admin] PATH_INFO: `/v3/projects` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:01.267384 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e18abc-58bf-445a-9b50-4d2f24eaaefd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:38:01.269202 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e18abc-58bf-445a-9b50-4d2f24eaaefd admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:38:01.270588 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: WARNING keystone.server.flask.common [None req-16e18abc-58bf-445a-9b50-4d2f24eaaefd admin admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Oct 12 16:38:01.290268 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.sql.core [None req-16e18abc-58bf-445a-9b50-4d2f24eaaefd admin admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 12 16:38:01.290268 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 12 16:38:01.290268 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [parameters: {'id': 'e83a5bcdfa334a8db238580a24ee75fa', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Oct 12 16:38:01.290268 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=85205) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 12 16:38:01.298981 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: WARNING keystone.server.flask.application [None req-16e18abc-58bf-445a-9b50-4d2f24eaaefd admin admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id e83a5bcdfa334a8db238580a24ee75fa.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id e83a5bcdfa334a8db238580a24ee75fa. Oct 12 16:38:01.300674 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 428/869] 10.222.0.58 () {60 vars in 1161 bytes} [Tue Oct 12 16:38:01 2021] POST /identity/v3/projects => generated 262 bytes in 54 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:38:01.307316 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16d8408-fe8c-42c6-8d7b-76b045f04e6c None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:38:01.317202 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16d8408-fe8c-42c6-8d7b-76b045f04e6c None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:38:01.321983 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdba7f5-9d56-46b3-a9b9-9bd44a8f2022 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:38:01.322788 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdba7f5-9d56-46b3-a9b9-9bd44a8f2022 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:01.323074 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdba7f5-9d56-46b3-a9b9-9bd44a8f2022 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:01.323352 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdba7f5-9d56-46b3-a9b9-9bd44a8f2022 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:01.330711 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdba7f5-9d56-46b3-a9b9-9bd44a8f2022 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:38:01.332712 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdba7f5-9d56-46b3-a9b9-9bd44a8f2022 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:38:01.346614 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: WARNING keystone.server.flask.application [None req-bfdba7f5-9d56-46b3-a9b9-9bd44a8f2022 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 16:38:01.348084 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 442/870] 10.222.0.58 () {56 vars in 1132 bytes} [Tue Oct 12 16:38:01 2021] GET /identity/v3/projects/service => generated 88 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:38:01.355056 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e18abc-58bf-445a-9b50-4d2f24eaaefd admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:38:01.365929 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e18abc-58bf-445a-9b50-4d2f24eaaefd admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:38:01.370755 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6d4c60-b8cf-429e-8cd0-aa89f5d1a57a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:38:01.371467 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6d4c60-b8cf-429e-8cd0-aa89f5d1a57a admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:01.371754 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6d4c60-b8cf-429e-8cd0-aa89f5d1a57a admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:01.372034 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6d4c60-b8cf-429e-8cd0-aa89f5d1a57a admin admin] PATH_INFO: `/v3/projects` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:01.372868 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6d4c60-b8cf-429e-8cd0-aa89f5d1a57a admin admin] RBAC: Adding query filter params (name=service) {{(pid=85205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:38:01.373185 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6d4c60-b8cf-429e-8cd0-aa89f5d1a57a admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:38:01.375432 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6d4c60-b8cf-429e-8cd0-aa89f5d1a57a admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:38:01.397475 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 429/871] 10.222.0.58 () {56 vars in 1133 bytes} [Tue Oct 12 16:38:01 2021] GET /identity/v3/projects?name=service => generated 411 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:38:01.723611 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebb9c78-45ec-4e9c-846b-b99735c3b5fe None None] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:01.724001 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebb9c78-45ec-4e9c-846b-b99735c3b5fe None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:01.724179 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebb9c78-45ec-4e9c-846b-b99735c3b5fe None None] PATH_INFO: `/` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:01.725941 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 443/872] 10.222.0.58 () {54 vars in 926 bytes} [Tue Oct 12 16:38:01 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:38:01.732036 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b71519b-cd37-4dba-ba23-80526ea0405b None None] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:01.732333 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b71519b-cd37-4dba-ba23-80526ea0405b None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:01.732616 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b71519b-cd37-4dba-ba23-80526ea0405b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:01.757053 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.auth.core [None req-1b71519b-cd37-4dba-ba23-80526ea0405b None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:38:01.758635 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-1b71519b-cd37-4dba-ba23-80526ea0405b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:38:01.767554 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 430/873] 10.222.0.58 () {58 vars in 1023 bytes} [Tue Oct 12 16:38:01 2021] POST /identity/v3/auth/tokens => generated 2480 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:38:01.791442 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebb9c78-45ec-4e9c-846b-b99735c3b5fe None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:38:01.804353 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebb9c78-45ec-4e9c-846b-b99735c3b5fe None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:38:01.809280 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1db60f-bc6c-4549-86dc-bab84e38767a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:38:01.810224 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1db60f-bc6c-4549-86dc-bab84e38767a admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:01.810509 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1db60f-bc6c-4549-86dc-bab84e38767a admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:01.810791 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1db60f-bc6c-4549-86dc-bab84e38767a admin admin] PATH_INFO: `/v3/services/image` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:01.811685 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1db60f-bc6c-4549-86dc-bab84e38767a admin admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:38:01.813305 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1db60f-bc6c-4549-86dc-bab84e38767a admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:38:01.824660 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: WARNING keystone.server.flask.application [None req-8d1db60f-bc6c-4549-86dc-bab84e38767a admin admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 12 16:38:01.826369 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689fe7f8-b646-470f-94ac-abf2272cc061 None None] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:01.826656 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689fe7f8-b646-470f-94ac-abf2272cc061 None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:01.826932 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689fe7f8-b646-470f-94ac-abf2272cc061 None None] PATH_INFO: `/` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:01.827361 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 444/874] 10.222.0.58 () {56 vars in 1126 bytes} [Tue Oct 12 16:38:01 2021] GET /identity/v3/services/image => generated 86 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:38:01.829555 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 431/875] 10.222.0.58 () {54 vars in 926 bytes} [Tue Oct 12 16:38:01 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 12 16:38:01.835416 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1db60f-bc6c-4549-86dc-bab84e38767a admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:38:01.835941 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae509e01-177b-4c35-85f0-9d9abc65e756 None None] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:01.837888 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae509e01-177b-4c35-85f0-9d9abc65e756 None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:01.837888 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae509e01-177b-4c35-85f0-9d9abc65e756 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:01.846469 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1db60f-bc6c-4549-86dc-bab84e38767a admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:38:01.851280 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f20fb51-9bb4-4a42-83f7-545697320a7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:38:01.852116 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f20fb51-9bb4-4a42-83f7-545697320a7f admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:01.852768 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f20fb51-9bb4-4a42-83f7-545697320a7f admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:01.853196 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f20fb51-9bb4-4a42-83f7-545697320a7f admin admin] PATH_INFO: `/v3/services` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:01.854091 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f20fb51-9bb4-4a42-83f7-545697320a7f admin admin] RBAC: Adding query filter params (name=image) {{(pid=85204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:38:01.854537 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f20fb51-9bb4-4a42-83f7-545697320a7f admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:38:01.855923 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.auth.core [None req-ae509e01-177b-4c35-85f0-9d9abc65e756 None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:38:01.856543 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f20fb51-9bb4-4a42-83f7-545697320a7f admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:38:01.857311 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-ae509e01-177b-4c35-85f0-9d9abc65e756 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:38:01.867882 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 445/876] 10.222.0.58 () {56 vars in 1129 bytes} [Tue Oct 12 16:38:01 2021] GET /identity/v3/services?name=image => generated 122 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:38:01.869458 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f20fb51-9bb4-4a42-83f7-545697320a7f admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:38:01.870506 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 432/877] 10.222.0.58 () {58 vars in 1023 bytes} [Tue Oct 12 16:38:01 2021] POST /identity/v3/auth/tokens => generated 2480 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:38:01.879706 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f20fb51-9bb4-4a42-83f7-545697320a7f admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:38:01.884408 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0566e06d-3c7e-427b-a634-28151dfb83dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:38:01.885396 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0566e06d-3c7e-427b-a634-28151dfb83dd admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:01.885916 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0566e06d-3c7e-427b-a634-28151dfb83dd admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:01.886400 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0566e06d-3c7e-427b-a634-28151dfb83dd admin admin] PATH_INFO: `/v3/services` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:01.887324 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0566e06d-3c7e-427b-a634-28151dfb83dd admin admin] RBAC: Adding query filter params (type=image) {{(pid=85204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:38:01.887824 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0566e06d-3c7e-427b-a634-28151dfb83dd admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:38:01.889609 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0566e06d-3c7e-427b-a634-28151dfb83dd admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:38:01.895040 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae509e01-177b-4c35-85f0-9d9abc65e756 None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:38:01.895704 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 446/878] 10.222.0.58 () {56 vars in 1129 bytes} [Tue Oct 12 16:38:01 2021] GET /identity/v3/services?type=image => generated 122 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 16:38:01.905336 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae509e01-177b-4c35-85f0-9d9abc65e756 None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:38:01.911044 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0b1e93-c6fc-43f8-8307-0fd4384f7ca1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:38:01.911730 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0b1e93-c6fc-43f8-8307-0fd4384f7ca1 admin admin] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:01.912058 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0b1e93-c6fc-43f8-8307-0fd4384f7ca1 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:01.912340 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0b1e93-c6fc-43f8-8307-0fd4384f7ca1 admin admin] PATH_INFO: `/v3/services` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:01.913111 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0b1e93-c6fc-43f8-8307-0fd4384f7ca1 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:38:01.914912 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0b1e93-c6fc-43f8-8307-0fd4384f7ca1 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:38:01.932786 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 433/879] 10.222.0.58 () {60 vars in 1162 bytes} [Tue Oct 12 16:38:01 2021] POST /identity/v3/services => generated 242 bytes in 38 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:38:03.301557 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d330e8e6-ce0d-47ca-ade1-454a0fa91bc5 None None] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:03.302132 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d330e8e6-ce0d-47ca-ade1-454a0fa91bc5 None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:03.302132 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d330e8e6-ce0d-47ca-ade1-454a0fa91bc5 None None] PATH_INFO: `/` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:03.304192 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 447/880] 10.222.0.58 () {54 vars in 926 bytes} [Tue Oct 12 16:38:03 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:38:03.310265 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dce5e4-60a0-4d39-a6d9-f2c201e9e6f4 None None] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:03.310699 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dce5e4-60a0-4d39-a6d9-f2c201e9e6f4 None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:03.310882 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dce5e4-60a0-4d39-a6d9-f2c201e9e6f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:03.329150 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.auth.core [None req-84dce5e4-60a0-4d39-a6d9-f2c201e9e6f4 None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:38:03.330375 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-84dce5e4-60a0-4d39-a6d9-f2c201e9e6f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:38:03.347908 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 434/881] 10.222.0.58 () {58 vars in 1023 bytes} [Tue Oct 12 16:38:03 2021] POST /identity/v3/auth/tokens => generated 2576 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:38:03.372653 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d330e8e6-ce0d-47ca-ade1-454a0fa91bc5 None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:38:03.385724 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d330e8e6-ce0d-47ca-ade1-454a0fa91bc5 None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:38:03.390759 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed48a7a0-c0ca-464e-ab81-bc0ddef86df4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:38:03.391547 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed48a7a0-c0ca-464e-ab81-bc0ddef86df4 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:03.391832 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed48a7a0-c0ca-464e-ab81-bc0ddef86df4 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:03.392113 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed48a7a0-c0ca-464e-ab81-bc0ddef86df4 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:03.392782 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed48a7a0-c0ca-464e-ab81-bc0ddef86df4 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:38:03.394453 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed48a7a0-c0ca-464e-ab81-bc0ddef86df4 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:38:03.406132 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: WARNING keystone.server.flask.application [None req-ed48a7a0-c0ca-464e-ab81-bc0ddef86df4 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 12 16:38:03.407615 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 448/882] 10.222.0.58 () {56 vars in 1147 bytes} [Tue Oct 12 16:38:03 2021] GET /identity/v3/services/object-store => generated 93 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:38:03.414195 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dce5e4-60a0-4d39-a6d9-f2c201e9e6f4 None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:38:03.423323 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dce5e4-60a0-4d39-a6d9-f2c201e9e6f4 None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:38:03.428040 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8386e9-c22e-41f8-9fc1-9ff3f0804809 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:38:03.428690 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8386e9-c22e-41f8-9fc1-9ff3f0804809 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:03.428973 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8386e9-c22e-41f8-9fc1-9ff3f0804809 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:03.429249 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8386e9-c22e-41f8-9fc1-9ff3f0804809 admin admin] PATH_INFO: `/v3/services` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:03.430001 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8386e9-c22e-41f8-9fc1-9ff3f0804809 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=85205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:38:03.430315 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8386e9-c22e-41f8-9fc1-9ff3f0804809 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:38:03.431887 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8386e9-c22e-41f8-9fc1-9ff3f0804809 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:38:03.437180 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 435/883] 10.222.0.58 () {56 vars in 1143 bytes} [Tue Oct 12 16:38:03 2021] GET /identity/v3/services?name=object-store => generated 129 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:38:03.443275 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed48a7a0-c0ca-464e-ab81-bc0ddef86df4 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:38:03.453657 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed48a7a0-c0ca-464e-ab81-bc0ddef86df4 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:38:03.458411 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c44a9e-1c00-4218-946e-b795c45f2c27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:38:03.459072 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c44a9e-1c00-4218-946e-b795c45f2c27 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:03.459359 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c44a9e-1c00-4218-946e-b795c45f2c27 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:03.459638 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c44a9e-1c00-4218-946e-b795c45f2c27 admin admin] PATH_INFO: `/v3/services` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:03.460366 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c44a9e-1c00-4218-946e-b795c45f2c27 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=85204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:38:03.460675 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c44a9e-1c00-4218-946e-b795c45f2c27 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:38:03.462290 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c44a9e-1c00-4218-946e-b795c45f2c27 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:38:03.467687 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 449/884] 10.222.0.58 () {56 vars in 1143 bytes} [Tue Oct 12 16:38:03 2021] GET /identity/v3/services?type=object-store => generated 356 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 16:38:03.474763 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8386e9-c22e-41f8-9fc1-9ff3f0804809 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:38:03.484588 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8386e9-c22e-41f8-9fc1-9ff3f0804809 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:38:03.489352 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72641d6a-c541-4c1c-96d4-2acac4ce158a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:38:03.490094 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72641d6a-c541-4c1c-96d4-2acac4ce158a admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:03.490383 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72641d6a-c541-4c1c-96d4-2acac4ce158a admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:03.490718 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72641d6a-c541-4c1c-96d4-2acac4ce158a admin admin] PATH_INFO: `/v3/endpoints` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:03.491522 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72641d6a-c541-4c1c-96d4-2acac4ce158a admin admin] RBAC: Adding query filter params (interface=admin, service_id=9eb618776d42489b8d4e5c1bafb4b2e0, region_id=RegionOne) {{(pid=85205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:38:03.491836 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72641d6a-c541-4c1c-96d4-2acac4ce158a admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:38:03.493470 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72641d6a-c541-4c1c-96d4-2acac4ce158a admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:38:03.499069 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 436/885] 10.222.0.58 () {56 vars in 1270 bytes} [Tue Oct 12 16:38:03 2021] GET /identity/v3/endpoints?service_id=9eb618776d42489b8d4e5c1bafb4b2e0&interface=admin®ion_id=RegionOne => generated 193 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:38:03.505589 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c44a9e-1c00-4218-946e-b795c45f2c27 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:38:03.515989 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c44a9e-1c00-4218-946e-b795c45f2c27 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:38:03.520610 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cc221f-928a-4571-bcac-1102c03a0675 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:38:03.521324 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cc221f-928a-4571-bcac-1102c03a0675 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:03.521688 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cc221f-928a-4571-bcac-1102c03a0675 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:03.522041 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cc221f-928a-4571-bcac-1102c03a0675 admin admin] PATH_INFO: `/v3/services` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:03.522745 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cc221f-928a-4571-bcac-1102c03a0675 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:38:03.524323 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cc221f-928a-4571-bcac-1102c03a0675 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:38:03.531879 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 450/886] 10.222.0.58 () {56 vars in 1108 bytes} [Tue Oct 12 16:38:03 2021] GET /identity/v3/services => generated 1727 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:38:03.737425 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26be1175-f6cc-4003-ac69-186c841f090e None None] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:03.737793 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26be1175-f6cc-4003-ac69-186c841f090e None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:03.738019 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26be1175-f6cc-4003-ac69-186c841f090e None None] PATH_INFO: `/` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:03.742716 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 437/887] 10.222.0.58 () {54 vars in 926 bytes} [Tue Oct 12 16:38:03 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:38:03.749101 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994a973a-2efc-4bb2-b60b-89f4f8868ed7 None None] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:03.750184 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994a973a-2efc-4bb2-b60b-89f4f8868ed7 None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:03.750463 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994a973a-2efc-4bb2-b60b-89f4f8868ed7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:03.768848 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.auth.core [None req-994a973a-2efc-4bb2-b60b-89f4f8868ed7 None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:38:03.770074 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-994a973a-2efc-4bb2-b60b-89f4f8868ed7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:38:03.778487 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 451/888] 10.222.0.58 () {58 vars in 1023 bytes} [Tue Oct 12 16:38:03 2021] POST /identity/v3/auth/tokens => generated 2576 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:38:03.804604 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26be1175-f6cc-4003-ac69-186c841f090e None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:38:03.823026 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26be1175-f6cc-4003-ac69-186c841f090e None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:38:03.828412 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20069ed5-e55d-4188-8b56-7000a2d1c9a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:38:03.829354 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20069ed5-e55d-4188-8b56-7000a2d1c9a2 admin admin] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:03.829841 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20069ed5-e55d-4188-8b56-7000a2d1c9a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:03.830347 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20069ed5-e55d-4188-8b56-7000a2d1c9a2 admin admin] PATH_INFO: `/v3/users` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:03.831289 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20069ed5-e55d-4188-8b56-7000a2d1c9a2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:38:03.833334 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20069ed5-e55d-4188-8b56-7000a2d1c9a2 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:38:03.847960 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.sql.core [None req-20069ed5-e55d-4188-8b56-7000a2d1c9a2 admin admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 12 16:38:03.847960 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Oct 12 16:38:03.847960 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [parameters: {'user_id': '1239755e15684e65b58aed3cbdc9e310', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Oct 12 16:38:03.847960 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=85205) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 12 16:38:03.854605 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: WARNING keystone.server.flask.application [None req-20069ed5-e55d-4188-8b56-7000a2d1c9a2 admin admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Oct 12 16:38:03.856504 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 438/889] 10.222.0.58 () {60 vars in 1152 bytes} [Tue Oct 12 16:38:03 2021] POST /identity/v3/users => generated 160 bytes in 52 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:38:03.867290 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994a973a-2efc-4bb2-b60b-89f4f8868ed7 None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:38:03.877973 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994a973a-2efc-4bb2-b60b-89f4f8868ed7 None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:38:03.882962 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deea9e94-e25c-4a95-a6db-a5b7f91d681a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:38:03.884446 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deea9e94-e25c-4a95-a6db-a5b7f91d681a admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:03.884960 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deea9e94-e25c-4a95-a6db-a5b7f91d681a admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:03.885450 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deea9e94-e25c-4a95-a6db-a5b7f91d681a admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:03.894507 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deea9e94-e25c-4a95-a6db-a5b7f91d681a admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:38:03.896829 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deea9e94-e25c-4a95-a6db-a5b7f91d681a admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:38:03.910691 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: WARNING keystone.server.flask.application [None req-deea9e94-e25c-4a95-a6db-a5b7f91d681a admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 12 16:38:03.912509 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 452/890] 10.222.0.58 () {56 vars in 1120 bytes} [Tue Oct 12 16:38:03 2021] GET /identity/v3/users/cinder => generated 84 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:38:03.918942 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20069ed5-e55d-4188-8b56-7000a2d1c9a2 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:38:03.930602 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20069ed5-e55d-4188-8b56-7000a2d1c9a2 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:38:03.935339 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c740941b-639b-4389-b4eb-a224fb588522 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:38:03.935997 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c740941b-639b-4389-b4eb-a224fb588522 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:03.936282 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c740941b-639b-4389-b4eb-a224fb588522 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:03.936653 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c740941b-639b-4389-b4eb-a224fb588522 admin admin] PATH_INFO: `/v3/users` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:03.938048 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c740941b-639b-4389-b4eb-a224fb588522 admin admin] RBAC: Adding query filter params (name=cinder) {{(pid=85205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:38:03.938361 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c740941b-639b-4389-b4eb-a224fb588522 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:38:03.940448 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c740941b-639b-4389-b4eb-a224fb588522 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:38:03.978881 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 439/891] 10.222.0.58 () {56 vars in 1122 bytes} [Tue Oct 12 16:38:03 2021] GET /identity/v3/users?name=cinder => generated 354 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:38:04.245266 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11f3a76-b92f-48e3-a692-793cca49daf2 None None] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:04.245652 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11f3a76-b92f-48e3-a692-793cca49daf2 None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:04.245830 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11f3a76-b92f-48e3-a692-793cca49daf2 None None] PATH_INFO: `/` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:04.247631 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 453/892] 10.222.0.58 () {54 vars in 926 bytes} [Tue Oct 12 16:38:04 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:38:04.255035 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9605e9-2627-4630-8372-ce367f188f6c None None] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:04.255324 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9605e9-2627-4630-8372-ce367f188f6c None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:04.255602 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9605e9-2627-4630-8372-ce367f188f6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:04.279382 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.auth.core [None req-2e9605e9-2627-4630-8372-ce367f188f6c None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:38:04.281659 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-2e9605e9-2627-4630-8372-ce367f188f6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:38:04.287787 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3738087-4b04-49eb-a374-ac1910ed77bf None None] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:04.288084 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3738087-4b04-49eb-a374-ac1910ed77bf None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:04.288365 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3738087-4b04-49eb-a374-ac1910ed77bf None None] PATH_INFO: `/` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:04.290158 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 454/893] 10.222.0.58 () {54 vars in 926 bytes} [Tue Oct 12 16:38:04 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 12 16:38:04.296603 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8753731d-0a48-4cf6-ae27-2cd1442b5b5d None None] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:04.296902 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 440/894] 10.222.0.58 () {58 vars in 1023 bytes} [Tue Oct 12 16:38:04 2021] POST /identity/v3/auth/tokens => generated 2576 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:38:04.297069 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8753731d-0a48-4cf6-ae27-2cd1442b5b5d None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:04.297230 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8753731d-0a48-4cf6-ae27-2cd1442b5b5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:04.317002 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.auth.core [None req-8753731d-0a48-4cf6-ae27-2cd1442b5b5d None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:38:04.319416 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9605e9-2627-4630-8372-ce367f188f6c None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:38:04.321848 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-8753731d-0a48-4cf6-ae27-2cd1442b5b5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:38:04.328422 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9605e9-2627-4630-8372-ce367f188f6c None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:38:04.332946 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14ac9da-5256-42a1-89cd-8aa4294c9990 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:38:04.333594 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14ac9da-5256-42a1-89cd-8aa4294c9990 admin admin] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:04.333820 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 455/895] 10.222.0.58 () {58 vars in 1023 bytes} [Tue Oct 12 16:38:04 2021] POST /identity/v3/auth/tokens => generated 2576 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:38:04.333939 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14ac9da-5256-42a1-89cd-8aa4294c9990 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:04.334161 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14ac9da-5256-42a1-89cd-8aa4294c9990 admin admin] PATH_INFO: `/v3/services` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:04.334899 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14ac9da-5256-42a1-89cd-8aa4294c9990 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:38:04.336514 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14ac9da-5256-42a1-89cd-8aa4294c9990 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:38:04.353901 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 441/896] 10.222.0.58 () {60 vars in 1162 bytes} [Tue Oct 12 16:38:04 2021] POST /identity/v3/services => generated 242 bytes in 32 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 16:38:04.362080 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8753731d-0a48-4cf6-ae27-2cd1442b5b5d None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:38:04.380668 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8753731d-0a48-4cf6-ae27-2cd1442b5b5d None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:38:04.395463 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655b587c-4f8f-4295-aff5-5d11e829e80f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:38:04.396263 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655b587c-4f8f-4295-aff5-5d11e829e80f admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:04.396548 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655b587c-4f8f-4295-aff5-5d11e829e80f admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:04.396822 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655b587c-4f8f-4295-aff5-5d11e829e80f admin admin] PATH_INFO: `/v3/services/compute` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:04.397486 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655b587c-4f8f-4295-aff5-5d11e829e80f admin admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:38:04.399123 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655b587c-4f8f-4295-aff5-5d11e829e80f admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:38:04.411108 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: WARNING keystone.server.flask.application [None req-655b587c-4f8f-4295-aff5-5d11e829e80f admin admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 12 16:38:04.412571 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 456/897] 10.222.0.58 () {56 vars in 1132 bytes} [Tue Oct 12 16:38:04 2021] GET /identity/v3/services/compute => generated 88 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:38:04.419397 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14ac9da-5256-42a1-89cd-8aa4294c9990 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:38:04.431167 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14ac9da-5256-42a1-89cd-8aa4294c9990 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:38:04.435775 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f47c61-51fd-42ad-83eb-70d0131f07eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:38:04.436452 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f47c61-51fd-42ad-83eb-70d0131f07eb admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:04.436752 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f47c61-51fd-42ad-83eb-70d0131f07eb admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:04.437020 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f47c61-51fd-42ad-83eb-70d0131f07eb admin admin] PATH_INFO: `/v3/services` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:04.437753 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f47c61-51fd-42ad-83eb-70d0131f07eb admin admin] RBAC: Adding query filter params (name=compute) {{(pid=85205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:38:04.438110 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f47c61-51fd-42ad-83eb-70d0131f07eb admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:38:04.439727 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f47c61-51fd-42ad-83eb-70d0131f07eb admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:38:04.445577 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 442/898] 10.222.0.58 () {56 vars in 1133 bytes} [Tue Oct 12 16:38:04 2021] GET /identity/v3/services?name=compute => generated 124 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:38:04.452131 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655b587c-4f8f-4295-aff5-5d11e829e80f admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:38:04.462072 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655b587c-4f8f-4295-aff5-5d11e829e80f admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:38:04.466769 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369c9ecd-7de4-4f8e-a82e-a967fad1281e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:38:04.467442 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369c9ecd-7de4-4f8e-a82e-a967fad1281e admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:04.467725 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369c9ecd-7de4-4f8e-a82e-a967fad1281e admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:04.468567 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369c9ecd-7de4-4f8e-a82e-a967fad1281e admin admin] PATH_INFO: `/v3/services` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:04.469365 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369c9ecd-7de4-4f8e-a82e-a967fad1281e admin admin] RBAC: Adding query filter params (type=compute) {{(pid=85204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:38:04.469670 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369c9ecd-7de4-4f8e-a82e-a967fad1281e admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:38:04.471328 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369c9ecd-7de4-4f8e-a82e-a967fad1281e admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:38:04.478103 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 457/899] 10.222.0.58 () {56 vars in 1133 bytes} [Tue Oct 12 16:38:04 2021] GET /identity/v3/services?type=compute => generated 352 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:38:04.484942 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f47c61-51fd-42ad-83eb-70d0131f07eb admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:38:04.494831 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f47c61-51fd-42ad-83eb-70d0131f07eb admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:38:04.499614 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0265b15f-cf96-4a7b-8b06-8895082ddd1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:38:04.500302 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0265b15f-cf96-4a7b-8b06-8895082ddd1c admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:04.500653 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0265b15f-cf96-4a7b-8b06-8895082ddd1c admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:04.500997 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0265b15f-cf96-4a7b-8b06-8895082ddd1c admin admin] PATH_INFO: `/v3/endpoints` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:04.502192 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0265b15f-cf96-4a7b-8b06-8895082ddd1c admin admin] RBAC: Adding query filter params (interface=public, service_id=176f584ba3b54fe5b967c6422622e8ab, region_id=RegionOne) {{(pid=85205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:38:04.502572 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0265b15f-cf96-4a7b-8b06-8895082ddd1c admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:38:04.504265 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0265b15f-cf96-4a7b-8b06-8895082ddd1c admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:38:04.510260 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 443/900] 10.222.0.58 () {56 vars in 1272 bytes} [Tue Oct 12 16:38:04 2021] GET /identity/v3/endpoints?service_id=176f584ba3b54fe5b967c6422622e8ab&interface=public®ion_id=RegionOne => generated 194 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:38:04.516487 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369c9ecd-7de4-4f8e-a82e-a967fad1281e admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:38:04.526520 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369c9ecd-7de4-4f8e-a82e-a967fad1281e admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:38:04.531593 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079c82e6-d1ca-4972-ad6d-41ba5c6ccb9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:38:04.532265 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079c82e6-d1ca-4972-ad6d-41ba5c6ccb9c admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:04.532549 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079c82e6-d1ca-4972-ad6d-41ba5c6ccb9c admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:04.532823 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079c82e6-d1ca-4972-ad6d-41ba5c6ccb9c admin admin] PATH_INFO: `/v3/services` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:04.533520 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079c82e6-d1ca-4972-ad6d-41ba5c6ccb9c admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:38:04.535138 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079c82e6-d1ca-4972-ad6d-41ba5c6ccb9c admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:38:04.542773 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 458/901] 10.222.0.58 () {56 vars in 1108 bytes} [Tue Oct 12 16:38:04 2021] GET /identity/v3/services => generated 1957 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:38:05.861037 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aac61ef-7bf3-485f-9672-5913137b0760 None None] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:05.861548 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aac61ef-7bf3-485f-9672-5913137b0760 None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:05.861634 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aac61ef-7bf3-485f-9672-5913137b0760 None None] PATH_INFO: `/` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:05.863574 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 444/902] 10.222.0.58 () {54 vars in 926 bytes} [Tue Oct 12 16:38:05 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:38:05.869313 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaa2297-550d-44cd-b56b-c59bd9a5dc6f None None] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:05.869700 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaa2297-550d-44cd-b56b-c59bd9a5dc6f None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:05.869926 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaa2297-550d-44cd-b56b-c59bd9a5dc6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:05.887535 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.auth.core [None req-feaa2297-550d-44cd-b56b-c59bd9a5dc6f None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:38:05.888721 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-feaa2297-550d-44cd-b56b-c59bd9a5dc6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:38:05.896531 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 459/903] 10.222.0.58 () {58 vars in 1023 bytes} [Tue Oct 12 16:38:05 2021] POST /identity/v3/auth/tokens => generated 2672 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:38:05.920726 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aac61ef-7bf3-485f-9672-5913137b0760 None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:38:05.933219 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aac61ef-7bf3-485f-9672-5913137b0760 None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:38:05.937621 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3824ae31-7432-4b82-babb-6f4f832ebcb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:38:05.938435 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3824ae31-7432-4b82-babb-6f4f832ebcb1 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:05.938722 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3824ae31-7432-4b82-babb-6f4f832ebcb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:05.938998 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3824ae31-7432-4b82-babb-6f4f832ebcb1 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:05.939662 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3824ae31-7432-4b82-babb-6f4f832ebcb1 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:38:05.941213 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3824ae31-7432-4b82-babb-6f4f832ebcb1 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:38:05.952089 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: WARNING keystone.server.flask.application [None req-3824ae31-7432-4b82-babb-6f4f832ebcb1 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 12 16:38:05.953493 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 445/904] 10.222.0.58 () {56 vars in 1147 bytes} [Tue Oct 12 16:38:05 2021] GET /identity/v3/services/object-store => generated 93 bytes in 33 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:38:05.960018 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feaa2297-550d-44cd-b56b-c59bd9a5dc6f None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:38:05.969487 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feaa2297-550d-44cd-b56b-c59bd9a5dc6f None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:38:05.974008 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57656d8c-72f3-4b24-8a50-bbddebe8ae32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:38:05.974659 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57656d8c-72f3-4b24-8a50-bbddebe8ae32 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:05.974945 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57656d8c-72f3-4b24-8a50-bbddebe8ae32 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:05.975277 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57656d8c-72f3-4b24-8a50-bbddebe8ae32 admin admin] PATH_INFO: `/v3/services` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:05.975997 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57656d8c-72f3-4b24-8a50-bbddebe8ae32 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=85204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:38:05.976357 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57656d8c-72f3-4b24-8a50-bbddebe8ae32 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:38:05.978025 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57656d8c-72f3-4b24-8a50-bbddebe8ae32 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:38:05.985898 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 460/905] 10.222.0.58 () {56 vars in 1143 bytes} [Tue Oct 12 16:38:05 2021] GET /identity/v3/services?name=object-store => generated 129 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:38:05.989402 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3824ae31-7432-4b82-babb-6f4f832ebcb1 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:38:05.998742 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3824ae31-7432-4b82-babb-6f4f832ebcb1 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:38:06.003485 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fcc566-99ab-4629-a90e-42e30c558dc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:38:06.004127 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fcc566-99ab-4629-a90e-42e30c558dc9 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:06.004409 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fcc566-99ab-4629-a90e-42e30c558dc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:06.004681 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fcc566-99ab-4629-a90e-42e30c558dc9 admin admin] PATH_INFO: `/v3/services` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:06.005402 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fcc566-99ab-4629-a90e-42e30c558dc9 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=85205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:38:06.005710 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fcc566-99ab-4629-a90e-42e30c558dc9 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:38:06.007287 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fcc566-99ab-4629-a90e-42e30c558dc9 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:38:06.017957 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 446/906] 10.222.0.58 () {56 vars in 1143 bytes} [Tue Oct 12 16:38:05 2021] GET /identity/v3/services?type=object-store => generated 356 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:38:06.018418 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57656d8c-72f3-4b24-8a50-bbddebe8ae32 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:38:06.028063 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57656d8c-72f3-4b24-8a50-bbddebe8ae32 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:38:06.033145 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb39f4f-08d8-4f7f-8d80-a31b54dc106f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:38:06.033901 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb39f4f-08d8-4f7f-8d80-a31b54dc106f admin admin] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:06.034270 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb39f4f-08d8-4f7f-8d80-a31b54dc106f admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:06.034620 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb39f4f-08d8-4f7f-8d80-a31b54dc106f admin admin] PATH_INFO: `/v3/endpoints` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:06.035451 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb39f4f-08d8-4f7f-8d80-a31b54dc106f admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:38:06.037086 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb39f4f-08d8-4f7f-8d80-a31b54dc106f admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:38:06.052925 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 461/907] 10.222.0.58 () {60 vars in 1165 bytes} [Tue Oct 12 16:38:06 2021] POST /identity/v3/endpoints => generated 325 bytes in 35 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:38:06.633126 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63163278-46cf-4a1e-969e-7617a9a2701f None None] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:06.633518 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63163278-46cf-4a1e-969e-7617a9a2701f None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:06.633723 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63163278-46cf-4a1e-969e-7617a9a2701f None None] PATH_INFO: `/` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:06.635635 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 447/908] 10.222.0.58 () {54 vars in 926 bytes} [Tue Oct 12 16:38:06 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:38:06.642848 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311ba909-5d72-4182-9398-b742d14bf1fc None None] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:06.643179 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311ba909-5d72-4182-9398-b742d14bf1fc None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:06.643405 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311ba909-5d72-4182-9398-b742d14bf1fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:06.662800 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.auth.core [None req-311ba909-5d72-4182-9398-b742d14bf1fc None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:38:06.664030 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-311ba909-5d72-4182-9398-b742d14bf1fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:38:06.681043 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 462/909] 10.222.0.58 () {58 vars in 1023 bytes} [Tue Oct 12 16:38:06 2021] POST /identity/v3/auth/tokens => generated 2821 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:38:06.705048 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63163278-46cf-4a1e-969e-7617a9a2701f None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:38:06.716840 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63163278-46cf-4a1e-969e-7617a9a2701f None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:38:06.721138 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59c087e-7db8-437e-abdd-fc22f48ebaea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:38:06.721919 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59c087e-7db8-437e-abdd-fc22f48ebaea admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:06.722207 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59c087e-7db8-437e-abdd-fc22f48ebaea admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:06.722478 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59c087e-7db8-437e-abdd-fc22f48ebaea admin admin] PATH_INFO: `/v3/services/image` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:06.723136 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59c087e-7db8-437e-abdd-fc22f48ebaea admin admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:38:06.724704 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59c087e-7db8-437e-abdd-fc22f48ebaea admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:38:06.735238 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: WARNING keystone.server.flask.application [None req-c59c087e-7db8-437e-abdd-fc22f48ebaea admin admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 12 16:38:06.736563 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 448/910] 10.222.0.58 () {56 vars in 1126 bytes} [Tue Oct 12 16:38:06 2021] GET /identity/v3/services/image => generated 86 bytes in 32 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:38:06.742822 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311ba909-5d72-4182-9398-b742d14bf1fc None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:38:06.752499 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311ba909-5d72-4182-9398-b742d14bf1fc None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:38:06.756941 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb1890e-3b90-4304-be1f-6de40fb71200 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:38:06.757597 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb1890e-3b90-4304-be1f-6de40fb71200 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:06.757902 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb1890e-3b90-4304-be1f-6de40fb71200 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:06.758188 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb1890e-3b90-4304-be1f-6de40fb71200 admin admin] PATH_INFO: `/v3/services` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:06.758907 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb1890e-3b90-4304-be1f-6de40fb71200 admin admin] RBAC: Adding query filter params (name=image) {{(pid=85204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:38:06.759214 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb1890e-3b90-4304-be1f-6de40fb71200 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:38:06.760803 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb1890e-3b90-4304-be1f-6de40fb71200 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:38:06.766469 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 463/911] 10.222.0.58 () {56 vars in 1129 bytes} [Tue Oct 12 16:38:06 2021] GET /identity/v3/services?name=image => generated 122 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:38:06.772434 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59c087e-7db8-437e-abdd-fc22f48ebaea admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:38:06.781738 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e2d60b-ead7-4a93-bf3d-a602c6628cf4 None None] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:06.782057 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e2d60b-ead7-4a93-bf3d-a602c6628cf4 None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:06.782326 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e2d60b-ead7-4a93-bf3d-a602c6628cf4 None None] PATH_INFO: `/` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:06.783114 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59c087e-7db8-437e-abdd-fc22f48ebaea admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:38:06.784183 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 464/912] 10.222.0.58 () {54 vars in 926 bytes} [Tue Oct 12 16:38:06 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 12 16:38:06.787788 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b89b15-fb60-4795-a4d0-fd9cf4d18704 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:38:06.788499 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b89b15-fb60-4795-a4d0-fd9cf4d18704 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:06.788783 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b89b15-fb60-4795-a4d0-fd9cf4d18704 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:06.789052 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b89b15-fb60-4795-a4d0-fd9cf4d18704 admin admin] PATH_INFO: `/v3/services` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:06.789404 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa1dbe4-4e4f-431d-93b5-7741f6172e4f None None] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:06.789688 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa1dbe4-4e4f-431d-93b5-7741f6172e4f None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:06.789792 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b89b15-fb60-4795-a4d0-fd9cf4d18704 admin admin] RBAC: Adding query filter params (type=image) {{(pid=85205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:38:06.790003 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa1dbe4-4e4f-431d-93b5-7741f6172e4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:06.790096 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b89b15-fb60-4795-a4d0-fd9cf4d18704 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:38:06.791644 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b89b15-fb60-4795-a4d0-fd9cf4d18704 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:38:06.797299 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 449/913] 10.222.0.58 () {56 vars in 1129 bytes} [Tue Oct 12 16:38:06 2021] GET /identity/v3/services?type=image => generated 350 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 16:38:06.803793 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b89b15-fb60-4795-a4d0-fd9cf4d18704 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:38:06.810089 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.auth.core [None req-1fa1dbe4-4e4f-431d-93b5-7741f6172e4f None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:38:06.812358 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-1fa1dbe4-4e4f-431d-93b5-7741f6172e4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:38:06.813755 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b89b15-fb60-4795-a4d0-fd9cf4d18704 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:38:06.818235 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb6d04c-3cf7-4bbe-a381-f63495d9981b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:38:06.818871 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb6d04c-3cf7-4bbe-a381-f63495d9981b admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:06.819150 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb6d04c-3cf7-4bbe-a381-f63495d9981b admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:06.819422 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb6d04c-3cf7-4bbe-a381-f63495d9981b admin admin] PATH_INFO: `/v3/endpoints` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:06.820208 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb6d04c-3cf7-4bbe-a381-f63495d9981b admin admin] RBAC: Adding query filter params (interface=public, service_id=5e383af848ab44c08af16eb3343c43a4, region_id=RegionOne) {{(pid=85205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:38:06.821918 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb6d04c-3cf7-4bbe-a381-f63495d9981b admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:38:06.822051 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 465/914] 10.222.0.58 () {58 vars in 1023 bytes} [Tue Oct 12 16:38:06 2021] POST /identity/v3/auth/tokens => generated 2821 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:38:06.822217 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb6d04c-3cf7-4bbe-a381-f63495d9981b admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:38:06.829922 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 450/915] 10.222.0.58 () {56 vars in 1272 bytes} [Tue Oct 12 16:38:06 2021] GET /identity/v3/endpoints?service_id=5e383af848ab44c08af16eb3343c43a4&interface=public®ion_id=RegionOne => generated 194 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 16:38:06.833852 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa1dbe4-4e4f-431d-93b5-7741f6172e4f None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:38:06.843002 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa1dbe4-4e4f-431d-93b5-7741f6172e4f None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:38:06.844247 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb6d04c-3cf7-4bbe-a381-f63495d9981b admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:38:06.847771 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7db9ad5-fbbc-429a-89e9-9a79a27b21a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:38:06.848417 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7db9ad5-fbbc-429a-89e9-9a79a27b21a8 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:06.848700 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7db9ad5-fbbc-429a-89e9-9a79a27b21a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:06.848973 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7db9ad5-fbbc-429a-89e9-9a79a27b21a8 admin admin] PATH_INFO: `/v3/services` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:06.849667 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7db9ad5-fbbc-429a-89e9-9a79a27b21a8 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:38:06.851282 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7db9ad5-fbbc-429a-89e9-9a79a27b21a8 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:38:06.856167 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb6d04c-3cf7-4bbe-a381-f63495d9981b admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:38:06.858010 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 466/916] 10.222.0.58 () {56 vars in 1108 bytes} [Tue Oct 12 16:38:06 2021] GET /identity/v3/services => generated 1957 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 16:38:06.861247 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e58c38-8578-4ab6-b4d4-5bf1a0430605 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:38:06.862071 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e58c38-8578-4ab6-b4d4-5bf1a0430605 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:06.862347 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e58c38-8578-4ab6-b4d4-5bf1a0430605 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:06.862614 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e58c38-8578-4ab6-b4d4-5bf1a0430605 admin admin] PATH_INFO: `/v3/services/compute` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:06.863283 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e58c38-8578-4ab6-b4d4-5bf1a0430605 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:38:06.864872 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e58c38-8578-4ab6-b4d4-5bf1a0430605 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:38:06.877235 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: WARNING keystone.server.flask.application [None req-66e58c38-8578-4ab6-b4d4-5bf1a0430605 admin admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 12 16:38:06.878713 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 451/917] 10.222.0.58 () {56 vars in 1132 bytes} [Tue Oct 12 16:38:06 2021] GET /identity/v3/services/compute => generated 88 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 16:38:06.885437 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7db9ad5-fbbc-429a-89e9-9a79a27b21a8 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:38:06.896425 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7db9ad5-fbbc-429a-89e9-9a79a27b21a8 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:38:06.901403 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6584d89d-8287-4753-aa8b-62f46c7dd7a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:38:06.902236 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6584d89d-8287-4753-aa8b-62f46c7dd7a9 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:06.902629 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6584d89d-8287-4753-aa8b-62f46c7dd7a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:06.902912 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6584d89d-8287-4753-aa8b-62f46c7dd7a9 admin admin] PATH_INFO: `/v3/services` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:06.903650 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6584d89d-8287-4753-aa8b-62f46c7dd7a9 admin admin] RBAC: Adding query filter params (name=compute) {{(pid=85204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:38:06.903959 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6584d89d-8287-4753-aa8b-62f46c7dd7a9 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:38:06.905636 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6584d89d-8287-4753-aa8b-62f46c7dd7a9 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:38:06.913913 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 467/918] 10.222.0.58 () {56 vars in 1133 bytes} [Tue Oct 12 16:38:06 2021] GET /identity/v3/services?name=compute => generated 124 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:38:06.918061 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e58c38-8578-4ab6-b4d4-5bf1a0430605 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:38:06.928894 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e58c38-8578-4ab6-b4d4-5bf1a0430605 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:38:06.933721 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab23dea-bd06-4f0d-be1a-a8950b2519f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:38:06.934559 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab23dea-bd06-4f0d-be1a-a8950b2519f1 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:06.934907 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab23dea-bd06-4f0d-be1a-a8950b2519f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:06.935248 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab23dea-bd06-4f0d-be1a-a8950b2519f1 admin admin] PATH_INFO: `/v3/services` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:06.936051 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab23dea-bd06-4f0d-be1a-a8950b2519f1 admin admin] RBAC: Adding query filter params (type=compute) {{(pid=85205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:38:06.937059 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab23dea-bd06-4f0d-be1a-a8950b2519f1 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:38:06.938680 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab23dea-bd06-4f0d-be1a-a8950b2519f1 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:38:06.944414 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 452/919] 10.222.0.58 () {56 vars in 1133 bytes} [Tue Oct 12 16:38:06 2021] GET /identity/v3/services?type=compute => generated 352 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:38:06.950675 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6584d89d-8287-4753-aa8b-62f46c7dd7a9 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:38:06.960788 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6584d89d-8287-4753-aa8b-62f46c7dd7a9 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:38:06.965561 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f82dcf-95dd-4bf3-a7c9-f545ab5afdca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:38:06.966361 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f82dcf-95dd-4bf3-a7c9-f545ab5afdca admin admin] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:06.966717 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f82dcf-95dd-4bf3-a7c9-f545ab5afdca admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:06.967073 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f82dcf-95dd-4bf3-a7c9-f545ab5afdca admin admin] PATH_INFO: `/v3/endpoints` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:06.967860 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f82dcf-95dd-4bf3-a7c9-f545ab5afdca admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:38:06.969438 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f82dcf-95dd-4bf3-a7c9-f545ab5afdca admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:38:06.997935 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 468/920] 10.222.0.58 () {60 vars in 1165 bytes} [Tue Oct 12 16:38:06 2021] POST /identity/v3/endpoints => generated 334 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:38:08.320745 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e8c378-2cd7-477d-b0fb-7bf20ecbbeb9 None None] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:08.321262 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e8c378-2cd7-477d-b0fb-7bf20ecbbeb9 None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:08.321372 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e8c378-2cd7-477d-b0fb-7bf20ecbbeb9 None None] PATH_INFO: `/` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:08.323123 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 453/921] 10.222.0.58 () {54 vars in 926 bytes} [Tue Oct 12 16:38:08 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:38:08.329561 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f5696b-1c76-4673-a2e5-12ea49c5e3f8 None None] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:08.329974 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f5696b-1c76-4673-a2e5-12ea49c5e3f8 None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:08.330153 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f5696b-1c76-4673-a2e5-12ea49c5e3f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:08.347245 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.auth.core [None req-19f5696b-1c76-4673-a2e5-12ea49c5e3f8 None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:38:08.348417 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-19f5696b-1c76-4673-a2e5-12ea49c5e3f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:38:08.365318 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 469/922] 10.222.0.58 () {58 vars in 1023 bytes} [Tue Oct 12 16:38:08 2021] POST /identity/v3/auth/tokens => generated 2977 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:38:08.391174 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e8c378-2cd7-477d-b0fb-7bf20ecbbeb9 None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:38:08.403080 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e8c378-2cd7-477d-b0fb-7bf20ecbbeb9 None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:38:08.407461 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb221a8e-8fb4-43ce-8d85-1b7286563c23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:38:08.408236 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb221a8e-8fb4-43ce-8d85-1b7286563c23 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:08.408516 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb221a8e-8fb4-43ce-8d85-1b7286563c23 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:08.408787 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb221a8e-8fb4-43ce-8d85-1b7286563c23 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:08.409985 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb221a8e-8fb4-43ce-8d85-1b7286563c23 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:38:08.411632 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb221a8e-8fb4-43ce-8d85-1b7286563c23 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:38:08.413224 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 454/923] 10.222.0.58 () {56 vars in 1129 bytes} [Tue Oct 12 16:38:08 2021] GET /identity/v3/domains/default => generated 199 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 16:38:08.419512 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f5696b-1c76-4673-a2e5-12ea49c5e3f8 None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:38:08.431524 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f5696b-1c76-4673-a2e5-12ea49c5e3f8 None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:38:08.436993 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e4e565-5d3a-4281-a9aa-74c32b225f2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:38:08.437731 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e4e565-5d3a-4281-a9aa-74c32b225f2f admin admin] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:08.438046 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e4e565-5d3a-4281-a9aa-74c32b225f2f admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:08.438319 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e4e565-5d3a-4281-a9aa-74c32b225f2f admin admin] PATH_INFO: `/v3/projects` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:08.439055 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e4e565-5d3a-4281-a9aa-74c32b225f2f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:38:08.440924 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e4e565-5d3a-4281-a9aa-74c32b225f2f admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:38:08.467568 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 470/924] 10.222.0.58 () {60 vars in 1162 bytes} [Tue Oct 12 16:38:08 2021] POST /identity/v3/projects => generated 311 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:38:09.143876 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d600b311-3895-404d-b1bf-264011e3706b None None] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:09.144117 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d600b311-3895-404d-b1bf-264011e3706b None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:09.144538 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d600b311-3895-404d-b1bf-264011e3706b None None] PATH_INFO: `/` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:09.146374 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 455/925] 10.222.0.58 () {54 vars in 926 bytes} [Tue Oct 12 16:38:09 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:38:09.152207 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a171a559-8787-49a1-a057-5efddbea0df1 None None] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:09.152501 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a171a559-8787-49a1-a057-5efddbea0df1 None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:09.152776 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a171a559-8787-49a1-a057-5efddbea0df1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:09.171851 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.auth.core [None req-a171a559-8787-49a1-a057-5efddbea0df1 None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:38:09.173116 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-a171a559-8787-49a1-a057-5efddbea0df1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:38:09.232851 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 471/926] 10.222.0.58 () {58 vars in 1023 bytes} [Tue Oct 12 16:38:09 2021] POST /identity/v3/auth/tokens => generated 2977 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:38:09.256394 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d600b311-3895-404d-b1bf-264011e3706b None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:38:09.270128 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d600b311-3895-404d-b1bf-264011e3706b None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:38:09.275441 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cb1fd9-598b-4294-8193-ca2a6c08d3cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:38:09.276295 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cb1fd9-598b-4294-8193-ca2a6c08d3cb admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:09.276578 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cb1fd9-598b-4294-8193-ca2a6c08d3cb admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:09.276850 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cb1fd9-598b-4294-8193-ca2a6c08d3cb admin admin] PATH_INFO: `/v3/services/image` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:09.277541 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cb1fd9-598b-4294-8193-ca2a6c08d3cb admin admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:38:09.279142 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cb1fd9-598b-4294-8193-ca2a6c08d3cb admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:38:09.290421 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: WARNING keystone.server.flask.application [None req-92cb1fd9-598b-4294-8193-ca2a6c08d3cb admin admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 12 16:38:09.291740 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 456/927] 10.222.0.58 () {56 vars in 1126 bytes} [Tue Oct 12 16:38:09 2021] GET /identity/v3/services/image => generated 86 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:38:09.298182 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a171a559-8787-49a1-a057-5efddbea0df1 None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:38:09.307215 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a171a559-8787-49a1-a057-5efddbea0df1 None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:38:09.311830 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e628da-cfae-484a-bf7f-2d2ff8542740 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:38:09.312562 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e628da-cfae-484a-bf7f-2d2ff8542740 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:09.312920 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e628da-cfae-484a-bf7f-2d2ff8542740 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:09.313267 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e628da-cfae-484a-bf7f-2d2ff8542740 admin admin] PATH_INFO: `/v3/services` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:09.314092 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e628da-cfae-484a-bf7f-2d2ff8542740 admin admin] RBAC: Adding query filter params (name=image) {{(pid=85204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:38:09.314471 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e628da-cfae-484a-bf7f-2d2ff8542740 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:38:09.316061 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e628da-cfae-484a-bf7f-2d2ff8542740 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:38:09.325906 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 472/928] 10.222.0.58 () {56 vars in 1129 bytes} [Tue Oct 12 16:38:09 2021] GET /identity/v3/services?name=image => generated 122 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:38:09.327901 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cb1fd9-598b-4294-8193-ca2a6c08d3cb admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:38:09.339549 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cb1fd9-598b-4294-8193-ca2a6c08d3cb admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:38:09.343716 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b656baa1-a093-4314-9624-99d62c10a746 None None] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:09.344150 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b656baa1-a093-4314-9624-99d62c10a746 None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:09.344400 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b656baa1-a093-4314-9624-99d62c10a746 None None] PATH_INFO: `/` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:09.344896 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002502fe-754b-401f-bdf7-87ea0ffec554 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:38:09.345543 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002502fe-754b-401f-bdf7-87ea0ffec554 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:09.345826 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002502fe-754b-401f-bdf7-87ea0ffec554 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:09.346248 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002502fe-754b-401f-bdf7-87ea0ffec554 admin admin] PATH_INFO: `/v3/services` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:09.346348 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 473/929] 10.222.0.58 () {54 vars in 926 bytes} [Tue Oct 12 16:38:09 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 12 16:38:09.346849 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002502fe-754b-401f-bdf7-87ea0ffec554 admin admin] RBAC: Adding query filter params (type=image) {{(pid=85205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:38:09.347182 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002502fe-754b-401f-bdf7-87ea0ffec554 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:38:09.348714 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002502fe-754b-401f-bdf7-87ea0ffec554 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:38:09.351670 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25496df9-79f5-4ff7-b0a9-7e764817ce6f None None] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:09.351957 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25496df9-79f5-4ff7-b0a9-7e764817ce6f None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:09.352233 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25496df9-79f5-4ff7-b0a9-7e764817ce6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:09.354110 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 457/930] 10.222.0.58 () {56 vars in 1129 bytes} [Tue Oct 12 16:38:09 2021] GET /identity/v3/services?type=image => generated 350 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:38:09.360053 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002502fe-754b-401f-bdf7-87ea0ffec554 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:38:09.369123 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002502fe-754b-401f-bdf7-87ea0ffec554 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:38:09.370357 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.auth.core [None req-25496df9-79f5-4ff7-b0a9-7e764817ce6f None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:38:09.371540 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-25496df9-79f5-4ff7-b0a9-7e764817ce6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:38:09.373668 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07043fdb-f740-41ee-9f25-ed179fa3a683 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:38:09.374334 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07043fdb-f740-41ee-9f25-ed179fa3a683 admin admin] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:09.374616 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07043fdb-f740-41ee-9f25-ed179fa3a683 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:09.374887 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07043fdb-f740-41ee-9f25-ed179fa3a683 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:09.375877 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07043fdb-f740-41ee-9f25-ed179fa3a683 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:38:09.377419 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07043fdb-f740-41ee-9f25-ed179fa3a683 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:38:09.379769 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 474/931] 10.222.0.58 () {58 vars in 1023 bytes} [Tue Oct 12 16:38:09 2021] POST /identity/v3/auth/tokens => generated 2977 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:38:09.396301 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 458/932] 10.222.0.58 () {60 vars in 1165 bytes} [Tue Oct 12 16:38:09 2021] POST /identity/v3/endpoints => generated 327 bytes in 36 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 16:38:09.407794 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25496df9-79f5-4ff7-b0a9-7e764817ce6f None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:38:09.417600 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25496df9-79f5-4ff7-b0a9-7e764817ce6f None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:38:09.433104 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ed7276-399c-43dd-9a33-e15dc6d32c76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:38:09.434044 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ed7276-399c-43dd-9a33-e15dc6d32c76 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:09.434329 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ed7276-399c-43dd-9a33-e15dc6d32c76 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:09.434598 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ed7276-399c-43dd-9a33-e15dc6d32c76 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:09.445838 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ed7276-399c-43dd-9a33-e15dc6d32c76 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 16:38:09.454108 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: WARNING keystone.server.flask.application [None req-23ed7276-399c-43dd-9a33-e15dc6d32c76 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 12 16:38:09.455607 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 475/933] 10.222.0.58 () {56 vars in 1141 bytes} [Tue Oct 12 16:38:09 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:38:09.462246 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07043fdb-f740-41ee-9f25-ed179fa3a683 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:38:09.473348 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07043fdb-f740-41ee-9f25-ed179fa3a683 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:38:09.478235 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73514ca3-db6e-4693-937e-fcc0fdd639f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:38:09.478921 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73514ca3-db6e-4693-937e-fcc0fdd639f5 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:09.479227 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73514ca3-db6e-4693-937e-fcc0fdd639f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:09.479502 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73514ca3-db6e-4693-937e-fcc0fdd639f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:09.480322 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73514ca3-db6e-4693-937e-fcc0fdd639f5 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=85205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:38:09.480625 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73514ca3-db6e-4693-937e-fcc0fdd639f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:38:09.482254 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73514ca3-db6e-4693-937e-fcc0fdd639f5 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:38:09.491774 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 459/934] 10.222.0.58 () {56 vars in 1136 bytes} [Tue Oct 12 16:38:09 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:38:09.497972 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ed7276-399c-43dd-9a33-e15dc6d32c76 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:38:09.508767 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ed7276-399c-43dd-9a33-e15dc6d32c76 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:38:09.513468 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3d37cf-4701-42b3-8eb7-5dc19efca246 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:38:09.514870 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3d37cf-4701-42b3-8eb7-5dc19efca246 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:09.515194 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3d37cf-4701-42b3-8eb7-5dc19efca246 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:09.515471 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3d37cf-4701-42b3-8eb7-5dc19efca246 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:09.527025 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3d37cf-4701-42b3-8eb7-5dc19efca246 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:38:09.528882 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3d37cf-4701-42b3-8eb7-5dc19efca246 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:38:09.547407 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: WARNING keystone.server.flask.application [None req-fc3d37cf-4701-42b3-8eb7-5dc19efca246 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 16:38:09.548900 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 476/935] 10.222.0.58 () {56 vars in 1129 bytes} [Tue Oct 12 16:38:09 2021] GET /identity/v3/domains/Default => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:38:09.555238 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73514ca3-db6e-4693-937e-fcc0fdd639f5 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:38:09.566078 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73514ca3-db6e-4693-937e-fcc0fdd639f5 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:38:09.570771 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180b3ba8-8113-463a-83be-997bb4108216 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:38:09.571557 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180b3ba8-8113-463a-83be-997bb4108216 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:09.571911 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180b3ba8-8113-463a-83be-997bb4108216 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:09.572251 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180b3ba8-8113-463a-83be-997bb4108216 admin admin] PATH_INFO: `/v3/domains` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:09.573065 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180b3ba8-8113-463a-83be-997bb4108216 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:38:09.573442 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180b3ba8-8113-463a-83be-997bb4108216 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:38:09.575188 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180b3ba8-8113-463a-83be-997bb4108216 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:38:09.588782 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 460/936] 10.222.0.58 () {56 vars in 1130 bytes} [Tue Oct 12 16:38:09 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:38:09.595435 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3d37cf-4701-42b3-8eb7-5dc19efca246 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:38:09.605337 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3d37cf-4701-42b3-8eb7-5dc19efca246 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:38:09.610987 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362173fc-27c7-48ba-b7dc-0b743cb7d3bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:38:09.611778 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362173fc-27c7-48ba-b7dc-0b743cb7d3bb admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:09.612060 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362173fc-27c7-48ba-b7dc-0b743cb7d3bb admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:09.612337 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362173fc-27c7-48ba-b7dc-0b743cb7d3bb admin admin] PATH_INFO: `/v3/users/nova` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:09.621694 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362173fc-27c7-48ba-b7dc-0b743cb7d3bb admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:38:09.624268 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362173fc-27c7-48ba-b7dc-0b743cb7d3bb admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:38:09.639886 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: WARNING keystone.server.flask.application [None req-362173fc-27c7-48ba-b7dc-0b743cb7d3bb admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 12 16:38:09.641370 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 477/937] 10.222.0.58 () {56 vars in 1114 bytes} [Tue Oct 12 16:38:09 2021] GET /identity/v3/users/nova => generated 82 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:38:09.648465 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180b3ba8-8113-463a-83be-997bb4108216 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:38:09.658172 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180b3ba8-8113-463a-83be-997bb4108216 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:38:09.662644 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4711f9-0c98-4161-a7e5-aaf62c0a4e1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:38:09.663296 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4711f9-0c98-4161-a7e5-aaf62c0a4e1b admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:09.663574 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4711f9-0c98-4161-a7e5-aaf62c0a4e1b admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:09.663843 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4711f9-0c98-4161-a7e5-aaf62c0a4e1b admin admin] PATH_INFO: `/v3/users` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:09.664685 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4711f9-0c98-4161-a7e5-aaf62c0a4e1b admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=85205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:38:09.664991 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4711f9-0c98-4161-a7e5-aaf62c0a4e1b admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:38:09.666829 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4711f9-0c98-4161-a7e5-aaf62c0a4e1b admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:38:09.684137 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 461/938] 10.222.0.58 () {56 vars in 1154 bytes} [Tue Oct 12 16:38:09 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:38:09.691508 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362173fc-27c7-48ba-b7dc-0b743cb7d3bb admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:38:09.701354 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362173fc-27c7-48ba-b7dc-0b743cb7d3bb admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:38:09.706643 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6d8a19-0404-4245-a277-0263177fdd9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:38:09.707290 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6d8a19-0404-4245-a277-0263177fdd9f admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:09.707573 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6d8a19-0404-4245-a277-0263177fdd9f admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:09.707845 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6d8a19-0404-4245-a277-0263177fdd9f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:09.715661 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6d8a19-0404-4245-a277-0263177fdd9f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:38:09.717550 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6d8a19-0404-4245-a277-0263177fdd9f admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:38:09.730893 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 478/939] 10.222.0.58 () {58 vars in 1324 bytes} [Tue Oct 12 16:38:09 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:38:09.733411 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4711f9-0c98-4161-a7e5-aaf62c0a4e1b admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:38:09.745606 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4711f9-0c98-4161-a7e5-aaf62c0a4e1b admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:38:09.751188 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857bda47-872e-4676-95c5-965d52a90c85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:38:09.751976 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857bda47-872e-4676-95c5-965d52a90c85 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:09.752255 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857bda47-872e-4676-95c5-965d52a90c85 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:09.752595 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857bda47-872e-4676-95c5-965d52a90c85 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:09.762805 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857bda47-872e-4676-95c5-965d52a90c85 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:38:09.765262 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857bda47-872e-4676-95c5-965d52a90c85 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:38:09.781576 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: WARNING keystone.server.flask.application [None req-857bda47-872e-4676-95c5-965d52a90c85 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 16:38:09.783260 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 462/940] 10.222.0.58 () {56 vars in 1129 bytes} [Tue Oct 12 16:38:09 2021] GET /identity/v3/domains/Default => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:38:09.789771 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6d8a19-0404-4245-a277-0263177fdd9f admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:38:09.798777 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6d8a19-0404-4245-a277-0263177fdd9f admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:38:09.803553 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b974d9e-54bd-4b43-95bd-f873f6a96dfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:38:09.804277 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b974d9e-54bd-4b43-95bd-f873f6a96dfd admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:09.804630 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b974d9e-54bd-4b43-95bd-f873f6a96dfd admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:09.804977 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b974d9e-54bd-4b43-95bd-f873f6a96dfd admin admin] PATH_INFO: `/v3/domains` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:09.805802 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b974d9e-54bd-4b43-95bd-f873f6a96dfd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:38:09.811682 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b974d9e-54bd-4b43-95bd-f873f6a96dfd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:38:09.813452 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b974d9e-54bd-4b43-95bd-f873f6a96dfd admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:38:09.826313 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 479/941] 10.222.0.58 () {56 vars in 1130 bytes} [Tue Oct 12 16:38:09 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 16:38:09.832035 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857bda47-872e-4676-95c5-965d52a90c85 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:38:09.841520 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857bda47-872e-4676-95c5-965d52a90c85 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:38:09.846072 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b23d26-368f-4fab-b95d-7956cfc614e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:38:09.846840 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b23d26-368f-4fab-b95d-7956cfc614e3 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:09.847122 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b23d26-368f-4fab-b95d-7956cfc614e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:09.847391 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b23d26-368f-4fab-b95d-7956cfc614e3 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:09.853925 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b23d26-368f-4fab-b95d-7956cfc614e3 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:38:09.855834 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b23d26-368f-4fab-b95d-7956cfc614e3 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:38:09.868342 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: WARNING keystone.server.flask.application [None req-83b23d26-368f-4fab-b95d-7956cfc614e3 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 16:38:09.869633 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 463/942] 10.222.0.58 () {56 vars in 1132 bytes} [Tue Oct 12 16:38:09 2021] GET /identity/v3/projects/service => generated 88 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 16:38:09.877012 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b974d9e-54bd-4b43-95bd-f873f6a96dfd admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:38:09.886592 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b974d9e-54bd-4b43-95bd-f873f6a96dfd admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:38:09.891758 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08098ea-4402-4761-8fda-abf9a53caeca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:38:09.892490 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08098ea-4402-4761-8fda-abf9a53caeca admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:09.892846 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08098ea-4402-4761-8fda-abf9a53caeca admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:09.893194 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08098ea-4402-4761-8fda-abf9a53caeca admin admin] PATH_INFO: `/v3/projects` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:09.894110 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08098ea-4402-4761-8fda-abf9a53caeca admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=85204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:38:09.894491 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08098ea-4402-4761-8fda-abf9a53caeca admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:38:09.896358 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08098ea-4402-4761-8fda-abf9a53caeca admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:38:09.908500 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 480/943] 10.222.0.58 () {56 vars in 1169 bytes} [Tue Oct 12 16:38:09 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:38:09.914618 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b23d26-368f-4fab-b95d-7956cfc614e3 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:38:09.925411 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b23d26-368f-4fab-b95d-7956cfc614e3 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:38:09.929948 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c3507f-3645-41a5-a426-b79073fb1567 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:38:09.930570 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c3507f-3645-41a5-a426-b79073fb1567 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:09.930853 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c3507f-3645-41a5-a426-b79073fb1567 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:09.931182 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c3507f-3645-41a5-a426-b79073fb1567 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:09.932302 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c3507f-3645-41a5-a426-b79073fb1567 admin admin] RBAC: Adding query filter params (role.id=5ad80b06c65f492a927df805eb69866c, scope.project.id=f3531f242eaa43b69562d70bca5ec5a8, user.id=29d30b574eec4ad3990d77d235c8b424) {{(pid=85205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:38:09.932622 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c3507f-3645-41a5-a426-b79073fb1567 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:38:09.934445 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c3507f-3645-41a5-a426-b79073fb1567 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:38:09.940508 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 464/944] 10.222.0.58 () {56 vars in 1395 bytes} [Tue Oct 12 16:38:09 2021] GET /identity/v3/role_assignments?user.id=29d30b574eec4ad3990d77d235c8b424&scope.project.id=f3531f242eaa43b69562d70bca5ec5a8&role.id=5ad80b06c65f492a927df805eb69866c => generated 259 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:38:10.760242 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942ef8e5-26c5-4e66-b7f0-39d2617334c3 None None] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:10.760755 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942ef8e5-26c5-4e66-b7f0-39d2617334c3 None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:10.760831 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942ef8e5-26c5-4e66-b7f0-39d2617334c3 None None] PATH_INFO: `/` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:10.762732 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 481/945] 10.222.0.58 () {54 vars in 926 bytes} [Tue Oct 12 16:38:10 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:38:10.769043 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a855e43-1d6d-4bdf-8751-cdf1c1151c62 None None] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:10.769485 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a855e43-1d6d-4bdf-8751-cdf1c1151c62 None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:10.769662 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a855e43-1d6d-4bdf-8751-cdf1c1151c62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:10.788950 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.auth.core [None req-1a855e43-1d6d-4bdf-8751-cdf1c1151c62 None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:38:10.790174 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-1a855e43-1d6d-4bdf-8751-cdf1c1151c62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:38:10.798341 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 465/946] 10.222.0.58 () {58 vars in 1023 bytes} [Tue Oct 12 16:38:10 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:38:10.823538 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942ef8e5-26c5-4e66-b7f0-39d2617334c3 None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:38:10.835989 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942ef8e5-26c5-4e66-b7f0-39d2617334c3 None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:38:10.840228 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18d4d7e-564e-4f78-a789-ed7f1f435570 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:38:10.840993 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18d4d7e-564e-4f78-a789-ed7f1f435570 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:10.841270 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18d4d7e-564e-4f78-a789-ed7f1f435570 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:10.841536 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18d4d7e-564e-4f78-a789-ed7f1f435570 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:10.843275 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18d4d7e-564e-4f78-a789-ed7f1f435570 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:38:10.844950 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18d4d7e-564e-4f78-a789-ed7f1f435570 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:38:10.846671 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 482/947] 10.222.0.58 () {56 vars in 1129 bytes} [Tue Oct 12 16:38:10 2021] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:38:10.852624 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a855e43-1d6d-4bdf-8751-cdf1c1151c62 None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:38:10.861459 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a855e43-1d6d-4bdf-8751-cdf1c1151c62 None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:38:10.865864 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8833e8c2-100e-4fbc-abaf-92519067e801 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:38:10.866535 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8833e8c2-100e-4fbc-abaf-92519067e801 admin admin] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:10.866815 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8833e8c2-100e-4fbc-abaf-92519067e801 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:10.867087 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8833e8c2-100e-4fbc-abaf-92519067e801 admin admin] PATH_INFO: `/v3/users` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:10.867825 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8833e8c2-100e-4fbc-abaf-92519067e801 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:38:10.869672 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8833e8c2-100e-4fbc-abaf-92519067e801 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:38:10.890807 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 466/948] 10.222.0.58 () {60 vars in 1153 bytes} [Tue Oct 12 16:38:10 2021] POST /identity/v3/users => generated 285 bytes in 39 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 16:38:11.680591 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ef1ee4-a98b-42d6-97f0-7a17741045a2 None None] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:11.680894 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ef1ee4-a98b-42d6-97f0-7a17741045a2 None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:11.681302 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ef1ee4-a98b-42d6-97f0-7a17741045a2 None None] PATH_INFO: `/` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:11.683138 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 483/949] 10.222.0.58 () {54 vars in 926 bytes} [Tue Oct 12 16:38:11 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:38:11.689577 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364b8a99-132e-4b42-97aa-6de7f38d5ec9 None None] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:11.689985 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364b8a99-132e-4b42-97aa-6de7f38d5ec9 None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:11.690343 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364b8a99-132e-4b42-97aa-6de7f38d5ec9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:11.707779 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.auth.core [None req-364b8a99-132e-4b42-97aa-6de7f38d5ec9 None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:38:11.708962 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-364b8a99-132e-4b42-97aa-6de7f38d5ec9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:38:11.716780 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 467/950] 10.222.0.58 () {58 vars in 1023 bytes} [Tue Oct 12 16:38:11 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:38:11.740467 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ef1ee4-a98b-42d6-97f0-7a17741045a2 None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:38:11.754850 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ef1ee4-a98b-42d6-97f0-7a17741045a2 None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:38:11.759220 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7eb247f-0486-4e0c-9826-8f93d03ca6e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:38:11.759864 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7eb247f-0486-4e0c-9826-8f93d03ca6e9 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:11.760146 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7eb247f-0486-4e0c-9826-8f93d03ca6e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:11.760427 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7eb247f-0486-4e0c-9826-8f93d03ca6e9 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:11.768647 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7eb247f-0486-4e0c-9826-8f93d03ca6e9 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:38:11.770429 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7eb247f-0486-4e0c-9826-8f93d03ca6e9 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:38:11.779479 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 484/951] 10.222.0.58 () {58 vars in 1324 bytes} [Tue Oct 12 16:38:11 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:38:11.785981 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364b8a99-132e-4b42-97aa-6de7f38d5ec9 None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:38:11.795071 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364b8a99-132e-4b42-97aa-6de7f38d5ec9 None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:38:11.800121 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f3299d-2700-44b6-b1f1-abffe99f5196 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:38:11.800903 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f3299d-2700-44b6-b1f1-abffe99f5196 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:11.801188 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f3299d-2700-44b6-b1f1-abffe99f5196 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:11.801464 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f3299d-2700-44b6-b1f1-abffe99f5196 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:11.802697 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f3299d-2700-44b6-b1f1-abffe99f5196 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:38:11.804381 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f3299d-2700-44b6-b1f1-abffe99f5196 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:38:11.805997 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 468/952] 10.222.0.58 () {56 vars in 1129 bytes} [Tue Oct 12 16:38:11 2021] GET /identity/v3/domains/default => generated 199 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:38:12.211985 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c025d26d-d709-4216-9937-ba62d16d4141 None None] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:12.212275 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c025d26d-d709-4216-9937-ba62d16d4141 None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:12.212557 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c025d26d-d709-4216-9937-ba62d16d4141 None None] PATH_INFO: `/` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:12.214377 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 485/953] 10.222.0.58 () {54 vars in 926 bytes} [Tue Oct 12 16:38:12 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:38:12.220663 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3698b2ca-7944-452d-bdb8-0b82fafeed81 None None] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:12.220950 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3698b2ca-7944-452d-bdb8-0b82fafeed81 None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:12.221225 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3698b2ca-7944-452d-bdb8-0b82fafeed81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:12.238509 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.auth.core [None req-3698b2ca-7944-452d-bdb8-0b82fafeed81 None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:38:12.239848 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-3698b2ca-7944-452d-bdb8-0b82fafeed81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:38:12.247576 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 469/954] 10.222.0.58 () {58 vars in 1023 bytes} [Tue Oct 12 16:38:12 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:38:12.272284 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c025d26d-d709-4216-9937-ba62d16d4141 None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:38:12.284715 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c025d26d-d709-4216-9937-ba62d16d4141 None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:38:12.288969 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99199a9-2a70-45d1-921c-771c3fff5ebd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:38:12.289750 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99199a9-2a70-45d1-921c-771c3fff5ebd admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:12.290057 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99199a9-2a70-45d1-921c-771c3fff5ebd admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:12.290328 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99199a9-2a70-45d1-921c-771c3fff5ebd admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:12.300113 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99199a9-2a70-45d1-921c-771c3fff5ebd admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 16:38:12.307230 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: WARNING keystone.server.flask.application [None req-d99199a9-2a70-45d1-921c-771c3fff5ebd admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 12 16:38:12.308516 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 486/955] 10.222.0.58 () {56 vars in 1141 bytes} [Tue Oct 12 16:38:12 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:38:12.314925 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3698b2ca-7944-452d-bdb8-0b82fafeed81 None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:38:12.323761 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3698b2ca-7944-452d-bdb8-0b82fafeed81 None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:38:12.328815 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8e132c-f38f-4f9b-9069-402b5d1723f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:38:12.329462 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8e132c-f38f-4f9b-9069-402b5d1723f0 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:12.329742 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8e132c-f38f-4f9b-9069-402b5d1723f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:12.330047 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8e132c-f38f-4f9b-9069-402b5d1723f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:12.330804 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8e132c-f38f-4f9b-9069-402b5d1723f0 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=85205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:38:12.331114 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8e132c-f38f-4f9b-9069-402b5d1723f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:38:12.332673 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8e132c-f38f-4f9b-9069-402b5d1723f0 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:38:12.340580 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 470/956] 10.222.0.58 () {56 vars in 1136 bytes} [Tue Oct 12 16:38:12 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:38:12.347222 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99199a9-2a70-45d1-921c-771c3fff5ebd admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:38:12.357150 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99199a9-2a70-45d1-921c-771c3fff5ebd admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:38:12.361553 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee6c9ea-e1e4-45aa-bccf-ad9263232d88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:38:12.362334 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee6c9ea-e1e4-45aa-bccf-ad9263232d88 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:12.362614 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee6c9ea-e1e4-45aa-bccf-ad9263232d88 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:12.362884 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee6c9ea-e1e4-45aa-bccf-ad9263232d88 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:12.372614 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee6c9ea-e1e4-45aa-bccf-ad9263232d88 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:38:12.374481 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee6c9ea-e1e4-45aa-bccf-ad9263232d88 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:38:12.391298 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: WARNING keystone.server.flask.application [None req-8ee6c9ea-e1e4-45aa-bccf-ad9263232d88 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 16:38:12.392513 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 487/957] 10.222.0.58 () {56 vars in 1129 bytes} [Tue Oct 12 16:38:12 2021] GET /identity/v3/domains/Default => generated 87 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:38:12.398308 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8e132c-f38f-4f9b-9069-402b5d1723f0 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:38:12.408209 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8e132c-f38f-4f9b-9069-402b5d1723f0 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:38:12.412689 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd9ec84-258b-4895-9da6-54408625e7e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:38:12.413415 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd9ec84-258b-4895-9da6-54408625e7e6 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:12.413764 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd9ec84-258b-4895-9da6-54408625e7e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:12.414133 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd9ec84-258b-4895-9da6-54408625e7e6 admin admin] PATH_INFO: `/v3/domains` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:12.414925 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd9ec84-258b-4895-9da6-54408625e7e6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:38:12.415299 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd9ec84-258b-4895-9da6-54408625e7e6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:38:12.416902 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd9ec84-258b-4895-9da6-54408625e7e6 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:38:12.428148 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 471/958] 10.222.0.58 () {56 vars in 1130 bytes} [Tue Oct 12 16:38:12 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:38:12.433754 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee6c9ea-e1e4-45aa-bccf-ad9263232d88 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:38:12.445461 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee6c9ea-e1e4-45aa-bccf-ad9263232d88 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:38:12.449944 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e799c234-4f6a-451b-bf33-6f2c6804081c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:38:12.450710 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e799c234-4f6a-451b-bf33-6f2c6804081c admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:12.450990 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e799c234-4f6a-451b-bf33-6f2c6804081c admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:12.451263 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e799c234-4f6a-451b-bf33-6f2c6804081c admin admin] PATH_INFO: `/v3/users/nova` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:12.461668 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e799c234-4f6a-451b-bf33-6f2c6804081c admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:38:12.463745 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e799c234-4f6a-451b-bf33-6f2c6804081c admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:38:12.478790 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: WARNING keystone.server.flask.application [None req-e799c234-4f6a-451b-bf33-6f2c6804081c admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 12 16:38:12.479915 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 488/959] 10.222.0.58 () {56 vars in 1114 bytes} [Tue Oct 12 16:38:12 2021] GET /identity/v3/users/nova => generated 82 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 16:38:12.486346 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd9ec84-258b-4895-9da6-54408625e7e6 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:38:12.495857 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd9ec84-258b-4895-9da6-54408625e7e6 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:38:12.500374 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfccd041-818f-4265-9289-be746dbabe41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:38:12.501278 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfccd041-818f-4265-9289-be746dbabe41 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:12.501565 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfccd041-818f-4265-9289-be746dbabe41 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:12.501842 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfccd041-818f-4265-9289-be746dbabe41 admin admin] PATH_INFO: `/v3/users` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:12.502735 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfccd041-818f-4265-9289-be746dbabe41 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=85205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:38:12.503046 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfccd041-818f-4265-9289-be746dbabe41 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:38:12.504856 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfccd041-818f-4265-9289-be746dbabe41 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:38:12.522381 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 472/960] 10.222.0.58 () {56 vars in 1154 bytes} [Tue Oct 12 16:38:12 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:38:12.528480 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e799c234-4f6a-451b-bf33-6f2c6804081c admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:38:12.538721 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e799c234-4f6a-451b-bf33-6f2c6804081c admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:38:12.543287 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca9f3c3-bf4b-4cfa-ad77-1eb94b4734c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:38:12.544057 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca9f3c3-bf4b-4cfa-ad77-1eb94b4734c3 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:12.544341 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca9f3c3-bf4b-4cfa-ad77-1eb94b4734c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:12.544616 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca9f3c3-bf4b-4cfa-ad77-1eb94b4734c3 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:12.554596 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca9f3c3-bf4b-4cfa-ad77-1eb94b4734c3 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:38:12.556400 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca9f3c3-bf4b-4cfa-ad77-1eb94b4734c3 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:38:12.573146 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: WARNING keystone.server.flask.application [None req-bca9f3c3-bf4b-4cfa-ad77-1eb94b4734c3 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 16:38:12.574292 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 489/961] 10.222.0.58 () {56 vars in 1129 bytes} [Tue Oct 12 16:38:12 2021] GET /identity/v3/domains/Default => generated 87 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:38:12.580847 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfccd041-818f-4265-9289-be746dbabe41 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:38:12.590202 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfccd041-818f-4265-9289-be746dbabe41 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:38:12.594735 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040d6730-012f-4be8-87dd-22f570cae6bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:38:12.595385 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040d6730-012f-4be8-87dd-22f570cae6bf admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:12.595665 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040d6730-012f-4be8-87dd-22f570cae6bf admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:12.595938 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040d6730-012f-4be8-87dd-22f570cae6bf admin admin] PATH_INFO: `/v3/domains` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:12.596668 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040d6730-012f-4be8-87dd-22f570cae6bf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:38:12.596971 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040d6730-012f-4be8-87dd-22f570cae6bf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:38:12.598571 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040d6730-012f-4be8-87dd-22f570cae6bf admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:38:12.609791 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 473/962] 10.222.0.58 () {56 vars in 1130 bytes} [Tue Oct 12 16:38:12 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 16:38:12.616030 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca9f3c3-bf4b-4cfa-ad77-1eb94b4734c3 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:38:12.626303 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca9f3c3-bf4b-4cfa-ad77-1eb94b4734c3 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:38:12.630807 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef3fe89-c670-44c0-a997-dbc8024c2d96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:38:12.631583 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef3fe89-c670-44c0-a997-dbc8024c2d96 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:12.631864 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef3fe89-c670-44c0-a997-dbc8024c2d96 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:12.632138 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef3fe89-c670-44c0-a997-dbc8024c2d96 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:12.638818 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef3fe89-c670-44c0-a997-dbc8024c2d96 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:38:12.641274 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef3fe89-c670-44c0-a997-dbc8024c2d96 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:38:12.653836 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: WARNING keystone.server.flask.application [None req-7ef3fe89-c670-44c0-a997-dbc8024c2d96 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 16:38:12.655031 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 490/963] 10.222.0.58 () {56 vars in 1132 bytes} [Tue Oct 12 16:38:12 2021] GET /identity/v3/projects/service => generated 88 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:38:12.661256 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040d6730-012f-4be8-87dd-22f570cae6bf admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:38:12.670668 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040d6730-012f-4be8-87dd-22f570cae6bf admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:38:12.675046 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c12484b-1803-47ce-88c2-b6071eadd987 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:38:12.675677 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c12484b-1803-47ce-88c2-b6071eadd987 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:12.675957 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c12484b-1803-47ce-88c2-b6071eadd987 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:12.676229 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c12484b-1803-47ce-88c2-b6071eadd987 admin admin] PATH_INFO: `/v3/projects` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:12.677017 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c12484b-1803-47ce-88c2-b6071eadd987 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=85205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:38:12.677381 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c12484b-1803-47ce-88c2-b6071eadd987 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:38:12.679209 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c12484b-1803-47ce-88c2-b6071eadd987 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:38:12.691251 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 474/964] 10.222.0.58 () {56 vars in 1169 bytes} [Tue Oct 12 16:38:12 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 16:38:12.697647 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef3fe89-c670-44c0-a997-dbc8024c2d96 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:38:12.708385 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef3fe89-c670-44c0-a997-dbc8024c2d96 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:38:12.712878 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992cdc7e-8e84-4e0d-9cbc-d1d37fb04143 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:38:12.713734 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992cdc7e-8e84-4e0d-9cbc-d1d37fb04143 admin admin] REQUEST_METHOD: `PUT` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:12.714106 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992cdc7e-8e84-4e0d-9cbc-d1d37fb04143 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:12.714335 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992cdc7e-8e84-4e0d-9cbc-d1d37fb04143 admin admin] PATH_INFO: `/v3/projects/f3531f242eaa43b69562d70bca5ec5a8/users/29d30b574eec4ad3990d77d235c8b424/roles/5ad80b06c65f492a927df805eb69866c` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:12.716530 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992cdc7e-8e84-4e0d-9cbc-d1d37fb04143 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3531f242eaa43b69562d70bca5ec5a8, user_id=29d30b574eec4ad3990d77d235c8b424, role_id=5ad80b06c65f492a927df805eb69866c)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:38:12.719185 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992cdc7e-8e84-4e0d-9cbc-d1d37fb04143 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:38:12.732450 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 491/965] 10.222.0.58 () {58 vars in 1460 bytes} [Tue Oct 12 16:38:12 2021] PUT /identity/v3/projects/f3531f242eaa43b69562d70bca5ec5a8/users/29d30b574eec4ad3990d77d235c8b424/roles/5ad80b06c65f492a927df805eb69866c => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:38:13.215248 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e535f5be-546e-41b4-88f1-6aa9bc519590 None None] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:13.215861 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e535f5be-546e-41b4-88f1-6aa9bc519590 None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:13.215861 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e535f5be-546e-41b4-88f1-6aa9bc519590 None None] PATH_INFO: `/` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:13.217605 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 475/966] 10.222.0.58 () {54 vars in 926 bytes} [Tue Oct 12 16:38:13 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:38:13.223538 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1959dbf-f931-4925-acda-cb6bf08677c7 None None] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:13.223918 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1959dbf-f931-4925-acda-cb6bf08677c7 None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:13.224213 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1959dbf-f931-4925-acda-cb6bf08677c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:13.241668 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.auth.core [None req-a1959dbf-f931-4925-acda-cb6bf08677c7 None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:38:13.242886 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-a1959dbf-f931-4925-acda-cb6bf08677c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:38:13.304722 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 492/967] 10.222.0.58 () {58 vars in 1023 bytes} [Tue Oct 12 16:38:13 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:38:13.329135 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e535f5be-546e-41b4-88f1-6aa9bc519590 None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:38:13.340934 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e535f5be-546e-41b4-88f1-6aa9bc519590 None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:38:13.345787 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1605129-82f3-406e-9cd1-05b55f8f690a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:38:13.346578 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1605129-82f3-406e-9cd1-05b55f8f690a admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:13.346859 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1605129-82f3-406e-9cd1-05b55f8f690a admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:13.347131 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1605129-82f3-406e-9cd1-05b55f8f690a admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:13.356758 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1605129-82f3-406e-9cd1-05b55f8f690a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 16:38:13.364067 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: WARNING keystone.server.flask.application [None req-b1605129-82f3-406e-9cd1-05b55f8f690a admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 16:38:13.365194 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 476/968] 10.222.0.58 () {56 vars in 1117 bytes} [Tue Oct 12 16:38:13 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:38:13.371627 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1959dbf-f931-4925-acda-cb6bf08677c7 None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:38:13.380669 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1959dbf-f931-4925-acda-cb6bf08677c7 None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:38:13.385204 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8e5127-91b6-46df-a6cf-1d14c3ed09db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:38:13.385860 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8e5127-91b6-46df-a6cf-1d14c3ed09db admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:13.386175 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8e5127-91b6-46df-a6cf-1d14c3ed09db admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:13.386457 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8e5127-91b6-46df-a6cf-1d14c3ed09db admin admin] PATH_INFO: `/v3/roles` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:13.387223 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8e5127-91b6-46df-a6cf-1d14c3ed09db admin admin] RBAC: Adding query filter params (name=admin) {{(pid=85204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:38:13.387585 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8e5127-91b6-46df-a6cf-1d14c3ed09db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:38:13.389183 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8e5127-91b6-46df-a6cf-1d14c3ed09db admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:38:13.397159 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 493/969] 10.222.0.58 () {56 vars in 1120 bytes} [Tue Oct 12 16:38:13 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:38:13.403455 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1605129-82f3-406e-9cd1-05b55f8f690a admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:38:13.413854 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1605129-82f3-406e-9cd1-05b55f8f690a admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:38:13.418302 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55a1de2-27cd-4d6f-a32f-35dcaa60b95c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:38:13.419134 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55a1de2-27cd-4d6f-a32f-35dcaa60b95c admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:13.419417 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55a1de2-27cd-4d6f-a32f-35dcaa60b95c admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:13.419690 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55a1de2-27cd-4d6f-a32f-35dcaa60b95c admin admin] PATH_INFO: `/v3/users/3e78421f32bd45d7bca3b280d9b2ac9a` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:13.433007 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55a1de2-27cd-4d6f-a32f-35dcaa60b95c admin admin] RBAC: Authorizing `identity:get_user(user_id=3e78421f32bd45d7bca3b280d9b2ac9a)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:38:13.435141 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55a1de2-27cd-4d6f-a32f-35dcaa60b95c admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:38:13.436780 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 477/970] 10.222.0.58 () {56 vars in 1198 bytes} [Tue Oct 12 16:38:13 2021] GET /identity/v3/users/3e78421f32bd45d7bca3b280d9b2ac9a => generated 285 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:38:13.443264 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8e5127-91b6-46df-a6cf-1d14c3ed09db admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:38:13.452788 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8e5127-91b6-46df-a6cf-1d14c3ed09db admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:38:13.457312 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa29822-96eb-418b-8609-6b575d5d231e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:38:13.457974 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa29822-96eb-418b-8609-6b575d5d231e admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:13.458264 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa29822-96eb-418b-8609-6b575d5d231e admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:13.458542 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa29822-96eb-418b-8609-6b575d5d231e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:13.466185 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa29822-96eb-418b-8609-6b575d5d231e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:38:13.468371 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa29822-96eb-418b-8609-6b575d5d231e admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:38:13.477125 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 494/971] 10.222.0.58 () {58 vars in 1324 bytes} [Tue Oct 12 16:38:13 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:38:13.484167 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55a1de2-27cd-4d6f-a32f-35dcaa60b95c admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:38:13.493708 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55a1de2-27cd-4d6f-a32f-35dcaa60b95c admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:38:13.498167 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e85402-01a4-45a0-9682-0a8fdfb7bf28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:38:13.499004 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e85402-01a4-45a0-9682-0a8fdfb7bf28 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:13.499286 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e85402-01a4-45a0-9682-0a8fdfb7bf28 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:13.499561 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e85402-01a4-45a0-9682-0a8fdfb7bf28 admin admin] PATH_INFO: `/v3/projects/0e02c6f40aa0446b8745907c5f4d05eb` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:13.500991 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e85402-01a4-45a0-9682-0a8fdfb7bf28 admin admin] RBAC: Authorizing `identity:get_project(project_id=0e02c6f40aa0446b8745907c5f4d05eb)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:38:13.503032 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e85402-01a4-45a0-9682-0a8fdfb7bf28 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:38:13.504661 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 478/972] 10.222.0.58 () {56 vars in 1207 bytes} [Tue Oct 12 16:38:13 2021] GET /identity/v3/projects/0e02c6f40aa0446b8745907c5f4d05eb => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 16:38:13.511126 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa29822-96eb-418b-8609-6b575d5d231e admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:38:13.519832 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa29822-96eb-418b-8609-6b575d5d231e admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:38:13.524478 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558406dc-6221-4727-a973-e575b5ee6a24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:38:13.525111 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558406dc-6221-4727-a973-e575b5ee6a24 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:13.525400 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558406dc-6221-4727-a973-e575b5ee6a24 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:13.525679 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558406dc-6221-4727-a973-e575b5ee6a24 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:13.526545 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558406dc-6221-4727-a973-e575b5ee6a24 admin admin] RBAC: Adding query filter params (role.id=610824e4f50f4fb8954610e98c1de784, scope.project.id=0e02c6f40aa0446b8745907c5f4d05eb, user.id=3e78421f32bd45d7bca3b280d9b2ac9a) {{(pid=85204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:38:13.526863 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558406dc-6221-4727-a973-e575b5ee6a24 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:38:13.528664 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558406dc-6221-4727-a973-e575b5ee6a24 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:38:13.534534 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 495/973] 10.222.0.58 () {56 vars in 1395 bytes} [Tue Oct 12 16:38:13 2021] GET /identity/v3/role_assignments?user.id=3e78421f32bd45d7bca3b280d9b2ac9a&scope.project.id=0e02c6f40aa0446b8745907c5f4d05eb&role.id=610824e4f50f4fb8954610e98c1de784 => generated 259 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 16:38:14.963187 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74885719-ab85-4196-8cd9-69a0bf363df9 None None] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:14.963703 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74885719-ab85-4196-8cd9-69a0bf363df9 None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:14.963815 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74885719-ab85-4196-8cd9-69a0bf363df9 None None] PATH_INFO: `/` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:14.965510 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 479/974] 10.222.0.58 () {54 vars in 926 bytes} [Tue Oct 12 16:38:14 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:38:14.971975 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafbf937-c39f-425a-8148-cc73119894af None None] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:14.972409 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafbf937-c39f-425a-8148-cc73119894af None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:14.972642 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafbf937-c39f-425a-8148-cc73119894af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:14.990437 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.auth.core [None req-cafbf937-c39f-425a-8148-cc73119894af None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:38:14.991603 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-cafbf937-c39f-425a-8148-cc73119894af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:38:14.999048 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 496/975] 10.222.0.58 () {58 vars in 1023 bytes} [Tue Oct 12 16:38:14 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:38:15.022887 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74885719-ab85-4196-8cd9-69a0bf363df9 None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:38:15.035354 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74885719-ab85-4196-8cd9-69a0bf363df9 None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:38:15.039724 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f415c4b-6f3e-4f2e-b0e2-c87dc73164fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:38:15.040512 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f415c4b-6f3e-4f2e-b0e2-c87dc73164fa admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:15.040791 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f415c4b-6f3e-4f2e-b0e2-c87dc73164fa admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:15.041064 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f415c4b-6f3e-4f2e-b0e2-c87dc73164fa admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:15.051552 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f415c4b-6f3e-4f2e-b0e2-c87dc73164fa admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 16:38:15.058788 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: WARNING keystone.server.flask.application [None req-3f415c4b-6f3e-4f2e-b0e2-c87dc73164fa admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 12 16:38:15.059953 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 480/976] 10.222.0.58 () {56 vars in 1141 bytes} [Tue Oct 12 16:38:15 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 16:38:15.066755 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafbf937-c39f-425a-8148-cc73119894af None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:38:15.075387 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafbf937-c39f-425a-8148-cc73119894af None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:38:15.079828 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802db424-7bed-4f19-bce0-f9930d8dcdcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:38:15.080474 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802db424-7bed-4f19-bce0-f9930d8dcdcf admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:15.080751 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802db424-7bed-4f19-bce0-f9930d8dcdcf admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:15.081021 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802db424-7bed-4f19-bce0-f9930d8dcdcf admin admin] PATH_INFO: `/v3/roles` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:15.081772 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802db424-7bed-4f19-bce0-f9930d8dcdcf admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=85204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:38:15.082115 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802db424-7bed-4f19-bce0-f9930d8dcdcf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:38:15.083668 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802db424-7bed-4f19-bce0-f9930d8dcdcf admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:38:15.091435 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 497/977] 10.222.0.58 () {56 vars in 1136 bytes} [Tue Oct 12 16:38:15 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:38:15.097788 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f415c4b-6f3e-4f2e-b0e2-c87dc73164fa admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:38:15.108231 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f415c4b-6f3e-4f2e-b0e2-c87dc73164fa admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:38:15.112616 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58568bb-62ec-4ba2-9d28-6cb5ab4f8184 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:38:15.113358 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58568bb-62ec-4ba2-9d28-6cb5ab4f8184 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:15.113638 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58568bb-62ec-4ba2-9d28-6cb5ab4f8184 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:15.113937 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58568bb-62ec-4ba2-9d28-6cb5ab4f8184 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:15.123573 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58568bb-62ec-4ba2-9d28-6cb5ab4f8184 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:38:15.125600 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58568bb-62ec-4ba2-9d28-6cb5ab4f8184 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:38:15.142325 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: WARNING keystone.server.flask.application [None req-f58568bb-62ec-4ba2-9d28-6cb5ab4f8184 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 16:38:15.143591 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 481/978] 10.222.0.58 () {56 vars in 1129 bytes} [Tue Oct 12 16:38:15 2021] GET /identity/v3/domains/Default => generated 87 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:38:15.149664 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802db424-7bed-4f19-bce0-f9930d8dcdcf admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:38:15.159707 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802db424-7bed-4f19-bce0-f9930d8dcdcf admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:38:15.164351 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef29d773-cf45-4d60-b409-b6ed92a3a467 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:38:15.165097 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef29d773-cf45-4d60-b409-b6ed92a3a467 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:15.165440 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef29d773-cf45-4d60-b409-b6ed92a3a467 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:15.165776 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef29d773-cf45-4d60-b409-b6ed92a3a467 admin admin] PATH_INFO: `/v3/domains` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:15.166599 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef29d773-cf45-4d60-b409-b6ed92a3a467 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:38:15.166970 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef29d773-cf45-4d60-b409-b6ed92a3a467 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:38:15.168604 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef29d773-cf45-4d60-b409-b6ed92a3a467 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:38:15.180588 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 498/979] 10.222.0.58 () {56 vars in 1130 bytes} [Tue Oct 12 16:38:15 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:38:15.186837 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58568bb-62ec-4ba2-9d28-6cb5ab4f8184 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:38:15.196189 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58568bb-62ec-4ba2-9d28-6cb5ab4f8184 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:38:15.200569 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ab7bb2-4a93-4850-b169-a2ef6969104b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:38:15.201860 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ab7bb2-4a93-4850-b169-a2ef6969104b admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:15.202170 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ab7bb2-4a93-4850-b169-a2ef6969104b admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:15.202436 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ab7bb2-4a93-4850-b169-a2ef6969104b admin admin] PATH_INFO: `/v3/users/nova` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:15.209372 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ab7bb2-4a93-4850-b169-a2ef6969104b admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:38:15.211361 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ab7bb2-4a93-4850-b169-a2ef6969104b admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:38:15.225161 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: WARNING keystone.server.flask.application [None req-25ab7bb2-4a93-4850-b169-a2ef6969104b admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 12 16:38:15.226306 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 482/980] 10.222.0.58 () {56 vars in 1114 bytes} [Tue Oct 12 16:38:15 2021] GET /identity/v3/users/nova => generated 82 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:38:15.232503 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef29d773-cf45-4d60-b409-b6ed92a3a467 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:38:15.241958 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef29d773-cf45-4d60-b409-b6ed92a3a467 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:38:15.246424 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2577dc-187b-4e3e-8dbb-14179225a2ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:38:15.247066 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2577dc-187b-4e3e-8dbb-14179225a2ec admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:15.247344 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2577dc-187b-4e3e-8dbb-14179225a2ec admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:15.247611 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2577dc-187b-4e3e-8dbb-14179225a2ec admin admin] PATH_INFO: `/v3/users` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:15.248445 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2577dc-187b-4e3e-8dbb-14179225a2ec admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=85204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:38:15.248747 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2577dc-187b-4e3e-8dbb-14179225a2ec admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:38:15.250929 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2577dc-187b-4e3e-8dbb-14179225a2ec admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:38:15.269361 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 499/981] 10.222.0.58 () {56 vars in 1154 bytes} [Tue Oct 12 16:38:15 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 16:38:15.275782 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ab7bb2-4a93-4850-b169-a2ef6969104b admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:38:15.285763 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ab7bb2-4a93-4850-b169-a2ef6969104b admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:38:15.290209 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10989fad-f088-400d-a868-a9d8bcaeddd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:38:15.290822 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10989fad-f088-400d-a868-a9d8bcaeddd2 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:15.291101 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10989fad-f088-400d-a868-a9d8bcaeddd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:15.291370 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10989fad-f088-400d-a868-a9d8bcaeddd2 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:15.298755 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10989fad-f088-400d-a868-a9d8bcaeddd2 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:38:15.300448 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10989fad-f088-400d-a868-a9d8bcaeddd2 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:38:15.308966 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 483/982] 10.222.0.58 () {58 vars in 1324 bytes} [Tue Oct 12 16:38:15 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:38:15.315529 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2577dc-187b-4e3e-8dbb-14179225a2ec admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:38:15.325143 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2577dc-187b-4e3e-8dbb-14179225a2ec admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:38:15.330077 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1fe520-1d4a-4456-84cf-e8cb1f0cd8d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:38:15.330845 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1fe520-1d4a-4456-84cf-e8cb1f0cd8d7 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:15.331126 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1fe520-1d4a-4456-84cf-e8cb1f0cd8d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:15.331400 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1fe520-1d4a-4456-84cf-e8cb1f0cd8d7 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:15.341139 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1fe520-1d4a-4456-84cf-e8cb1f0cd8d7 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:38:15.343555 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1fe520-1d4a-4456-84cf-e8cb1f0cd8d7 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:38:15.359484 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: WARNING keystone.server.flask.application [None req-bf1fe520-1d4a-4456-84cf-e8cb1f0cd8d7 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 16:38:15.360621 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 500/983] 10.222.0.58 () {56 vars in 1129 bytes} [Tue Oct 12 16:38:15 2021] GET /identity/v3/domains/Default => generated 87 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:38:15.367057 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10989fad-f088-400d-a868-a9d8bcaeddd2 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:38:15.376030 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10989fad-f088-400d-a868-a9d8bcaeddd2 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:38:15.380483 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a8d5f5-03f5-4adb-a627-c6ec5907b9f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:38:15.381118 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a8d5f5-03f5-4adb-a627-c6ec5907b9f1 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:15.381397 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a8d5f5-03f5-4adb-a627-c6ec5907b9f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:15.381668 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a8d5f5-03f5-4adb-a627-c6ec5907b9f1 admin admin] PATH_INFO: `/v3/domains` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:15.382425 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a8d5f5-03f5-4adb-a627-c6ec5907b9f1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:38:15.382728 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a8d5f5-03f5-4adb-a627-c6ec5907b9f1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:38:15.384279 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a8d5f5-03f5-4adb-a627-c6ec5907b9f1 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:38:15.401291 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 484/984] 10.222.0.58 () {56 vars in 1130 bytes} [Tue Oct 12 16:38:15 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:38:15.402742 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1fe520-1d4a-4456-84cf-e8cb1f0cd8d7 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:38:15.412652 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1fe520-1d4a-4456-84cf-e8cb1f0cd8d7 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:38:15.417062 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cbb4eb-70f7-40bc-8b26-0431d45e0ee2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:38:15.417826 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cbb4eb-70f7-40bc-8b26-0431d45e0ee2 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:15.418143 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cbb4eb-70f7-40bc-8b26-0431d45e0ee2 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:15.418415 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cbb4eb-70f7-40bc-8b26-0431d45e0ee2 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:15.424995 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cbb4eb-70f7-40bc-8b26-0431d45e0ee2 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:38:15.426973 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cbb4eb-70f7-40bc-8b26-0431d45e0ee2 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:38:15.440117 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: WARNING keystone.server.flask.application [None req-c6cbb4eb-70f7-40bc-8b26-0431d45e0ee2 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 16:38:15.441204 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 501/985] 10.222.0.58 () {56 vars in 1132 bytes} [Tue Oct 12 16:38:15 2021] GET /identity/v3/projects/service => generated 88 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:38:15.447688 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a8d5f5-03f5-4adb-a627-c6ec5907b9f1 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:38:15.457564 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a8d5f5-03f5-4adb-a627-c6ec5907b9f1 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:38:15.462015 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389db986-c00d-4720-9461-571d34c3f486 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:38:15.462647 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389db986-c00d-4720-9461-571d34c3f486 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:15.462926 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389db986-c00d-4720-9461-571d34c3f486 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:15.463199 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389db986-c00d-4720-9461-571d34c3f486 admin admin] PATH_INFO: `/v3/projects` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:15.463987 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389db986-c00d-4720-9461-571d34c3f486 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=85205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:38:15.464296 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389db986-c00d-4720-9461-571d34c3f486 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:38:15.466218 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389db986-c00d-4720-9461-571d34c3f486 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:38:15.478685 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 485/986] 10.222.0.58 () {56 vars in 1169 bytes} [Tue Oct 12 16:38:15 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:38:15.484968 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cbb4eb-70f7-40bc-8b26-0431d45e0ee2 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:38:15.495195 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cbb4eb-70f7-40bc-8b26-0431d45e0ee2 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:38:15.499639 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e92ea8-9f02-46d3-adb3-4e5965e2e282 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:38:15.500548 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e92ea8-9f02-46d3-adb3-4e5965e2e282 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:15.500831 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e92ea8-9f02-46d3-adb3-4e5965e2e282 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:15.501105 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e92ea8-9f02-46d3-adb3-4e5965e2e282 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:15.501968 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e92ea8-9f02-46d3-adb3-4e5965e2e282 admin admin] RBAC: Adding query filter params (role.id=5ad80b06c65f492a927df805eb69866c, scope.project.id=f3531f242eaa43b69562d70bca5ec5a8, user.id=29d30b574eec4ad3990d77d235c8b424) {{(pid=85204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:38:15.502282 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e92ea8-9f02-46d3-adb3-4e5965e2e282 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:38:15.504083 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e92ea8-9f02-46d3-adb3-4e5965e2e282 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:38:15.509600 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 502/987] 10.222.0.58 () {56 vars in 1395 bytes} [Tue Oct 12 16:38:15 2021] GET /identity/v3/role_assignments?user.id=29d30b574eec4ad3990d77d235c8b424&scope.project.id=f3531f242eaa43b69562d70bca5ec5a8&role.id=5ad80b06c65f492a927df805eb69866c => generated 608 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:38:15.759534 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ed1494-c4cb-476f-ba0e-5572c6ebe9a9 None None] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:15.759827 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ed1494-c4cb-476f-ba0e-5572c6ebe9a9 None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:15.760106 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ed1494-c4cb-476f-ba0e-5572c6ebe9a9 None None] PATH_INFO: `/` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:15.761900 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 486/988] 10.222.0.58 () {54 vars in 926 bytes} [Tue Oct 12 16:38:15 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:38:15.768797 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbb266d-ae19-40b0-beb3-088b04156e85 None None] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:15.769083 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbb266d-ae19-40b0-beb3-088b04156e85 None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:15.769357 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbb266d-ae19-40b0-beb3-088b04156e85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:15.786863 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.auth.core [None req-7fbb266d-ae19-40b0-beb3-088b04156e85 None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:38:15.788035 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-7fbb266d-ae19-40b0-beb3-088b04156e85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:38:15.795680 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 503/989] 10.222.0.58 () {58 vars in 1023 bytes} [Tue Oct 12 16:38:15 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:38:15.819799 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ed1494-c4cb-476f-ba0e-5572c6ebe9a9 None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:38:15.832613 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ed1494-c4cb-476f-ba0e-5572c6ebe9a9 None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:38:15.837016 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b707fd28-9dd2-406f-bc31-fff33593bd23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:38:15.837791 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b707fd28-9dd2-406f-bc31-fff33593bd23 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:15.838111 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b707fd28-9dd2-406f-bc31-fff33593bd23 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:15.838385 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b707fd28-9dd2-406f-bc31-fff33593bd23 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:15.848450 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b707fd28-9dd2-406f-bc31-fff33593bd23 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 16:38:15.855326 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: WARNING keystone.server.flask.application [None req-b707fd28-9dd2-406f-bc31-fff33593bd23 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 16:38:15.856493 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 487/990] 10.222.0.58 () {56 vars in 1117 bytes} [Tue Oct 12 16:38:15 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:38:15.863377 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbb266d-ae19-40b0-beb3-088b04156e85 None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:38:15.872306 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbb266d-ae19-40b0-beb3-088b04156e85 None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:38:15.877627 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f4c64a-20c6-4018-9662-f0d686c23350 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:38:15.878318 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f4c64a-20c6-4018-9662-f0d686c23350 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:15.878831 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f4c64a-20c6-4018-9662-f0d686c23350 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:15.879086 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f4c64a-20c6-4018-9662-f0d686c23350 admin admin] PATH_INFO: `/v3/roles` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:15.879611 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f4c64a-20c6-4018-9662-f0d686c23350 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=85204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:38:15.879944 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f4c64a-20c6-4018-9662-f0d686c23350 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:38:15.881513 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f4c64a-20c6-4018-9662-f0d686c23350 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:38:15.890600 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 504/991] 10.222.0.58 () {56 vars in 1120 bytes} [Tue Oct 12 16:38:15 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:38:15.897006 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b707fd28-9dd2-406f-bc31-fff33593bd23 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:38:15.907238 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b707fd28-9dd2-406f-bc31-fff33593bd23 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:38:15.911769 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7c0fa8-1447-4035-89b5-e710c83e1796 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:38:15.912624 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7c0fa8-1447-4035-89b5-e710c83e1796 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:15.912896 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7c0fa8-1447-4035-89b5-e710c83e1796 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:15.913166 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7c0fa8-1447-4035-89b5-e710c83e1796 admin admin] PATH_INFO: `/v3/users/3e78421f32bd45d7bca3b280d9b2ac9a` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:15.914402 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7c0fa8-1447-4035-89b5-e710c83e1796 admin admin] RBAC: Authorizing `identity:get_user(user_id=3e78421f32bd45d7bca3b280d9b2ac9a)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:38:15.916494 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7c0fa8-1447-4035-89b5-e710c83e1796 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:38:15.918106 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 488/992] 10.222.0.58 () {56 vars in 1198 bytes} [Tue Oct 12 16:38:15 2021] GET /identity/v3/users/3e78421f32bd45d7bca3b280d9b2ac9a => generated 285 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:38:15.924945 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f4c64a-20c6-4018-9662-f0d686c23350 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:38:15.934744 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f4c64a-20c6-4018-9662-f0d686c23350 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:38:15.939921 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f2b905-156f-4c15-a8d9-06af3c8f63ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:38:15.940764 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f2b905-156f-4c15-a8d9-06af3c8f63ce admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:15.941059 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f2b905-156f-4c15-a8d9-06af3c8f63ce admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:15.941317 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f2b905-156f-4c15-a8d9-06af3c8f63ce admin admin] PATH_INFO: `/v3/projects/0e02c6f40aa0446b8745907c5f4d05eb` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:15.942537 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f2b905-156f-4c15-a8d9-06af3c8f63ce admin admin] RBAC: Authorizing `identity:get_project(project_id=0e02c6f40aa0446b8745907c5f4d05eb)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:38:15.944573 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f2b905-156f-4c15-a8d9-06af3c8f63ce admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:38:15.946251 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 505/993] 10.222.0.58 () {56 vars in 1207 bytes} [Tue Oct 12 16:38:15 2021] GET /identity/v3/projects/0e02c6f40aa0446b8745907c5f4d05eb => generated 311 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:38:15.952775 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7c0fa8-1447-4035-89b5-e710c83e1796 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:38:15.962648 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7c0fa8-1447-4035-89b5-e710c83e1796 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:38:15.967261 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7217bc80-07e8-41c0-95cf-07315986149b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:38:15.968124 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7217bc80-07e8-41c0-95cf-07315986149b admin admin] REQUEST_METHOD: `PUT` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:15.968407 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7217bc80-07e8-41c0-95cf-07315986149b admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:15.968682 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7217bc80-07e8-41c0-95cf-07315986149b admin admin] PATH_INFO: `/v3/projects/0e02c6f40aa0446b8745907c5f4d05eb/users/3e78421f32bd45d7bca3b280d9b2ac9a/roles/610824e4f50f4fb8954610e98c1de784` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:15.970639 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7217bc80-07e8-41c0-95cf-07315986149b admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e02c6f40aa0446b8745907c5f4d05eb, user_id=3e78421f32bd45d7bca3b280d9b2ac9a, role_id=610824e4f50f4fb8954610e98c1de784)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:38:15.973219 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7217bc80-07e8-41c0-95cf-07315986149b admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:38:15.986844 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 489/994] 10.222.0.58 () {58 vars in 1460 bytes} [Tue Oct 12 16:38:15 2021] PUT /identity/v3/projects/0e02c6f40aa0446b8745907c5f4d05eb/users/3e78421f32bd45d7bca3b280d9b2ac9a/roles/610824e4f50f4fb8954610e98c1de784 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:38:18.218557 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c7f472-0c75-466b-ba4a-ab3f3fe43f27 None None] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:18.219066 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c7f472-0c75-466b-ba4a-ab3f3fe43f27 None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:18.219157 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c7f472-0c75-466b-ba4a-ab3f3fe43f27 None None] PATH_INFO: `/` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:18.220862 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 506/995] 10.222.0.58 () {54 vars in 926 bytes} [Tue Oct 12 16:38:18 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:38:18.226955 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4c67b3-e134-4121-941e-27a14f018c52 None None] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:18.227357 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4c67b3-e134-4121-941e-27a14f018c52 None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:18.227502 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4c67b3-e134-4121-941e-27a14f018c52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:18.244566 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.auth.core [None req-9b4c67b3-e134-4121-941e-27a14f018c52 None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:38:18.245756 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-9b4c67b3-e134-4121-941e-27a14f018c52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:38:18.301120 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 490/996] 10.222.0.58 () {58 vars in 1023 bytes} [Tue Oct 12 16:38:18 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:38:18.325166 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c7f472-0c75-466b-ba4a-ab3f3fe43f27 None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:38:18.337515 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c7f472-0c75-466b-ba4a-ab3f3fe43f27 None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:38:18.342523 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed65c43-fc17-4cfe-9933-e7c8dcbc8268 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:38:18.343286 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed65c43-fc17-4cfe-9933-e7c8dcbc8268 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:18.343567 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed65c43-fc17-4cfe-9933-e7c8dcbc8268 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:18.343840 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed65c43-fc17-4cfe-9933-e7c8dcbc8268 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:18.354170 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed65c43-fc17-4cfe-9933-e7c8dcbc8268 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 16:38:18.360892 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: WARNING keystone.server.flask.application [None req-aed65c43-fc17-4cfe-9933-e7c8dcbc8268 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 16:38:18.362028 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 507/997] 10.222.0.58 () {56 vars in 1117 bytes} [Tue Oct 12 16:38:18 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 16:38:18.368320 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4c67b3-e134-4121-941e-27a14f018c52 None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:38:18.377196 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4c67b3-e134-4121-941e-27a14f018c52 None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:38:18.381683 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8098e357-03d4-44ab-ab31-dd23ffe1b3e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:38:18.382358 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8098e357-03d4-44ab-ab31-dd23ffe1b3e8 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:18.382635 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8098e357-03d4-44ab-ab31-dd23ffe1b3e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:18.382905 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8098e357-03d4-44ab-ab31-dd23ffe1b3e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:18.383651 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8098e357-03d4-44ab-ab31-dd23ffe1b3e8 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=85205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:38:18.383950 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8098e357-03d4-44ab-ab31-dd23ffe1b3e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:38:18.385495 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8098e357-03d4-44ab-ab31-dd23ffe1b3e8 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:38:18.393979 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 491/998] 10.222.0.58 () {56 vars in 1120 bytes} [Tue Oct 12 16:38:18 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:38:18.400107 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed65c43-fc17-4cfe-9933-e7c8dcbc8268 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:38:18.409987 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed65c43-fc17-4cfe-9933-e7c8dcbc8268 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:38:18.414430 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c880cf-6d79-4acb-99c1-f779739faeb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:38:18.415246 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c880cf-6d79-4acb-99c1-f779739faeb6 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:18.415526 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c880cf-6d79-4acb-99c1-f779739faeb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:18.415797 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c880cf-6d79-4acb-99c1-f779739faeb6 admin admin] PATH_INFO: `/v3/users/3e78421f32bd45d7bca3b280d9b2ac9a` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:18.416988 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c880cf-6d79-4acb-99c1-f779739faeb6 admin admin] RBAC: Authorizing `identity:get_user(user_id=3e78421f32bd45d7bca3b280d9b2ac9a)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:38:18.419130 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c880cf-6d79-4acb-99c1-f779739faeb6 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:38:18.420797 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 508/999] 10.222.0.58 () {56 vars in 1198 bytes} [Tue Oct 12 16:38:18 2021] GET /identity/v3/users/3e78421f32bd45d7bca3b280d9b2ac9a => generated 285 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:38:18.426420 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8098e357-03d4-44ab-ab31-dd23ffe1b3e8 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:38:18.435431 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8098e357-03d4-44ab-ab31-dd23ffe1b3e8 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:38:18.439873 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d434f499-bd65-4856-9c4b-1c4371863f50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:38:18.440463 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d434f499-bd65-4856-9c4b-1c4371863f50 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:18.440743 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d434f499-bd65-4856-9c4b-1c4371863f50 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:18.441014 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d434f499-bd65-4856-9c4b-1c4371863f50 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:18.448412 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d434f499-bd65-4856-9c4b-1c4371863f50 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:38:18.450111 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d434f499-bd65-4856-9c4b-1c4371863f50 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:38:18.459035 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 492/1000] 10.222.0.58 () {58 vars in 1324 bytes} [Tue Oct 12 16:38:18 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 12 16:38:18.465149 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c880cf-6d79-4acb-99c1-f779739faeb6 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:38:18.474950 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c880cf-6d79-4acb-99c1-f779739faeb6 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:38:18.479523 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebd9678-8e0c-4d2f-9d78-ba744006d879 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:38:18.480336 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebd9678-8e0c-4d2f-9d78-ba744006d879 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:18.480641 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebd9678-8e0c-4d2f-9d78-ba744006d879 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:18.480915 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebd9678-8e0c-4d2f-9d78-ba744006d879 admin admin] PATH_INFO: `/v3/projects/0e02c6f40aa0446b8745907c5f4d05eb` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:18.482158 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebd9678-8e0c-4d2f-9d78-ba744006d879 admin admin] RBAC: Authorizing `identity:get_project(project_id=0e02c6f40aa0446b8745907c5f4d05eb)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:38:18.487734 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebd9678-8e0c-4d2f-9d78-ba744006d879 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:38:18.489388 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 509/1001] 10.222.0.58 () {56 vars in 1207 bytes} [Tue Oct 12 16:38:18 2021] GET /identity/v3/projects/0e02c6f40aa0446b8745907c5f4d05eb => generated 311 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:38:18.496598 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d434f499-bd65-4856-9c4b-1c4371863f50 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:38:18.506887 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d434f499-bd65-4856-9c4b-1c4371863f50 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:38:18.511765 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce29715b-b31b-4bf0-bb98-14f7a519c4c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:38:18.512400 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce29715b-b31b-4bf0-bb98-14f7a519c4c7 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:18.512687 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce29715b-b31b-4bf0-bb98-14f7a519c4c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:18.512966 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce29715b-b31b-4bf0-bb98-14f7a519c4c7 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:18.514336 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce29715b-b31b-4bf0-bb98-14f7a519c4c7 admin admin] RBAC: Adding query filter params (role.id=610824e4f50f4fb8954610e98c1de784, scope.project.id=0e02c6f40aa0446b8745907c5f4d05eb, user.id=3e78421f32bd45d7bca3b280d9b2ac9a) {{(pid=85205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:38:18.514654 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce29715b-b31b-4bf0-bb98-14f7a519c4c7 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:38:18.516456 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce29715b-b31b-4bf0-bb98-14f7a519c4c7 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:38:18.522229 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 493/1002] 10.222.0.58 () {56 vars in 1395 bytes} [Tue Oct 12 16:38:18 2021] GET /identity/v3/role_assignments?user.id=3e78421f32bd45d7bca3b280d9b2ac9a&scope.project.id=0e02c6f40aa0446b8745907c5f4d05eb&role.id=610824e4f50f4fb8954610e98c1de784 => generated 608 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 16:38:20.757143 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae789ac4-ec32-415b-9bd2-0e435b90e33b None None] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:20.757691 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae789ac4-ec32-415b-9bd2-0e435b90e33b None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:20.757691 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae789ac4-ec32-415b-9bd2-0e435b90e33b None None] PATH_INFO: `/` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:20.759478 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 510/1003] 10.222.0.58 () {54 vars in 926 bytes} [Tue Oct 12 16:38:20 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:38:20.765371 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40842132-8b91-48e1-8bd7-f18902aeb886 None None] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:20.765810 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40842132-8b91-48e1-8bd7-f18902aeb886 None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:20.765934 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40842132-8b91-48e1-8bd7-f18902aeb886 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:20.782913 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.auth.core [None req-40842132-8b91-48e1-8bd7-f18902aeb886 None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:38:20.784106 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-40842132-8b91-48e1-8bd7-f18902aeb886 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:38:20.791601 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 494/1004] 10.222.0.58 () {58 vars in 1023 bytes} [Tue Oct 12 16:38:20 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:38:20.817365 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae789ac4-ec32-415b-9bd2-0e435b90e33b None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:38:20.829176 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae789ac4-ec32-415b-9bd2-0e435b90e33b None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:38:20.833421 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92371ffe-fd5b-413f-91c9-a7095a9d4466 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:38:20.834207 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92371ffe-fd5b-413f-91c9-a7095a9d4466 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:20.834488 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92371ffe-fd5b-413f-91c9-a7095a9d4466 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:20.834758 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92371ffe-fd5b-413f-91c9-a7095a9d4466 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:20.835916 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92371ffe-fd5b-413f-91c9-a7095a9d4466 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:38:20.837571 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92371ffe-fd5b-413f-91c9-a7095a9d4466 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:38:20.839126 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 511/1005] 10.222.0.58 () {56 vars in 1129 bytes} [Tue Oct 12 16:38:20 2021] GET /identity/v3/domains/default => generated 199 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:38:20.845512 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40842132-8b91-48e1-8bd7-f18902aeb886 None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:38:20.854106 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40842132-8b91-48e1-8bd7-f18902aeb886 None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:38:20.859132 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0a1d05-69ea-4ca6-b4f2-f3c8363e194f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:38:20.859772 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0a1d05-69ea-4ca6-b4f2-f3c8363e194f admin admin] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:20.860053 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0a1d05-69ea-4ca6-b4f2-f3c8363e194f admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:20.860326 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0a1d05-69ea-4ca6-b4f2-f3c8363e194f admin admin] PATH_INFO: `/v3/users` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:20.861034 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0a1d05-69ea-4ca6-b4f2-f3c8363e194f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:38:20.862931 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0a1d05-69ea-4ca6-b4f2-f3c8363e194f admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:38:20.881651 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 495/1006] 10.222.0.58 () {60 vars in 1153 bytes} [Tue Oct 12 16:38:20 2021] POST /identity/v3/users => generated 286 bytes in 37 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 16:38:23.129165 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7e7234-277d-4698-9503-c6c498a162e1 None None] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:23.129662 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7e7234-277d-4698-9503-c6c498a162e1 None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:23.129662 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7e7234-277d-4698-9503-c6c498a162e1 None None] PATH_INFO: `/` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:23.131434 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 512/1007] 10.222.0.58 () {54 vars in 926 bytes} [Tue Oct 12 16:38:23 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:38:23.137357 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b02fa4-ffe9-4a38-85cf-2ec2728c0366 None None] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:23.137753 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b02fa4-ffe9-4a38-85cf-2ec2728c0366 None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:23.137949 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b02fa4-ffe9-4a38-85cf-2ec2728c0366 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:23.155519 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.auth.core [None req-b8b02fa4-ffe9-4a38-85cf-2ec2728c0366 None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:38:23.156692 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-b8b02fa4-ffe9-4a38-85cf-2ec2728c0366 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:38:23.164256 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 496/1008] 10.222.0.58 () {58 vars in 1023 bytes} [Tue Oct 12 16:38:23 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:38:23.188894 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7e7234-277d-4698-9503-c6c498a162e1 None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:38:23.200666 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7e7234-277d-4698-9503-c6c498a162e1 None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:38:23.204997 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d269717-f8cb-409d-b3b4-9256542cc2bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:38:23.205812 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d269717-f8cb-409d-b3b4-9256542cc2bb admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:23.206125 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d269717-f8cb-409d-b3b4-9256542cc2bb admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:23.206402 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d269717-f8cb-409d-b3b4-9256542cc2bb admin admin] PATH_INFO: `/v3/roles/638eb220c5a346cb8cf0e7128f938c65` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:23.207872 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d269717-f8cb-409d-b3b4-9256542cc2bb admin admin] RBAC: Authorizing `identity:get_role(role_id=638eb220c5a346cb8cf0e7128f938c65)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:38:23.208875 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: WARNING py.warnings [None req-8d269717-f8cb-409d-b3b4-9256542cc2bb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:get_role failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 12 16:38:23.208875 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: warnings.warn(msg) Oct 12 16:38:23.208875 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: Oct 12 16:38:23.209731 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d269717-f8cb-409d-b3b4-9256542cc2bb admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:38:23.211038 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 513/1009] 10.222.0.58 () {56 vars in 1198 bytes} [Tue Oct 12 16:38:23 2021] GET /identity/v3/roles/638eb220c5a346cb8cf0e7128f938c65 => generated 223 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 16:38:23.217254 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b02fa4-ffe9-4a38-85cf-2ec2728c0366 None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:38:23.225769 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b02fa4-ffe9-4a38-85cf-2ec2728c0366 None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:38:23.230240 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b28af9-00a9-4bc4-bc8e-c11a2abff6a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:38:23.231077 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b28af9-00a9-4bc4-bc8e-c11a2abff6a8 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:23.231359 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b28af9-00a9-4bc4-bc8e-c11a2abff6a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:23.231687 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b28af9-00a9-4bc4-bc8e-c11a2abff6a8 admin admin] PATH_INFO: `/v3/users/a281f63371c54748b4003d341895e37e` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:23.244647 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b28af9-00a9-4bc4-bc8e-c11a2abff6a8 admin admin] RBAC: Authorizing `identity:get_user(user_id=a281f63371c54748b4003d341895e37e)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:38:23.246758 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b28af9-00a9-4bc4-bc8e-c11a2abff6a8 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:38:23.248376 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 497/1010] 10.222.0.58 () {56 vars in 1198 bytes} [Tue Oct 12 16:38:23 2021] GET /identity/v3/users/a281f63371c54748b4003d341895e37e => generated 286 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:38:23.254692 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d269717-f8cb-409d-b3b4-9256542cc2bb admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:38:23.263845 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d269717-f8cb-409d-b3b4-9256542cc2bb admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:38:23.268695 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebea4cda-7439-49ac-9b12-7d7d9ec2000a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:38:23.269307 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebea4cda-7439-49ac-9b12-7d7d9ec2000a admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:23.269592 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebea4cda-7439-49ac-9b12-7d7d9ec2000a admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:23.269867 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebea4cda-7439-49ac-9b12-7d7d9ec2000a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:23.277482 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebea4cda-7439-49ac-9b12-7d7d9ec2000a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:38:23.279706 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebea4cda-7439-49ac-9b12-7d7d9ec2000a admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:38:23.288296 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 514/1011] 10.222.0.58 () {58 vars in 1324 bytes} [Tue Oct 12 16:38:23 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:38:23.295069 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b28af9-00a9-4bc4-bc8e-c11a2abff6a8 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:38:23.304267 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b28af9-00a9-4bc4-bc8e-c11a2abff6a8 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:38:23.308718 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfeb1f01-a97a-48f3-82d9-42d977dc087f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:38:23.309531 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfeb1f01-a97a-48f3-82d9-42d977dc087f admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:23.309815 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfeb1f01-a97a-48f3-82d9-42d977dc087f admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:23.310119 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfeb1f01-a97a-48f3-82d9-42d977dc087f admin admin] PATH_INFO: `/v3/projects/0e02c6f40aa0446b8745907c5f4d05eb` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:23.311301 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfeb1f01-a97a-48f3-82d9-42d977dc087f admin admin] RBAC: Authorizing `identity:get_project(project_id=0e02c6f40aa0446b8745907c5f4d05eb)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:38:23.313281 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfeb1f01-a97a-48f3-82d9-42d977dc087f admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:38:23.314926 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 498/1012] 10.222.0.58 () {56 vars in 1207 bytes} [Tue Oct 12 16:38:23 2021] GET /identity/v3/projects/0e02c6f40aa0446b8745907c5f4d05eb => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:38:23.320942 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebea4cda-7439-49ac-9b12-7d7d9ec2000a admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:38:23.329240 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebea4cda-7439-49ac-9b12-7d7d9ec2000a admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:38:23.333656 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834199ea-12ba-47e8-8bc2-38c170c4ead5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:38:23.334295 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834199ea-12ba-47e8-8bc2-38c170c4ead5 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:23.334574 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834199ea-12ba-47e8-8bc2-38c170c4ead5 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:23.334844 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834199ea-12ba-47e8-8bc2-38c170c4ead5 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:23.335655 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834199ea-12ba-47e8-8bc2-38c170c4ead5 admin admin] RBAC: Adding query filter params (role.id=638eb220c5a346cb8cf0e7128f938c65, scope.project.id=0e02c6f40aa0446b8745907c5f4d05eb, user.id=a281f63371c54748b4003d341895e37e) {{(pid=85204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:38:23.335962 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834199ea-12ba-47e8-8bc2-38c170c4ead5 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:38:23.337691 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834199ea-12ba-47e8-8bc2-38c170c4ead5 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:38:23.343222 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 515/1013] 10.222.0.58 () {56 vars in 1395 bytes} [Tue Oct 12 16:38:23 2021] GET /identity/v3/role_assignments?user.id=a281f63371c54748b4003d341895e37e&scope.project.id=0e02c6f40aa0446b8745907c5f4d05eb&role.id=638eb220c5a346cb8cf0e7128f938c65 => generated 259 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 16:38:25.522281 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3731838-b4eb-4ce1-badb-67d671f37dc7 None None] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:25.522810 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3731838-b4eb-4ce1-badb-67d671f37dc7 None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:25.522810 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3731838-b4eb-4ce1-badb-67d671f37dc7 None None] PATH_INFO: `/` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:25.524610 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 499/1014] 10.222.0.58 () {54 vars in 926 bytes} [Tue Oct 12 16:38:25 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:38:25.530390 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41571909-1014-4201-8bf3-d8adde95c688 None None] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:25.530757 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41571909-1014-4201-8bf3-d8adde95c688 None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:25.530938 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41571909-1014-4201-8bf3-d8adde95c688 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:25.548093 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.auth.core [None req-41571909-1014-4201-8bf3-d8adde95c688 None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:38:25.549258 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-41571909-1014-4201-8bf3-d8adde95c688 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:38:25.556731 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 516/1015] 10.222.0.58 () {58 vars in 1023 bytes} [Tue Oct 12 16:38:25 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:38:25.580294 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3731838-b4eb-4ce1-badb-67d671f37dc7 None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:38:25.592173 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3731838-b4eb-4ce1-badb-67d671f37dc7 None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:38:25.596541 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6356b448-6179-459a-9532-124915b6035a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:38:25.597359 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6356b448-6179-459a-9532-124915b6035a admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:25.597643 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6356b448-6179-459a-9532-124915b6035a admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:25.597952 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6356b448-6179-459a-9532-124915b6035a admin admin] PATH_INFO: `/v3/roles/638eb220c5a346cb8cf0e7128f938c65` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:25.599436 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6356b448-6179-459a-9532-124915b6035a admin admin] RBAC: Authorizing `identity:get_role(role_id=638eb220c5a346cb8cf0e7128f938c65)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:38:25.600433 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: WARNING py.warnings [None req-6356b448-6179-459a-9532-124915b6035a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:get_role failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 12 16:38:25.600433 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: warnings.warn(msg) Oct 12 16:38:25.600433 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: Oct 12 16:38:25.601297 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6356b448-6179-459a-9532-124915b6035a admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:38:25.602626 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 500/1016] 10.222.0.58 () {56 vars in 1198 bytes} [Tue Oct 12 16:38:25 2021] GET /identity/v3/roles/638eb220c5a346cb8cf0e7128f938c65 => generated 223 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:38:25.608510 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41571909-1014-4201-8bf3-d8adde95c688 None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:38:25.616975 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41571909-1014-4201-8bf3-d8adde95c688 None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:38:25.621347 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da366a4f-faaa-4fcb-b5ad-4eda5dbad2a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:38:25.622742 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da366a4f-faaa-4fcb-b5ad-4eda5dbad2a3 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:25.623019 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da366a4f-faaa-4fcb-b5ad-4eda5dbad2a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:25.623288 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da366a4f-faaa-4fcb-b5ad-4eda5dbad2a3 admin admin] PATH_INFO: `/v3/users/a281f63371c54748b4003d341895e37e` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:25.624464 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da366a4f-faaa-4fcb-b5ad-4eda5dbad2a3 admin admin] RBAC: Authorizing `identity:get_user(user_id=a281f63371c54748b4003d341895e37e)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:38:25.626829 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da366a4f-faaa-4fcb-b5ad-4eda5dbad2a3 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:38:25.628339 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 517/1017] 10.222.0.58 () {56 vars in 1198 bytes} [Tue Oct 12 16:38:25 2021] GET /identity/v3/users/a281f63371c54748b4003d341895e37e => generated 286 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:38:25.634160 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6356b448-6179-459a-9532-124915b6035a admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:38:25.643846 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6356b448-6179-459a-9532-124915b6035a admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:38:25.648383 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d07e3e0-995d-4872-bc75-bcfef02ff6e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:38:25.649165 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d07e3e0-995d-4872-bc75-bcfef02ff6e5 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:25.649449 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d07e3e0-995d-4872-bc75-bcfef02ff6e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:25.649726 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d07e3e0-995d-4872-bc75-bcfef02ff6e5 admin admin] PATH_INFO: `/v3/projects/0e02c6f40aa0446b8745907c5f4d05eb` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:25.650936 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d07e3e0-995d-4872-bc75-bcfef02ff6e5 admin admin] RBAC: Authorizing `identity:get_project(project_id=0e02c6f40aa0446b8745907c5f4d05eb)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:38:25.652890 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d07e3e0-995d-4872-bc75-bcfef02ff6e5 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:38:25.654649 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 501/1018] 10.222.0.58 () {56 vars in 1207 bytes} [Tue Oct 12 16:38:25 2021] GET /identity/v3/projects/0e02c6f40aa0446b8745907c5f4d05eb => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:38:25.660279 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da366a4f-faaa-4fcb-b5ad-4eda5dbad2a3 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:38:25.669712 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da366a4f-faaa-4fcb-b5ad-4eda5dbad2a3 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:38:25.674101 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd1f516-a918-4504-8bf6-be5987e0fbc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:38:25.674922 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd1f516-a918-4504-8bf6-be5987e0fbc6 admin admin] REQUEST_METHOD: `PUT` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:25.675202 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd1f516-a918-4504-8bf6-be5987e0fbc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:25.675472 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd1f516-a918-4504-8bf6-be5987e0fbc6 admin admin] PATH_INFO: `/v3/projects/0e02c6f40aa0446b8745907c5f4d05eb/users/a281f63371c54748b4003d341895e37e/roles/638eb220c5a346cb8cf0e7128f938c65` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:25.677611 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd1f516-a918-4504-8bf6-be5987e0fbc6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e02c6f40aa0446b8745907c5f4d05eb, user_id=a281f63371c54748b4003d341895e37e, role_id=638eb220c5a346cb8cf0e7128f938c65)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:38:25.680148 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd1f516-a918-4504-8bf6-be5987e0fbc6 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:38:25.693103 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 518/1019] 10.222.0.58 () {58 vars in 1460 bytes} [Tue Oct 12 16:38:25 2021] PUT /identity/v3/projects/0e02c6f40aa0446b8745907c5f4d05eb/users/a281f63371c54748b4003d341895e37e/roles/638eb220c5a346cb8cf0e7128f938c65 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:38:27.901634 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc77870c-23a4-473c-b8b3-dadbe5697516 None None] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:27.902187 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc77870c-23a4-473c-b8b3-dadbe5697516 None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:27.902304 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc77870c-23a4-473c-b8b3-dadbe5697516 None None] PATH_INFO: `/` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:27.904466 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 502/1020] 10.222.0.58 () {54 vars in 926 bytes} [Tue Oct 12 16:38:27 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:38:27.910422 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df5396f-db55-44b7-b923-1d1a75ea39c0 None None] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:27.910817 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df5396f-db55-44b7-b923-1d1a75ea39c0 None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:27.911016 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df5396f-db55-44b7-b923-1d1a75ea39c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:27.928680 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.auth.core [None req-0df5396f-db55-44b7-b923-1d1a75ea39c0 None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:38:27.929866 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-0df5396f-db55-44b7-b923-1d1a75ea39c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:38:27.985168 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 519/1021] 10.222.0.58 () {58 vars in 1023 bytes} [Tue Oct 12 16:38:27 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:38:28.009359 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc77870c-23a4-473c-b8b3-dadbe5697516 None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:38:28.021569 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc77870c-23a4-473c-b8b3-dadbe5697516 None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:38:28.025798 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b360cb-3a31-48ce-904d-70f692cb0ed1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:38:28.026644 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b360cb-3a31-48ce-904d-70f692cb0ed1 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:28.026924 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b360cb-3a31-48ce-904d-70f692cb0ed1 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:28.027194 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b360cb-3a31-48ce-904d-70f692cb0ed1 admin admin] PATH_INFO: `/v3/roles/638eb220c5a346cb8cf0e7128f938c65` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:28.029242 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b360cb-3a31-48ce-904d-70f692cb0ed1 admin admin] RBAC: Authorizing `identity:get_role(role_id=638eb220c5a346cb8cf0e7128f938c65)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:38:28.030824 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b360cb-3a31-48ce-904d-70f692cb0ed1 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:38:28.032112 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 503/1022] 10.222.0.58 () {56 vars in 1198 bytes} [Tue Oct 12 16:38:28 2021] GET /identity/v3/roles/638eb220c5a346cb8cf0e7128f938c65 => generated 223 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 16:38:28.037889 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df5396f-db55-44b7-b923-1d1a75ea39c0 None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:38:28.046347 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df5396f-db55-44b7-b923-1d1a75ea39c0 None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:38:28.050780 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23d218f-1826-4a57-ba05-c2ac140f8011 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:38:28.051613 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23d218f-1826-4a57-ba05-c2ac140f8011 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:28.051894 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23d218f-1826-4a57-ba05-c2ac140f8011 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:28.052163 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23d218f-1826-4a57-ba05-c2ac140f8011 admin admin] PATH_INFO: `/v3/users/a281f63371c54748b4003d341895e37e` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:28.053354 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23d218f-1826-4a57-ba05-c2ac140f8011 admin admin] RBAC: Authorizing `identity:get_user(user_id=a281f63371c54748b4003d341895e37e)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:38:28.055471 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23d218f-1826-4a57-ba05-c2ac140f8011 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:38:28.056989 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 520/1023] 10.222.0.58 () {56 vars in 1198 bytes} [Tue Oct 12 16:38:28 2021] GET /identity/v3/users/a281f63371c54748b4003d341895e37e => generated 286 bytes in 19 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 16:38:28.062718 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b360cb-3a31-48ce-904d-70f692cb0ed1 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:38:28.071619 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b360cb-3a31-48ce-904d-70f692cb0ed1 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:38:28.076554 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2519bf43-2749-4c6c-a309-1a8b0fab46e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:38:28.077144 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2519bf43-2749-4c6c-a309-1a8b0fab46e2 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:28.077427 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2519bf43-2749-4c6c-a309-1a8b0fab46e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:28.077702 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2519bf43-2749-4c6c-a309-1a8b0fab46e2 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:28.085100 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2519bf43-2749-4c6c-a309-1a8b0fab46e2 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:38:28.086777 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2519bf43-2749-4c6c-a309-1a8b0fab46e2 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:38:28.095785 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 504/1024] 10.222.0.58 () {58 vars in 1324 bytes} [Tue Oct 12 16:38:28 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:38:28.101564 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23d218f-1826-4a57-ba05-c2ac140f8011 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:38:28.110470 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23d218f-1826-4a57-ba05-c2ac140f8011 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:38:28.114873 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519b5642-8a4c-4995-b7b6-82d7d572ed24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:38:28.115641 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519b5642-8a4c-4995-b7b6-82d7d572ed24 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:28.115923 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519b5642-8a4c-4995-b7b6-82d7d572ed24 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:28.116197 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519b5642-8a4c-4995-b7b6-82d7d572ed24 admin admin] PATH_INFO: `/v3/projects/0e02c6f40aa0446b8745907c5f4d05eb` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:28.117349 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519b5642-8a4c-4995-b7b6-82d7d572ed24 admin admin] RBAC: Authorizing `identity:get_project(project_id=0e02c6f40aa0446b8745907c5f4d05eb)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:38:28.119327 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519b5642-8a4c-4995-b7b6-82d7d572ed24 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:38:28.121011 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 521/1025] 10.222.0.58 () {56 vars in 1207 bytes} [Tue Oct 12 16:38:28 2021] GET /identity/v3/projects/0e02c6f40aa0446b8745907c5f4d05eb => generated 311 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:38:28.127196 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2519bf43-2749-4c6c-a309-1a8b0fab46e2 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:38:28.135284 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2519bf43-2749-4c6c-a309-1a8b0fab46e2 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:38:28.140205 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ba8cd8-edb8-4ba7-97a0-2a9d4c0a718e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:38:28.140790 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ba8cd8-edb8-4ba7-97a0-2a9d4c0a718e admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:28.141070 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ba8cd8-edb8-4ba7-97a0-2a9d4c0a718e admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:28.141343 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ba8cd8-edb8-4ba7-97a0-2a9d4c0a718e admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:28.142200 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ba8cd8-edb8-4ba7-97a0-2a9d4c0a718e admin admin] RBAC: Adding query filter params (role.id=638eb220c5a346cb8cf0e7128f938c65, scope.project.id=0e02c6f40aa0446b8745907c5f4d05eb, user.id=a281f63371c54748b4003d341895e37e) {{(pid=85205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:38:28.142508 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ba8cd8-edb8-4ba7-97a0-2a9d4c0a718e admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:38:28.144225 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ba8cd8-edb8-4ba7-97a0-2a9d4c0a718e admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:38:28.149673 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 505/1026] 10.222.0.58 () {56 vars in 1395 bytes} [Tue Oct 12 16:38:28 2021] GET /identity/v3/role_assignments?user.id=a281f63371c54748b4003d341895e37e&scope.project.id=0e02c6f40aa0446b8745907c5f4d05eb&role.id=638eb220c5a346cb8cf0e7128f938c65 => generated 608 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 16:38:30.376670 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6f905a-f8dc-4c0e-b77a-df3b31eec308 None None] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:30.377196 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6f905a-f8dc-4c0e-b77a-df3b31eec308 None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:30.377196 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6f905a-f8dc-4c0e-b77a-df3b31eec308 None None] PATH_INFO: `/` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:30.378998 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 522/1027] 10.222.0.58 () {54 vars in 926 bytes} [Tue Oct 12 16:38:30 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:38:30.384931 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ffcbb1-d9ad-4134-87ff-50e40598bc79 None None] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:30.385353 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ffcbb1-d9ad-4134-87ff-50e40598bc79 None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:30.385479 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ffcbb1-d9ad-4134-87ff-50e40598bc79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:30.402655 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.auth.core [None req-91ffcbb1-d9ad-4134-87ff-50e40598bc79 None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:38:30.403844 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-91ffcbb1-d9ad-4134-87ff-50e40598bc79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:38:30.411291 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 506/1028] 10.222.0.58 () {58 vars in 1023 bytes} [Tue Oct 12 16:38:30 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:38:30.436008 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6f905a-f8dc-4c0e-b77a-df3b31eec308 None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:38:30.447604 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6f905a-f8dc-4c0e-b77a-df3b31eec308 None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:38:30.452184 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b419cc36-a7f0-453b-832e-9f690db46d1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:38:30.452929 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b419cc36-a7f0-453b-832e-9f690db46d1a admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:30.453205 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b419cc36-a7f0-453b-832e-9f690db46d1a admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:30.453470 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b419cc36-a7f0-453b-832e-9f690db46d1a admin admin] PATH_INFO: `/v3/domains/default` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:30.454640 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b419cc36-a7f0-453b-832e-9f690db46d1a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:38:30.456290 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b419cc36-a7f0-453b-832e-9f690db46d1a admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:38:30.457788 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 523/1029] 10.222.0.58 () {56 vars in 1129 bytes} [Tue Oct 12 16:38:30 2021] GET /identity/v3/domains/default => generated 199 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:38:30.463662 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ffcbb1-d9ad-4134-87ff-50e40598bc79 None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:38:30.472091 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ffcbb1-d9ad-4134-87ff-50e40598bc79 None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:38:30.476469 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4111be85-7649-4d13-b32e-7c130de3ac37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:38:30.477088 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4111be85-7649-4d13-b32e-7c130de3ac37 admin admin] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:30.477367 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4111be85-7649-4d13-b32e-7c130de3ac37 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:30.477657 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4111be85-7649-4d13-b32e-7c130de3ac37 admin admin] PATH_INFO: `/v3/projects` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:30.478399 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4111be85-7649-4d13-b32e-7c130de3ac37 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:38:30.480247 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4111be85-7649-4d13-b32e-7c130de3ac37 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:38:30.506112 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 507/1030] 10.222.0.58 () {60 vars in 1162 bytes} [Tue Oct 12 16:38:30 2021] POST /identity/v3/projects => generated 311 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:38:32.752965 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08453788-741a-4539-8080-b3a5fed57b07 None None] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:32.753596 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08453788-741a-4539-8080-b3a5fed57b07 None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:32.753596 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08453788-741a-4539-8080-b3a5fed57b07 None None] PATH_INFO: `/` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:32.755295 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 524/1031] 10.222.0.58 () {54 vars in 926 bytes} [Tue Oct 12 16:38:32 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:38:32.761108 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a17f27a-8ec7-4ff0-866e-6ad602a94a56 None None] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:32.761536 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a17f27a-8ec7-4ff0-866e-6ad602a94a56 None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:32.761643 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a17f27a-8ec7-4ff0-866e-6ad602a94a56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:32.780002 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.auth.core [None req-6a17f27a-8ec7-4ff0-866e-6ad602a94a56 None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:38:32.781223 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-6a17f27a-8ec7-4ff0-866e-6ad602a94a56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:38:32.835169 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 508/1032] 10.222.0.58 () {58 vars in 1023 bytes} [Tue Oct 12 16:38:32 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:38:32.860530 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08453788-741a-4539-8080-b3a5fed57b07 None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:38:32.872918 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08453788-741a-4539-8080-b3a5fed57b07 None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:38:32.877536 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50d1f4f-9fbd-4cdb-8af1-a151600b0a9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:38:32.878333 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50d1f4f-9fbd-4cdb-8af1-a151600b0a9f admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:32.878617 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50d1f4f-9fbd-4cdb-8af1-a151600b0a9f admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:32.878892 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50d1f4f-9fbd-4cdb-8af1-a151600b0a9f admin admin] PATH_INFO: `/v3/domains/default` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:32.880062 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50d1f4f-9fbd-4cdb-8af1-a151600b0a9f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:38:32.881732 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50d1f4f-9fbd-4cdb-8af1-a151600b0a9f admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:38:32.883306 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 525/1033] 10.222.0.58 () {56 vars in 1129 bytes} [Tue Oct 12 16:38:32 2021] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:38:32.889631 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a17f27a-8ec7-4ff0-866e-6ad602a94a56 None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:38:32.898235 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a17f27a-8ec7-4ff0-866e-6ad602a94a56 None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:38:32.902775 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863054aa-0a88-48dd-afa1-78c1c6c2f03a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:38:32.903464 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863054aa-0a88-48dd-afa1-78c1c6c2f03a admin admin] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:32.903749 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863054aa-0a88-48dd-afa1-78c1c6c2f03a admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:32.904025 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863054aa-0a88-48dd-afa1-78c1c6c2f03a admin admin] PATH_INFO: `/v3/users` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:32.904754 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863054aa-0a88-48dd-afa1-78c1c6c2f03a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:38:32.906694 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863054aa-0a88-48dd-afa1-78c1c6c2f03a admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:38:32.925273 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 509/1034] 10.222.0.58 () {60 vars in 1153 bytes} [Tue Oct 12 16:38:32 2021] POST /identity/v3/users => generated 286 bytes in 36 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 16:38:35.182873 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6616b2f-d69c-4074-8787-d1ab68e0aa5f None None] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:35.183380 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6616b2f-d69c-4074-8787-d1ab68e0aa5f None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:35.183484 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6616b2f-d69c-4074-8787-d1ab68e0aa5f None None] PATH_INFO: `/` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:35.185184 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 526/1035] 10.222.0.58 () {54 vars in 926 bytes} [Tue Oct 12 16:38:35 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:38:35.191065 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e7732d-37da-427c-89db-c33f18d94f48 None None] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:35.191451 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e7732d-37da-427c-89db-c33f18d94f48 None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:35.191618 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e7732d-37da-427c-89db-c33f18d94f48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:35.214653 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.auth.core [None req-a9e7732d-37da-427c-89db-c33f18d94f48 None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:38:35.216565 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-a9e7732d-37da-427c-89db-c33f18d94f48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:38:35.224214 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 510/1036] 10.222.0.58 () {58 vars in 1023 bytes} [Tue Oct 12 16:38:35 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:38:35.248875 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6616b2f-d69c-4074-8787-d1ab68e0aa5f None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:38:35.260758 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6616b2f-d69c-4074-8787-d1ab68e0aa5f None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:38:35.265074 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f25ae0-baa9-45e4-8c67-028b80e0f1be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:38:35.265837 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f25ae0-baa9-45e4-8c67-028b80e0f1be admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:35.266149 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f25ae0-baa9-45e4-8c67-028b80e0f1be admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:35.266465 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f25ae0-baa9-45e4-8c67-028b80e0f1be admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:35.276928 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f25ae0-baa9-45e4-8c67-028b80e0f1be admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 16:38:35.284245 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: WARNING keystone.server.flask.application [None req-34f25ae0-baa9-45e4-8c67-028b80e0f1be admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 16:38:35.285361 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 527/1037] 10.222.0.58 () {56 vars in 1117 bytes} [Tue Oct 12 16:38:35 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:38:35.291684 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e7732d-37da-427c-89db-c33f18d94f48 None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:38:35.301004 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e7732d-37da-427c-89db-c33f18d94f48 None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:38:35.305504 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f9013f-d5df-4139-82ed-c4c090524844 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:38:35.306193 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f9013f-d5df-4139-82ed-c4c090524844 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:35.306474 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f9013f-d5df-4139-82ed-c4c090524844 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:35.306747 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f9013f-d5df-4139-82ed-c4c090524844 admin admin] PATH_INFO: `/v3/roles` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:35.307501 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f9013f-d5df-4139-82ed-c4c090524844 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=85205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:38:35.307808 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f9013f-d5df-4139-82ed-c4c090524844 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:38:35.309424 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f9013f-d5df-4139-82ed-c4c090524844 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:38:35.317324 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 511/1038] 10.222.0.58 () {56 vars in 1120 bytes} [Tue Oct 12 16:38:35 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:38:35.323233 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f25ae0-baa9-45e4-8c67-028b80e0f1be admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:38:35.332862 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f25ae0-baa9-45e4-8c67-028b80e0f1be admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:38:35.337242 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84351462-f2ba-471d-a807-afe68042efc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:38:35.338082 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84351462-f2ba-471d-a807-afe68042efc8 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:35.338362 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84351462-f2ba-471d-a807-afe68042efc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:35.338633 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84351462-f2ba-471d-a807-afe68042efc8 admin admin] PATH_INFO: `/v3/users/73e2d657af2e4c94b01fd3fdc6e8e341` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:35.351723 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84351462-f2ba-471d-a807-afe68042efc8 admin admin] RBAC: Authorizing `identity:get_user(user_id=73e2d657af2e4c94b01fd3fdc6e8e341)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:38:35.353816 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84351462-f2ba-471d-a807-afe68042efc8 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:38:35.355425 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 528/1039] 10.222.0.58 () {56 vars in 1198 bytes} [Tue Oct 12 16:38:35 2021] GET /identity/v3/users/73e2d657af2e4c94b01fd3fdc6e8e341 => generated 286 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 16:38:35.361917 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f9013f-d5df-4139-82ed-c4c090524844 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:38:35.371049 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f9013f-d5df-4139-82ed-c4c090524844 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:38:35.375797 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02996c7-4edb-4c0e-9378-4fe32858af80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:38:35.376407 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02996c7-4edb-4c0e-9378-4fe32858af80 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:35.376688 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02996c7-4edb-4c0e-9378-4fe32858af80 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:35.376962 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02996c7-4edb-4c0e-9378-4fe32858af80 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:35.384499 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02996c7-4edb-4c0e-9378-4fe32858af80 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:38:35.386221 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02996c7-4edb-4c0e-9378-4fe32858af80 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:38:35.394848 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 512/1040] 10.222.0.58 () {58 vars in 1324 bytes} [Tue Oct 12 16:38:35 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:38:35.400713 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84351462-f2ba-471d-a807-afe68042efc8 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:38:35.410165 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84351462-f2ba-471d-a807-afe68042efc8 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:38:35.414562 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a787feaf-4bbd-4e4f-b4ec-f5ec509b866f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:38:35.415353 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a787feaf-4bbd-4e4f-b4ec-f5ec509b866f admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:35.415632 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a787feaf-4bbd-4e4f-b4ec-f5ec509b866f admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:35.415903 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a787feaf-4bbd-4e4f-b4ec-f5ec509b866f admin admin] PATH_INFO: `/v3/projects/7ad5e168316c4f9495f58192944eaf86` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:35.417040 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a787feaf-4bbd-4e4f-b4ec-f5ec509b866f admin admin] RBAC: Authorizing `identity:get_project(project_id=7ad5e168316c4f9495f58192944eaf86)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:38:35.419595 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a787feaf-4bbd-4e4f-b4ec-f5ec509b866f admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:38:35.421149 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 529/1041] 10.222.0.58 () {56 vars in 1207 bytes} [Tue Oct 12 16:38:35 2021] GET /identity/v3/projects/7ad5e168316c4f9495f58192944eaf86 => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:38:35.427031 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02996c7-4edb-4c0e-9378-4fe32858af80 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:38:35.435328 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02996c7-4edb-4c0e-9378-4fe32858af80 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:38:35.439754 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449fcf5c-fe19-4dbb-b8eb-11fb2c2e3068 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:38:35.440348 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449fcf5c-fe19-4dbb-b8eb-11fb2c2e3068 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:35.440628 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449fcf5c-fe19-4dbb-b8eb-11fb2c2e3068 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:35.440901 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449fcf5c-fe19-4dbb-b8eb-11fb2c2e3068 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:35.441719 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449fcf5c-fe19-4dbb-b8eb-11fb2c2e3068 admin admin] RBAC: Adding query filter params (role.id=610824e4f50f4fb8954610e98c1de784, scope.project.id=7ad5e168316c4f9495f58192944eaf86, user.id=73e2d657af2e4c94b01fd3fdc6e8e341) {{(pid=85205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:38:35.442072 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449fcf5c-fe19-4dbb-b8eb-11fb2c2e3068 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:38:35.443804 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449fcf5c-fe19-4dbb-b8eb-11fb2c2e3068 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:38:35.448993 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 513/1042] 10.222.0.58 () {56 vars in 1395 bytes} [Tue Oct 12 16:38:35 2021] GET /identity/v3/role_assignments?user.id=73e2d657af2e4c94b01fd3fdc6e8e341&scope.project.id=7ad5e168316c4f9495f58192944eaf86&role.id=610824e4f50f4fb8954610e98c1de784 => generated 259 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 16:38:37.630314 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8d9ee7-054e-4c8c-b2cb-83ca6208b1c4 None None] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:37.630877 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8d9ee7-054e-4c8c-b2cb-83ca6208b1c4 None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:37.630877 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8d9ee7-054e-4c8c-b2cb-83ca6208b1c4 None None] PATH_INFO: `/` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:37.632608 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 530/1043] 10.222.0.58 () {54 vars in 926 bytes} [Tue Oct 12 16:38:37 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 12 16:38:37.639003 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d67c9e-ac75-482d-99ff-85f05d4c3284 None None] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:37.639408 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d67c9e-ac75-482d-99ff-85f05d4c3284 None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:37.639552 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d67c9e-ac75-482d-99ff-85f05d4c3284 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:37.656511 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.auth.core [None req-22d67c9e-ac75-482d-99ff-85f05d4c3284 None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:38:37.657673 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-22d67c9e-ac75-482d-99ff-85f05d4c3284 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:38:37.665091 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 514/1044] 10.222.0.58 () {58 vars in 1023 bytes} [Tue Oct 12 16:38:37 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:38:37.689101 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8d9ee7-054e-4c8c-b2cb-83ca6208b1c4 None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:38:37.700929 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8d9ee7-054e-4c8c-b2cb-83ca6208b1c4 None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:38:37.705152 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b63688-ffee-47a0-aa54-fe91f03958e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:38:37.705934 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b63688-ffee-47a0-aa54-fe91f03958e9 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:37.706219 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b63688-ffee-47a0-aa54-fe91f03958e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:37.706496 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b63688-ffee-47a0-aa54-fe91f03958e9 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:37.716324 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b63688-ffee-47a0-aa54-fe91f03958e9 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 16:38:37.723033 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: WARNING keystone.server.flask.application [None req-92b63688-ffee-47a0-aa54-fe91f03958e9 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 16:38:37.724124 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 531/1045] 10.222.0.58 () {56 vars in 1117 bytes} [Tue Oct 12 16:38:37 2021] GET /identity/v3/roles/admin => generated 83 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:38:37.730326 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d67c9e-ac75-482d-99ff-85f05d4c3284 None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:38:37.739309 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d67c9e-ac75-482d-99ff-85f05d4c3284 None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:38:37.743698 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6e0de9-4990-4fe6-824f-aa622797e09b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:38:37.744339 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6e0de9-4990-4fe6-824f-aa622797e09b admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:37.744619 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6e0de9-4990-4fe6-824f-aa622797e09b admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:37.744891 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6e0de9-4990-4fe6-824f-aa622797e09b admin admin] PATH_INFO: `/v3/roles` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:37.745642 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6e0de9-4990-4fe6-824f-aa622797e09b admin admin] RBAC: Adding query filter params (name=admin) {{(pid=85205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:38:37.745977 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6e0de9-4990-4fe6-824f-aa622797e09b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:38:37.748202 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6e0de9-4990-4fe6-824f-aa622797e09b admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:38:37.756477 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 515/1046] 10.222.0.58 () {56 vars in 1120 bytes} [Tue Oct 12 16:38:37 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:38:37.762776 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b63688-ffee-47a0-aa54-fe91f03958e9 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:38:37.772564 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b63688-ffee-47a0-aa54-fe91f03958e9 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:38:37.776984 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbda717f-47a5-4b91-b0a5-751dc1d93c92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:38:37.777828 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbda717f-47a5-4b91-b0a5-751dc1d93c92 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:37.778302 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbda717f-47a5-4b91-b0a5-751dc1d93c92 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:37.778584 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbda717f-47a5-4b91-b0a5-751dc1d93c92 admin admin] PATH_INFO: `/v3/users/73e2d657af2e4c94b01fd3fdc6e8e341` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:37.779766 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbda717f-47a5-4b91-b0a5-751dc1d93c92 admin admin] RBAC: Authorizing `identity:get_user(user_id=73e2d657af2e4c94b01fd3fdc6e8e341)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:38:37.781822 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbda717f-47a5-4b91-b0a5-751dc1d93c92 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:38:37.783368 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 532/1047] 10.222.0.58 () {56 vars in 1198 bytes} [Tue Oct 12 16:38:37 2021] GET /identity/v3/users/73e2d657af2e4c94b01fd3fdc6e8e341 => generated 286 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 16:38:37.789127 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6e0de9-4990-4fe6-824f-aa622797e09b admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:38:37.798587 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6e0de9-4990-4fe6-824f-aa622797e09b admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:38:37.802959 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01b9a51-a8ae-491d-90eb-5e8ec152a14e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:38:37.803758 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01b9a51-a8ae-491d-90eb-5e8ec152a14e admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:37.804034 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01b9a51-a8ae-491d-90eb-5e8ec152a14e admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:37.804300 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01b9a51-a8ae-491d-90eb-5e8ec152a14e admin admin] PATH_INFO: `/v3/projects/7ad5e168316c4f9495f58192944eaf86` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:37.805451 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01b9a51-a8ae-491d-90eb-5e8ec152a14e admin admin] RBAC: Authorizing `identity:get_project(project_id=7ad5e168316c4f9495f58192944eaf86)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:38:37.807447 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01b9a51-a8ae-491d-90eb-5e8ec152a14e admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:38:37.809625 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 516/1048] 10.222.0.58 () {56 vars in 1207 bytes} [Tue Oct 12 16:38:37 2021] GET /identity/v3/projects/7ad5e168316c4f9495f58192944eaf86 => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:38:37.815698 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbda717f-47a5-4b91-b0a5-751dc1d93c92 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:38:37.825038 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbda717f-47a5-4b91-b0a5-751dc1d93c92 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:38:37.829489 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def275eb-cfd7-4273-836f-0438b62200c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:38:37.830376 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def275eb-cfd7-4273-836f-0438b62200c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:37.830657 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def275eb-cfd7-4273-836f-0438b62200c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:37.830928 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def275eb-cfd7-4273-836f-0438b62200c5 admin admin] PATH_INFO: `/v3/projects/7ad5e168316c4f9495f58192944eaf86/users/73e2d657af2e4c94b01fd3fdc6e8e341/roles/610824e4f50f4fb8954610e98c1de784` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:37.832860 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def275eb-cfd7-4273-836f-0438b62200c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ad5e168316c4f9495f58192944eaf86, user_id=73e2d657af2e4c94b01fd3fdc6e8e341, role_id=610824e4f50f4fb8954610e98c1de784)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:38:37.835447 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def275eb-cfd7-4273-836f-0438b62200c5 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:38:37.848196 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 533/1049] 10.222.0.58 () {58 vars in 1460 bytes} [Tue Oct 12 16:38:37 2021] PUT /identity/v3/projects/7ad5e168316c4f9495f58192944eaf86/users/73e2d657af2e4c94b01fd3fdc6e8e341/roles/610824e4f50f4fb8954610e98c1de784 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:38:40.045301 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7019c3-0e16-4809-bcea-df6e40c48f7c None None] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:40.045854 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7019c3-0e16-4809-bcea-df6e40c48f7c None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:40.045854 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7019c3-0e16-4809-bcea-df6e40c48f7c None None] PATH_INFO: `/` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:40.047626 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 517/1050] 10.222.0.58 () {54 vars in 926 bytes} [Tue Oct 12 16:38:40 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:38:40.053598 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b638a7-207e-459a-8045-a011cbfa81d3 None None] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:40.054044 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b638a7-207e-459a-8045-a011cbfa81d3 None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:40.054190 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b638a7-207e-459a-8045-a011cbfa81d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:40.071890 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.auth.core [None req-03b638a7-207e-459a-8045-a011cbfa81d3 None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:38:40.073026 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-03b638a7-207e-459a-8045-a011cbfa81d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:38:40.127554 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 534/1051] 10.222.0.58 () {58 vars in 1023 bytes} [Tue Oct 12 16:38:40 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:38:40.151221 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7019c3-0e16-4809-bcea-df6e40c48f7c None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:38:40.162790 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7019c3-0e16-4809-bcea-df6e40c48f7c None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:38:40.167011 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49826f90-03cd-44a1-8977-9eda60f945fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:38:40.167763 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49826f90-03cd-44a1-8977-9eda60f945fd admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:40.168040 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49826f90-03cd-44a1-8977-9eda60f945fd admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:40.168811 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49826f90-03cd-44a1-8977-9eda60f945fd admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:40.178522 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49826f90-03cd-44a1-8977-9eda60f945fd admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 16:38:40.185846 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: WARNING keystone.server.flask.application [None req-49826f90-03cd-44a1-8977-9eda60f945fd admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 16:38:40.186970 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 518/1052] 10.222.0.58 () {56 vars in 1117 bytes} [Tue Oct 12 16:38:40 2021] GET /identity/v3/roles/admin => generated 83 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:38:40.193082 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b638a7-207e-459a-8045-a011cbfa81d3 None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:38:40.201543 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b638a7-207e-459a-8045-a011cbfa81d3 None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:38:40.205976 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290b4670-53c0-4bf8-86f4-ba7e95626d44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:38:40.206613 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290b4670-53c0-4bf8-86f4-ba7e95626d44 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:40.206891 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290b4670-53c0-4bf8-86f4-ba7e95626d44 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:40.207162 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290b4670-53c0-4bf8-86f4-ba7e95626d44 admin admin] PATH_INFO: `/v3/roles` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:40.207914 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290b4670-53c0-4bf8-86f4-ba7e95626d44 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=85204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:38:40.208215 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290b4670-53c0-4bf8-86f4-ba7e95626d44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:38:40.209772 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290b4670-53c0-4bf8-86f4-ba7e95626d44 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:38:40.217674 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 535/1053] 10.222.0.58 () {56 vars in 1120 bytes} [Tue Oct 12 16:38:40 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:38:40.223530 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49826f90-03cd-44a1-8977-9eda60f945fd admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:38:40.233850 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49826f90-03cd-44a1-8977-9eda60f945fd admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:38:40.238376 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fefb5cd-3ecd-4003-a663-2fb763e33fe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:38:40.239185 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fefb5cd-3ecd-4003-a663-2fb763e33fe3 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:40.239470 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fefb5cd-3ecd-4003-a663-2fb763e33fe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:40.239746 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fefb5cd-3ecd-4003-a663-2fb763e33fe3 admin admin] PATH_INFO: `/v3/users/73e2d657af2e4c94b01fd3fdc6e8e341` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:40.240941 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fefb5cd-3ecd-4003-a663-2fb763e33fe3 admin admin] RBAC: Authorizing `identity:get_user(user_id=73e2d657af2e4c94b01fd3fdc6e8e341)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:38:40.243068 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fefb5cd-3ecd-4003-a663-2fb763e33fe3 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:38:40.244759 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 519/1054] 10.222.0.58 () {56 vars in 1198 bytes} [Tue Oct 12 16:38:40 2021] GET /identity/v3/users/73e2d657af2e4c94b01fd3fdc6e8e341 => generated 286 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:38:40.251114 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290b4670-53c0-4bf8-86f4-ba7e95626d44 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:38:40.260002 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290b4670-53c0-4bf8-86f4-ba7e95626d44 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:38:40.264412 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc602d2-9199-4566-93f6-d2db063063c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:38:40.265004 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc602d2-9199-4566-93f6-d2db063063c5 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:40.265284 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc602d2-9199-4566-93f6-d2db063063c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:40.265557 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc602d2-9199-4566-93f6-d2db063063c5 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:40.273011 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc602d2-9199-4566-93f6-d2db063063c5 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:38:40.274737 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc602d2-9199-4566-93f6-d2db063063c5 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:38:40.283722 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 536/1055] 10.222.0.58 () {58 vars in 1324 bytes} [Tue Oct 12 16:38:40 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 12 16:38:40.289531 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fefb5cd-3ecd-4003-a663-2fb763e33fe3 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:38:40.299205 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fefb5cd-3ecd-4003-a663-2fb763e33fe3 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:38:40.303636 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdd81bd-5e0e-4aae-912f-7ec83dc2c283 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:38:40.304420 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdd81bd-5e0e-4aae-912f-7ec83dc2c283 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:40.304703 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdd81bd-5e0e-4aae-912f-7ec83dc2c283 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:40.304977 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdd81bd-5e0e-4aae-912f-7ec83dc2c283 admin admin] PATH_INFO: `/v3/projects/7ad5e168316c4f9495f58192944eaf86` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:40.306166 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdd81bd-5e0e-4aae-912f-7ec83dc2c283 admin admin] RBAC: Authorizing `identity:get_project(project_id=7ad5e168316c4f9495f58192944eaf86)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:38:40.308113 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdd81bd-5e0e-4aae-912f-7ec83dc2c283 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:38:40.309827 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 520/1056] 10.222.0.58 () {56 vars in 1207 bytes} [Tue Oct 12 16:38:40 2021] GET /identity/v3/projects/7ad5e168316c4f9495f58192944eaf86 => generated 311 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 16:38:40.315519 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc602d2-9199-4566-93f6-d2db063063c5 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:38:40.323642 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc602d2-9199-4566-93f6-d2db063063c5 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:38:40.328025 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba128203-defb-4d9b-a705-fb5cef1cd7a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:38:40.328613 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba128203-defb-4d9b-a705-fb5cef1cd7a3 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:40.328891 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba128203-defb-4d9b-a705-fb5cef1cd7a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:40.329163 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba128203-defb-4d9b-a705-fb5cef1cd7a3 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:40.330001 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba128203-defb-4d9b-a705-fb5cef1cd7a3 admin admin] RBAC: Adding query filter params (role.id=610824e4f50f4fb8954610e98c1de784, scope.project.id=7ad5e168316c4f9495f58192944eaf86, user.id=73e2d657af2e4c94b01fd3fdc6e8e341) {{(pid=85204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:38:40.330310 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba128203-defb-4d9b-a705-fb5cef1cd7a3 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:38:40.332040 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba128203-defb-4d9b-a705-fb5cef1cd7a3 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:38:40.337422 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 537/1057] 10.222.0.58 () {56 vars in 1395 bytes} [Tue Oct 12 16:38:40 2021] GET /identity/v3/role_assignments?user.id=73e2d657af2e4c94b01fd3fdc6e8e341&scope.project.id=7ad5e168316c4f9495f58192944eaf86&role.id=610824e4f50f4fb8954610e98c1de784 => generated 608 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 16:38:42.561412 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec692ed-f902-4c62-a85d-d39350186a32 None None] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:42.562000 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec692ed-f902-4c62-a85d-d39350186a32 None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:42.562000 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec692ed-f902-4c62-a85d-d39350186a32 None None] PATH_INFO: `/` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:42.563725 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 521/1058] 10.222.0.58 () {54 vars in 926 bytes} [Tue Oct 12 16:38:42 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:38:42.569681 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a814653a-47b8-4487-b2ec-c4d72ef43aba None None] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:42.570128 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a814653a-47b8-4487-b2ec-c4d72ef43aba None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:42.570278 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a814653a-47b8-4487-b2ec-c4d72ef43aba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:42.593735 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.auth.core [None req-a814653a-47b8-4487-b2ec-c4d72ef43aba None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:38:42.595004 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-a814653a-47b8-4487-b2ec-c4d72ef43aba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:38:42.603017 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 538/1059] 10.222.0.58 () {58 vars in 1023 bytes} [Tue Oct 12 16:38:42 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:38:42.627100 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec692ed-f902-4c62-a85d-d39350186a32 None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:38:42.639686 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec692ed-f902-4c62-a85d-d39350186a32 None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:38:42.644019 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16980d9-0863-43f7-8f8a-79778b2c5b43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:38:42.644642 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16980d9-0863-43f7-8f8a-79778b2c5b43 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:42.644920 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16980d9-0863-43f7-8f8a-79778b2c5b43 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:42.645188 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16980d9-0863-43f7-8f8a-79778b2c5b43 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:42.652538 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16980d9-0863-43f7-8f8a-79778b2c5b43 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:38:42.654274 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16980d9-0863-43f7-8f8a-79778b2c5b43 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:38:42.662718 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 522/1060] 10.222.0.58 () {58 vars in 1324 bytes} [Tue Oct 12 16:38:42 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:38:42.668891 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a814653a-47b8-4487-b2ec-c4d72ef43aba None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:38:42.677746 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a814653a-47b8-4487-b2ec-c4d72ef43aba None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:38:42.682266 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed0b633-9e2f-4baf-abd9-b50aae464787 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:38:42.683040 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed0b633-9e2f-4baf-abd9-b50aae464787 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:42.683324 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed0b633-9e2f-4baf-abd9-b50aae464787 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:42.683598 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed0b633-9e2f-4baf-abd9-b50aae464787 admin admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:42.690830 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed0b633-9e2f-4baf-abd9-b50aae464787 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:38:42.692620 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed0b633-9e2f-4baf-abd9-b50aae464787 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:38:42.707282 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: WARNING keystone.server.flask.application [None req-1ed0b633-9e2f-4baf-abd9-b50aae464787 admin admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Oct 12 16:38:42.708384 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 539/1061] 10.222.0.58 () {56 vars in 1138 bytes} [Tue Oct 12 16:38:42 2021] GET /identity/v3/domains/swift_test => generated 90 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:38:42.714634 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16980d9-0863-43f7-8f8a-79778b2c5b43 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:38:42.723027 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16980d9-0863-43f7-8f8a-79778b2c5b43 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:38:42.727496 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735aafc2-db5c-44a4-8584-b2cb8f999b6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:38:42.728112 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735aafc2-db5c-44a4-8584-b2cb8f999b6e admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:42.728389 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735aafc2-db5c-44a4-8584-b2cb8f999b6e admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:42.728657 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735aafc2-db5c-44a4-8584-b2cb8f999b6e admin admin] PATH_INFO: `/v3/domains` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:42.729363 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735aafc2-db5c-44a4-8584-b2cb8f999b6e admin admin] RBAC: Adding query filter params (name=swift_test) {{(pid=85205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:38:42.729665 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735aafc2-db5c-44a4-8584-b2cb8f999b6e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:38:42.731210 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735aafc2-db5c-44a4-8584-b2cb8f999b6e admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:38:42.738084 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 523/1062] 10.222.0.58 () {56 vars in 1136 bytes} [Tue Oct 12 16:38:42 2021] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:38:45.045978 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e58180f-9a9f-4819-a2d3-c32ce376e050 None None] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:45.046522 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e58180f-9a9f-4819-a2d3-c32ce376e050 None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:45.046522 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e58180f-9a9f-4819-a2d3-c32ce376e050 None None] PATH_INFO: `/` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:45.048258 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 540/1063] 10.222.0.58 () {54 vars in 926 bytes} [Tue Oct 12 16:38:45 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:38:45.054110 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe3a990-3cb2-4b73-9223-269b93b6ad80 None None] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:45.054498 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe3a990-3cb2-4b73-9223-269b93b6ad80 None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:45.054669 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe3a990-3cb2-4b73-9223-269b93b6ad80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:45.071831 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.auth.core [None req-3fe3a990-3cb2-4b73-9223-269b93b6ad80 None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:38:45.072953 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-3fe3a990-3cb2-4b73-9223-269b93b6ad80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:38:45.080560 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 524/1064] 10.222.0.58 () {58 vars in 1023 bytes} [Tue Oct 12 16:38:45 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:38:45.104757 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e58180f-9a9f-4819-a2d3-c32ce376e050 None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:38:45.117312 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e58180f-9a9f-4819-a2d3-c32ce376e050 None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:38:45.121544 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b6ea86-f667-442d-ad22-c3249319c426 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:38:45.122206 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b6ea86-f667-442d-ad22-c3249319c426 admin admin] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:45.122487 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b6ea86-f667-442d-ad22-c3249319c426 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:45.122755 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b6ea86-f667-442d-ad22-c3249319c426 admin admin] PATH_INFO: `/v3/domains` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:45.123487 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b6ea86-f667-442d-ad22-c3249319c426 admin admin] RBAC: Authorizing `identity:create_domain()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:38:45.124734 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: WARNING py.warnings [None req-09b6ea86-f667-442d-ad22-c3249319c426 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:create_domain failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 12 16:38:45.124734 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: warnings.warn(msg) Oct 12 16:38:45.124734 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: Oct 12 16:38:45.125595 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b6ea86-f667-442d-ad22-c3249319c426 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:38:45.140101 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 541/1065] 10.222.0.58 () {60 vars in 1159 bytes} [Tue Oct 12 16:38:45 2021] POST /identity/v3/domains => generated 267 bytes in 36 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:38:47.382208 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed184263-d098-4a99-aefd-1a62afdebacc None None] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:47.382762 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed184263-d098-4a99-aefd-1a62afdebacc None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:47.382762 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed184263-d098-4a99-aefd-1a62afdebacc None None] PATH_INFO: `/` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:47.384500 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 525/1066] 10.222.0.58 () {54 vars in 926 bytes} [Tue Oct 12 16:38:47 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:38:47.390950 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2a9b61-8838-4807-84e9-ab5f0bcba4e5 None None] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:47.391384 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2a9b61-8838-4807-84e9-ab5f0bcba4e5 None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:47.391509 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2a9b61-8838-4807-84e9-ab5f0bcba4e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:47.408849 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.auth.core [None req-9a2a9b61-8838-4807-84e9-ab5f0bcba4e5 None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:38:47.410073 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-9a2a9b61-8838-4807-84e9-ab5f0bcba4e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:38:47.464344 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 542/1067] 10.222.0.58 () {58 vars in 1023 bytes} [Tue Oct 12 16:38:47 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:38:47.488510 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed184263-d098-4a99-aefd-1a62afdebacc None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:38:47.501106 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed184263-d098-4a99-aefd-1a62afdebacc None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:38:47.505369 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f7ea61-6d0e-418b-bf42-cabff6db8deb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:38:47.506214 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f7ea61-6d0e-418b-bf42-cabff6db8deb admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:47.506492 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f7ea61-6d0e-418b-bf42-cabff6db8deb admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:47.506759 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f7ea61-6d0e-418b-bf42-cabff6db8deb admin admin] PATH_INFO: `/v3/domains/5dc1acaf2e144e828d21479a665888cf` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:47.516743 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f7ea61-6d0e-418b-bf42-cabff6db8deb admin admin] RBAC: Authorizing `identity:get_domain(domain_id=5dc1acaf2e144e828d21479a665888cf)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:38:47.518691 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f7ea61-6d0e-418b-bf42-cabff6db8deb admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:38:47.520248 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 526/1068] 10.222.0.58 () {56 vars in 1204 bytes} [Tue Oct 12 16:38:47 2021] GET /identity/v3/domains/5dc1acaf2e144e828d21479a665888cf => generated 267 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:38:47.526172 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2a9b61-8838-4807-84e9-ab5f0bcba4e5 None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:38:47.534809 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2a9b61-8838-4807-84e9-ab5f0bcba4e5 None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:38:47.539263 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8115389-2507-4d44-b6af-1f6fdc75e7b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:38:47.539897 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8115389-2507-4d44-b6af-1f6fdc75e7b6 admin admin] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:47.540181 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8115389-2507-4d44-b6af-1f6fdc75e7b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:47.540455 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8115389-2507-4d44-b6af-1f6fdc75e7b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:47.541171 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8115389-2507-4d44-b6af-1f6fdc75e7b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:38:47.543571 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8115389-2507-4d44-b6af-1f6fdc75e7b6 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:38:47.568431 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 543/1069] 10.222.0.58 () {60 vars in 1162 bytes} [Tue Oct 12 16:38:47 2021] POST /identity/v3/projects => generated 361 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 16:38:49.811404 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4458cd04-6fa8-4a90-9ed3-aa4c9daa8371 None None] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:49.811860 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4458cd04-6fa8-4a90-9ed3-aa4c9daa8371 None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:49.811966 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4458cd04-6fa8-4a90-9ed3-aa4c9daa8371 None None] PATH_INFO: `/` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:49.813725 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 527/1070] 10.222.0.58 () {54 vars in 926 bytes} [Tue Oct 12 16:38:49 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:38:49.819704 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03794235-06dd-497a-b0e2-da78d6fb41eb None None] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:49.820119 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03794235-06dd-497a-b0e2-da78d6fb41eb None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:49.820257 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03794235-06dd-497a-b0e2-da78d6fb41eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:49.837939 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.auth.core [None req-03794235-06dd-497a-b0e2-da78d6fb41eb None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:38:49.839118 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-03794235-06dd-497a-b0e2-da78d6fb41eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:38:49.893517 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 544/1071] 10.222.0.58 () {58 vars in 1023 bytes} [Tue Oct 12 16:38:49 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:38:49.919040 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4458cd04-6fa8-4a90-9ed3-aa4c9daa8371 None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:38:49.930802 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4458cd04-6fa8-4a90-9ed3-aa4c9daa8371 None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:38:49.935105 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0481d6af-ad0c-48ee-9bc8-d21e693c5470 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:38:49.935927 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0481d6af-ad0c-48ee-9bc8-d21e693c5470 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:49.936208 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0481d6af-ad0c-48ee-9bc8-d21e693c5470 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:49.936479 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0481d6af-ad0c-48ee-9bc8-d21e693c5470 admin admin] PATH_INFO: `/v3/domains/5dc1acaf2e144e828d21479a665888cf` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:49.937646 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0481d6af-ad0c-48ee-9bc8-d21e693c5470 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=5dc1acaf2e144e828d21479a665888cf)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:38:49.939600 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0481d6af-ad0c-48ee-9bc8-d21e693c5470 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:38:49.941143 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 528/1072] 10.222.0.58 () {56 vars in 1204 bytes} [Tue Oct 12 16:38:49 2021] GET /identity/v3/domains/5dc1acaf2e144e828d21479a665888cf => generated 267 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 16:38:49.947034 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03794235-06dd-497a-b0e2-da78d6fb41eb None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:38:49.956044 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03794235-06dd-497a-b0e2-da78d6fb41eb None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:38:49.960464 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126a8aec-2eb4-461e-bc38-95790e32a6f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:38:49.961100 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126a8aec-2eb4-461e-bc38-95790e32a6f1 admin admin] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:49.961383 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126a8aec-2eb4-461e-bc38-95790e32a6f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:49.961659 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126a8aec-2eb4-461e-bc38-95790e32a6f1 admin admin] PATH_INFO: `/v3/users` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:49.962405 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126a8aec-2eb4-461e-bc38-95790e32a6f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:38:49.964276 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126a8aec-2eb4-461e-bc38-95790e32a6f1 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:38:49.983337 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 545/1073] 10.222.0.58 () {60 vars in 1153 bytes} [Tue Oct 12 16:38:49 2021] POST /identity/v3/users => generated 311 bytes in 37 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:38:52.226481 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab347e7-35db-42eb-98d5-b3b1adbe86e7 None None] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:52.227057 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab347e7-35db-42eb-98d5-b3b1adbe86e7 None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:52.227057 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab347e7-35db-42eb-98d5-b3b1adbe86e7 None None] PATH_INFO: `/` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:52.228791 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 529/1074] 10.222.0.58 () {54 vars in 926 bytes} [Tue Oct 12 16:38:52 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:38:52.235174 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12aa2de-0716-41cd-be23-f6e29d721d95 None None] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:52.235575 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12aa2de-0716-41cd-be23-f6e29d721d95 None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:52.235740 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12aa2de-0716-41cd-be23-f6e29d721d95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:52.253845 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.auth.core [None req-a12aa2de-0716-41cd-be23-f6e29d721d95 None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:38:52.255060 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-a12aa2de-0716-41cd-be23-f6e29d721d95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:38:52.262678 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 546/1075] 10.222.0.58 () {58 vars in 1023 bytes} [Tue Oct 12 16:38:52 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:38:52.287312 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab347e7-35db-42eb-98d5-b3b1adbe86e7 None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:38:52.299721 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab347e7-35db-42eb-98d5-b3b1adbe86e7 None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:38:52.304014 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58f63fd-f9ee-4095-a749-63f924e5933a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:38:52.304772 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58f63fd-f9ee-4095-a749-63f924e5933a admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:52.305054 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58f63fd-f9ee-4095-a749-63f924e5933a admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:52.305325 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58f63fd-f9ee-4095-a749-63f924e5933a admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:52.315506 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58f63fd-f9ee-4095-a749-63f924e5933a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 16:38:52.322326 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: WARNING keystone.server.flask.application [None req-c58f63fd-f9ee-4095-a749-63f924e5933a admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 16:38:52.323449 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 530/1076] 10.222.0.58 () {56 vars in 1117 bytes} [Tue Oct 12 16:38:52 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:38:52.329679 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12aa2de-0716-41cd-be23-f6e29d721d95 None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:38:52.338410 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12aa2de-0716-41cd-be23-f6e29d721d95 None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:38:52.343372 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3318c9-a742-4ef7-8a01-577e78956a7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:38:52.344018 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3318c9-a742-4ef7-8a01-577e78956a7d admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:52.344305 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3318c9-a742-4ef7-8a01-577e78956a7d admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:52.344584 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3318c9-a742-4ef7-8a01-577e78956a7d admin admin] PATH_INFO: `/v3/roles` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:52.345345 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3318c9-a742-4ef7-8a01-577e78956a7d admin admin] RBAC: Adding query filter params (name=admin) {{(pid=85204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:38:52.345654 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3318c9-a742-4ef7-8a01-577e78956a7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:38:52.347265 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3318c9-a742-4ef7-8a01-577e78956a7d admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:38:52.355799 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 547/1077] 10.222.0.58 () {56 vars in 1120 bytes} [Tue Oct 12 16:38:52 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:38:52.361656 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58f63fd-f9ee-4095-a749-63f924e5933a admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:38:52.370760 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58f63fd-f9ee-4095-a749-63f924e5933a admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:38:52.375498 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8237d42-5bdd-4a07-b12a-e05b129a8d70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:38:52.376307 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8237d42-5bdd-4a07-b12a-e05b129a8d70 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:52.376586 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8237d42-5bdd-4a07-b12a-e05b129a8d70 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:52.376857 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8237d42-5bdd-4a07-b12a-e05b129a8d70 admin admin] PATH_INFO: `/v3/users/09cf1469c56643048ecf9c7d3f71e3cb` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:52.389677 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8237d42-5bdd-4a07-b12a-e05b129a8d70 admin admin] RBAC: Authorizing `identity:get_user(user_id=09cf1469c56643048ecf9c7d3f71e3cb)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:38:52.391793 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8237d42-5bdd-4a07-b12a-e05b129a8d70 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:38:52.393347 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 531/1078] 10.222.0.58 () {56 vars in 1198 bytes} [Tue Oct 12 16:38:52 2021] GET /identity/v3/users/09cf1469c56643048ecf9c7d3f71e3cb => generated 311 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:38:52.399239 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3318c9-a742-4ef7-8a01-577e78956a7d admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:38:52.408930 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3318c9-a742-4ef7-8a01-577e78956a7d admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:38:52.413381 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970ce171-4674-4449-99bd-9ee4f0284de1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:38:52.414027 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970ce171-4674-4449-99bd-9ee4f0284de1 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:52.414317 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970ce171-4674-4449-99bd-9ee4f0284de1 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:52.414597 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970ce171-4674-4449-99bd-9ee4f0284de1 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:52.422692 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970ce171-4674-4449-99bd-9ee4f0284de1 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:38:52.424380 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970ce171-4674-4449-99bd-9ee4f0284de1 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:38:52.433107 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 548/1079] 10.222.0.58 () {58 vars in 1324 bytes} [Tue Oct 12 16:38:52 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 12 16:38:52.438739 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8237d42-5bdd-4a07-b12a-e05b129a8d70 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:38:52.447620 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8237d42-5bdd-4a07-b12a-e05b129a8d70 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:38:52.452033 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4f62b9-1288-4d61-9544-20ecb60b1524 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:38:52.452819 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4f62b9-1288-4d61-9544-20ecb60b1524 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:52.453098 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4f62b9-1288-4d61-9544-20ecb60b1524 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:52.453366 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4f62b9-1288-4d61-9544-20ecb60b1524 admin admin] PATH_INFO: `/v3/projects/86a7296e12774eb79f28fb849849c792` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:52.454519 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4f62b9-1288-4d61-9544-20ecb60b1524 admin admin] RBAC: Authorizing `identity:get_project(project_id=86a7296e12774eb79f28fb849849c792)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:38:52.456454 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4f62b9-1288-4d61-9544-20ecb60b1524 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:38:52.458170 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 532/1080] 10.222.0.58 () {56 vars in 1207 bytes} [Tue Oct 12 16:38:52 2021] GET /identity/v3/projects/86a7296e12774eb79f28fb849849c792 => generated 361 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 16:38:52.463870 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970ce171-4674-4449-99bd-9ee4f0284de1 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:38:52.472635 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970ce171-4674-4449-99bd-9ee4f0284de1 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:38:52.477138 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b82f69-d921-46fa-8a62-0f58d1f3ef7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:38:52.477708 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b82f69-d921-46fa-8a62-0f58d1f3ef7e admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:52.478081 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b82f69-d921-46fa-8a62-0f58d1f3ef7e admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:52.478359 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b82f69-d921-46fa-8a62-0f58d1f3ef7e admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:52.479172 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b82f69-d921-46fa-8a62-0f58d1f3ef7e admin admin] RBAC: Adding query filter params (role.id=610824e4f50f4fb8954610e98c1de784, scope.project.id=86a7296e12774eb79f28fb849849c792, user.id=09cf1469c56643048ecf9c7d3f71e3cb) {{(pid=85204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:38:52.479488 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b82f69-d921-46fa-8a62-0f58d1f3ef7e admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:38:52.481856 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b82f69-d921-46fa-8a62-0f58d1f3ef7e admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:38:52.486984 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 549/1081] 10.222.0.58 () {56 vars in 1395 bytes} [Tue Oct 12 16:38:52 2021] GET /identity/v3/role_assignments?user.id=09cf1469c56643048ecf9c7d3f71e3cb&scope.project.id=86a7296e12774eb79f28fb849849c792&role.id=610824e4f50f4fb8954610e98c1de784 => generated 259 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 16:38:54.651778 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928db93c-d72d-4807-b0e8-6b55d15e440e None None] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:54.652356 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928db93c-d72d-4807-b0e8-6b55d15e440e None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:54.652356 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928db93c-d72d-4807-b0e8-6b55d15e440e None None] PATH_INFO: `/` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:54.654118 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 533/1082] 10.222.0.58 () {54 vars in 926 bytes} [Tue Oct 12 16:38:54 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:38:54.659832 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81242670-1ed3-4515-82c6-0c4e2c13a2cc None None] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:54.660261 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81242670-1ed3-4515-82c6-0c4e2c13a2cc None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:54.660372 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81242670-1ed3-4515-82c6-0c4e2c13a2cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:54.689236 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.auth.core [None req-81242670-1ed3-4515-82c6-0c4e2c13a2cc None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:38:54.690549 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-81242670-1ed3-4515-82c6-0c4e2c13a2cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:38:54.698229 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 550/1083] 10.222.0.58 () {58 vars in 1023 bytes} [Tue Oct 12 16:38:54 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:38:54.721885 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928db93c-d72d-4807-b0e8-6b55d15e440e None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:38:54.733642 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928db93c-d72d-4807-b0e8-6b55d15e440e None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:38:54.737951 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05a3ffd-aceb-4ca5-92ba-18f3be1500a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:38:54.738713 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05a3ffd-aceb-4ca5-92ba-18f3be1500a5 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:54.738992 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05a3ffd-aceb-4ca5-92ba-18f3be1500a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:54.739260 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05a3ffd-aceb-4ca5-92ba-18f3be1500a5 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:54.749964 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05a3ffd-aceb-4ca5-92ba-18f3be1500a5 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 16:38:54.756756 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: WARNING keystone.server.flask.application [None req-d05a3ffd-aceb-4ca5-92ba-18f3be1500a5 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 16:38:54.757920 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 534/1084] 10.222.0.58 () {56 vars in 1117 bytes} [Tue Oct 12 16:38:54 2021] GET /identity/v3/roles/admin => generated 83 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:38:54.765177 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81242670-1ed3-4515-82c6-0c4e2c13a2cc None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:38:54.774102 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81242670-1ed3-4515-82c6-0c4e2c13a2cc None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:38:54.778699 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfec3a4-79e1-48ef-ac49-c137c2bf4628 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:38:54.779349 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfec3a4-79e1-48ef-ac49-c137c2bf4628 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:54.779631 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfec3a4-79e1-48ef-ac49-c137c2bf4628 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:54.779902 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfec3a4-79e1-48ef-ac49-c137c2bf4628 admin admin] PATH_INFO: `/v3/roles` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:54.780654 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfec3a4-79e1-48ef-ac49-c137c2bf4628 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=85204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:38:54.780957 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfec3a4-79e1-48ef-ac49-c137c2bf4628 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:38:54.782568 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfec3a4-79e1-48ef-ac49-c137c2bf4628 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:38:54.790557 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 551/1085] 10.222.0.58 () {56 vars in 1120 bytes} [Tue Oct 12 16:38:54 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:38:54.796585 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05a3ffd-aceb-4ca5-92ba-18f3be1500a5 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:38:54.806360 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05a3ffd-aceb-4ca5-92ba-18f3be1500a5 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:38:54.811550 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cc4ac7-5c84-4a1d-ba70-92ab6c15c007 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:38:54.812388 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cc4ac7-5c84-4a1d-ba70-92ab6c15c007 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:54.812674 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cc4ac7-5c84-4a1d-ba70-92ab6c15c007 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:54.812952 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cc4ac7-5c84-4a1d-ba70-92ab6c15c007 admin admin] PATH_INFO: `/v3/users/09cf1469c56643048ecf9c7d3f71e3cb` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:54.814225 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cc4ac7-5c84-4a1d-ba70-92ab6c15c007 admin admin] RBAC: Authorizing `identity:get_user(user_id=09cf1469c56643048ecf9c7d3f71e3cb)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:38:54.816311 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cc4ac7-5c84-4a1d-ba70-92ab6c15c007 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:38:54.817890 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 535/1086] 10.222.0.58 () {56 vars in 1198 bytes} [Tue Oct 12 16:38:54 2021] GET /identity/v3/users/09cf1469c56643048ecf9c7d3f71e3cb => generated 311 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:38:54.824407 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfec3a4-79e1-48ef-ac49-c137c2bf4628 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:38:54.833778 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfec3a4-79e1-48ef-ac49-c137c2bf4628 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:38:54.838216 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edfc16c-de43-4f6a-ac44-b9edc65bb811 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:38:54.839038 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edfc16c-de43-4f6a-ac44-b9edc65bb811 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:54.839318 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edfc16c-de43-4f6a-ac44-b9edc65bb811 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:54.839594 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edfc16c-de43-4f6a-ac44-b9edc65bb811 admin admin] PATH_INFO: `/v3/projects/86a7296e12774eb79f28fb849849c792` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:54.840766 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edfc16c-de43-4f6a-ac44-b9edc65bb811 admin admin] RBAC: Authorizing `identity:get_project(project_id=86a7296e12774eb79f28fb849849c792)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:38:54.842797 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edfc16c-de43-4f6a-ac44-b9edc65bb811 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:38:54.844501 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 552/1087] 10.222.0.58 () {56 vars in 1207 bytes} [Tue Oct 12 16:38:54 2021] GET /identity/v3/projects/86a7296e12774eb79f28fb849849c792 => generated 361 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:38:54.850100 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cc4ac7-5c84-4a1d-ba70-92ab6c15c007 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:38:54.859381 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cc4ac7-5c84-4a1d-ba70-92ab6c15c007 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:38:54.863866 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575239dd-78b8-4812-bc3f-d34a5ce355b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:38:54.864681 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575239dd-78b8-4812-bc3f-d34a5ce355b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:54.864961 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575239dd-78b8-4812-bc3f-d34a5ce355b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:54.865237 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575239dd-78b8-4812-bc3f-d34a5ce355b8 admin admin] PATH_INFO: `/v3/projects/86a7296e12774eb79f28fb849849c792/users/09cf1469c56643048ecf9c7d3f71e3cb/roles/610824e4f50f4fb8954610e98c1de784` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:54.867197 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575239dd-78b8-4812-bc3f-d34a5ce355b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=86a7296e12774eb79f28fb849849c792, user_id=09cf1469c56643048ecf9c7d3f71e3cb, role_id=610824e4f50f4fb8954610e98c1de784)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:38:54.869706 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575239dd-78b8-4812-bc3f-d34a5ce355b8 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:38:54.883255 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 536/1088] 10.222.0.58 () {58 vars in 1460 bytes} [Tue Oct 12 16:38:54 2021] PUT /identity/v3/projects/86a7296e12774eb79f28fb849849c792/users/09cf1469c56643048ecf9c7d3f71e3cb/roles/610824e4f50f4fb8954610e98c1de784 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 16:38:57.089928 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b579765-bb01-471a-b2d5-f17c4159f377 None None] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:57.090458 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b579765-bb01-471a-b2d5-f17c4159f377 None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:57.090552 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b579765-bb01-471a-b2d5-f17c4159f377 None None] PATH_INFO: `/` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:57.092296 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 553/1089] 10.222.0.58 () {54 vars in 926 bytes} [Tue Oct 12 16:38:57 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:38:57.098317 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd33cff-82ae-4659-b35c-3dd99e47347b None None] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:57.098740 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd33cff-82ae-4659-b35c-3dd99e47347b None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:57.098871 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd33cff-82ae-4659-b35c-3dd99e47347b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:57.115751 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.auth.core [None req-ddd33cff-82ae-4659-b35c-3dd99e47347b None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:38:57.116917 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-ddd33cff-82ae-4659-b35c-3dd99e47347b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:38:57.171353 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 537/1090] 10.222.0.58 () {58 vars in 1023 bytes} [Tue Oct 12 16:38:57 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:38:57.196149 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b579765-bb01-471a-b2d5-f17c4159f377 None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:38:57.207968 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b579765-bb01-471a-b2d5-f17c4159f377 None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:38:57.212268 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc12eb7-149a-48ca-a0c2-1bd348b3e64c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:38:57.213025 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc12eb7-149a-48ca-a0c2-1bd348b3e64c admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:57.213307 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc12eb7-149a-48ca-a0c2-1bd348b3e64c admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:57.213579 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc12eb7-149a-48ca-a0c2-1bd348b3e64c admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:57.223439 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc12eb7-149a-48ca-a0c2-1bd348b3e64c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 16:38:57.230697 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: WARNING keystone.server.flask.application [None req-3cc12eb7-149a-48ca-a0c2-1bd348b3e64c admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 16:38:57.231803 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 554/1091] 10.222.0.58 () {56 vars in 1117 bytes} [Tue Oct 12 16:38:57 2021] GET /identity/v3/roles/admin => generated 83 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:38:57.237923 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd33cff-82ae-4659-b35c-3dd99e47347b None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:38:57.246924 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd33cff-82ae-4659-b35c-3dd99e47347b None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:38:57.251749 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80037678-aeee-49ee-9ab0-5bcda7be9757 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:38:57.253730 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80037678-aeee-49ee-9ab0-5bcda7be9757 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:57.254048 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80037678-aeee-49ee-9ab0-5bcda7be9757 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:57.254322 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80037678-aeee-49ee-9ab0-5bcda7be9757 admin admin] PATH_INFO: `/v3/roles` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:57.255076 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80037678-aeee-49ee-9ab0-5bcda7be9757 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=85205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:38:57.255436 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80037678-aeee-49ee-9ab0-5bcda7be9757 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:38:57.258804 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80037678-aeee-49ee-9ab0-5bcda7be9757 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:38:57.267115 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 538/1092] 10.222.0.58 () {56 vars in 1120 bytes} [Tue Oct 12 16:38:57 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:38:57.273437 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc12eb7-149a-48ca-a0c2-1bd348b3e64c admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:38:57.284667 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc12eb7-149a-48ca-a0c2-1bd348b3e64c admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:38:57.289144 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e89b17-05fa-4791-9e64-538124867672 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:38:57.290013 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e89b17-05fa-4791-9e64-538124867672 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:57.290295 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e89b17-05fa-4791-9e64-538124867672 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:57.290566 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e89b17-05fa-4791-9e64-538124867672 admin admin] PATH_INFO: `/v3/users/09cf1469c56643048ecf9c7d3f71e3cb` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:57.291789 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e89b17-05fa-4791-9e64-538124867672 admin admin] RBAC: Authorizing `identity:get_user(user_id=09cf1469c56643048ecf9c7d3f71e3cb)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:38:57.294472 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e89b17-05fa-4791-9e64-538124867672 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:38:57.296014 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 555/1093] 10.222.0.58 () {56 vars in 1198 bytes} [Tue Oct 12 16:38:57 2021] GET /identity/v3/users/09cf1469c56643048ecf9c7d3f71e3cb => generated 311 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:38:57.302080 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80037678-aeee-49ee-9ab0-5bcda7be9757 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:38:57.311872 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80037678-aeee-49ee-9ab0-5bcda7be9757 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:38:57.316305 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f92bf71-c05c-4be6-a2bb-90c17df4f0ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:38:57.316918 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f92bf71-c05c-4be6-a2bb-90c17df4f0ee admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:57.317196 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f92bf71-c05c-4be6-a2bb-90c17df4f0ee admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:57.317467 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f92bf71-c05c-4be6-a2bb-90c17df4f0ee admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:57.324857 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f92bf71-c05c-4be6-a2bb-90c17df4f0ee admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:38:57.326574 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f92bf71-c05c-4be6-a2bb-90c17df4f0ee admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:38:57.335029 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 539/1094] 10.222.0.58 () {58 vars in 1324 bytes} [Tue Oct 12 16:38:57 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:38:57.341039 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e89b17-05fa-4791-9e64-538124867672 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:38:57.350192 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e89b17-05fa-4791-9e64-538124867672 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:38:57.354677 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b94cacb-2dc7-4dc5-b85d-d9078978ef56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:38:57.355944 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b94cacb-2dc7-4dc5-b85d-d9078978ef56 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:57.356219 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b94cacb-2dc7-4dc5-b85d-d9078978ef56 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:57.356485 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b94cacb-2dc7-4dc5-b85d-d9078978ef56 admin admin] PATH_INFO: `/v3/projects/86a7296e12774eb79f28fb849849c792` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:57.357627 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b94cacb-2dc7-4dc5-b85d-d9078978ef56 admin admin] RBAC: Authorizing `identity:get_project(project_id=86a7296e12774eb79f28fb849849c792)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:38:57.359612 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b94cacb-2dc7-4dc5-b85d-d9078978ef56 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:38:57.361162 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 556/1095] 10.222.0.58 () {56 vars in 1207 bytes} [Tue Oct 12 16:38:57 2021] GET /identity/v3/projects/86a7296e12774eb79f28fb849849c792 => generated 361 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:38:57.367142 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f92bf71-c05c-4be6-a2bb-90c17df4f0ee admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:38:57.376190 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f92bf71-c05c-4be6-a2bb-90c17df4f0ee admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:38:57.380590 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48921f8a-e428-436e-8d1f-8afbe5d3822c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:38:57.381181 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48921f8a-e428-436e-8d1f-8afbe5d3822c admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:57.381461 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48921f8a-e428-436e-8d1f-8afbe5d3822c admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:57.381735 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48921f8a-e428-436e-8d1f-8afbe5d3822c admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:57.382583 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48921f8a-e428-436e-8d1f-8afbe5d3822c admin admin] RBAC: Adding query filter params (role.id=610824e4f50f4fb8954610e98c1de784, scope.project.id=86a7296e12774eb79f28fb849849c792, user.id=09cf1469c56643048ecf9c7d3f71e3cb) {{(pid=85205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:38:57.382889 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48921f8a-e428-436e-8d1f-8afbe5d3822c admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:38:57.384608 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48921f8a-e428-436e-8d1f-8afbe5d3822c admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:38:57.390204 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 540/1096] 10.222.0.58 () {56 vars in 1395 bytes} [Tue Oct 12 16:38:57 2021] GET /identity/v3/role_assignments?user.id=09cf1469c56643048ecf9c7d3f71e3cb&scope.project.id=86a7296e12774eb79f28fb849849c792&role.id=610824e4f50f4fb8954610e98c1de784 => generated 608 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:39:52.406264 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b269076a-1c52-4dc6-a7a1-a3d3cf58e542 None None] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:39:52.406264 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b269076a-1c52-4dc6-a7a1-a3d3cf58e542 None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:39:52.406264 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b269076a-1c52-4dc6-a7a1-a3d3cf58e542 None None] PATH_INFO: `/` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:39:52.406264 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 557/1097] 10.222.0.58 () {54 vars in 926 bytes} [Tue Oct 12 16:39:52 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:39:52.413492 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfc9d12-d8b1-40e5-b995-b9b47090f3e9 None None] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:39:52.414028 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfc9d12-d8b1-40e5-b995-b9b47090f3e9 None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:39:52.414124 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfc9d12-d8b1-40e5-b995-b9b47090f3e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:39:52.436374 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.auth.core [None req-ebfc9d12-d8b1-40e5-b995-b9b47090f3e9 None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:39:52.437750 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-ebfc9d12-d8b1-40e5-b995-b9b47090f3e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:39:52.446644 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 541/1098] 10.222.0.58 () {58 vars in 1023 bytes} [Tue Oct 12 16:39:52 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:39:52.473869 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b269076a-1c52-4dc6-a7a1-a3d3cf58e542 None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:39:52.487983 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b269076a-1c52-4dc6-a7a1-a3d3cf58e542 None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:39:52.494045 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ede265-6cd9-476b-a130-c7c084808e49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:39:52.494884 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ede265-6cd9-476b-a130-c7c084808e49 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:39:52.495853 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ede265-6cd9-476b-a130-c7c084808e49 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:39:52.496305 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ede265-6cd9-476b-a130-c7c084808e49 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:39:52.508013 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ede265-6cd9-476b-a130-c7c084808e49 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:39:52.510098 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ede265-6cd9-476b-a130-c7c084808e49 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:39:52.528212 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: WARNING keystone.server.flask.application [None req-48ede265-6cd9-476b-a130-c7c084808e49 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 16:39:52.529669 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 558/1099] 10.222.0.58 () {56 vars in 1129 bytes} [Tue Oct 12 16:39:52 2021] GET /identity/v3/domains/Default => generated 87 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 16:39:52.536566 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfc9d12-d8b1-40e5-b995-b9b47090f3e9 None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:39:52.545990 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfc9d12-d8b1-40e5-b995-b9b47090f3e9 None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:39:52.551492 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a08a8f-82e9-4442-98e0-4b3c9d32ec58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:39:52.552381 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a08a8f-82e9-4442-98e0-4b3c9d32ec58 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:39:52.552810 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a08a8f-82e9-4442-98e0-4b3c9d32ec58 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:39:52.553250 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a08a8f-82e9-4442-98e0-4b3c9d32ec58 admin admin] PATH_INFO: `/v3/domains` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:39:52.554197 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a08a8f-82e9-4442-98e0-4b3c9d32ec58 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:39:52.554665 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a08a8f-82e9-4442-98e0-4b3c9d32ec58 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:39:52.556449 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a08a8f-82e9-4442-98e0-4b3c9d32ec58 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:39:52.570041 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 542/1100] 10.222.0.58 () {56 vars in 1130 bytes} [Tue Oct 12 16:39:52 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 16:39:52.577596 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ede265-6cd9-476b-a130-c7c084808e49 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:39:52.588130 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ede265-6cd9-476b-a130-c7c084808e49 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:39:52.595211 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27924f53-1e87-4d6a-9335-5dbf9d21e384 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:39:52.595960 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27924f53-1e87-4d6a-9335-5dbf9d21e384 admin admin] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:39:52.596259 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27924f53-1e87-4d6a-9335-5dbf9d21e384 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:39:52.596620 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27924f53-1e87-4d6a-9335-5dbf9d21e384 admin admin] PATH_INFO: `/v3/users` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:39:52.597307 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27924f53-1e87-4d6a-9335-5dbf9d21e384 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:39:52.599516 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27924f53-1e87-4d6a-9335-5dbf9d21e384 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:39:52.629913 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 559/1101] 10.222.0.58 () {60 vars in 1153 bytes} [Tue Oct 12 16:39:52 2021] POST /identity/v3/users => generated 251 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:39:55.031608 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c6315d-fe98-4eb0-81db-99306ee43058 None None] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:39:55.032221 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c6315d-fe98-4eb0-81db-99306ee43058 None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:39:55.032221 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c6315d-fe98-4eb0-81db-99306ee43058 None None] PATH_INFO: `/` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:39:55.034073 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 543/1102] 10.222.0.58 () {54 vars in 926 bytes} [Tue Oct 12 16:39:55 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 12 16:39:55.039858 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca60367-60be-4a20-bd8a-9949c9e69670 None None] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:39:55.040350 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca60367-60be-4a20-bd8a-9949c9e69670 None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:39:55.040431 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca60367-60be-4a20-bd8a-9949c9e69670 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:39:55.068922 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.auth.core [None req-cca60367-60be-4a20-bd8a-9949c9e69670 None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:39:55.068922 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-cca60367-60be-4a20-bd8a-9949c9e69670 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:39:55.082027 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 560/1103] 10.222.0.58 () {58 vars in 1023 bytes} [Tue Oct 12 16:39:55 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:39:55.100904 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c6315d-fe98-4eb0-81db-99306ee43058 None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:39:55.114375 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c6315d-fe98-4eb0-81db-99306ee43058 None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:39:55.119706 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff64a7a-66c0-4d61-8e6b-cac19741bb54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:39:55.121168 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff64a7a-66c0-4d61-8e6b-cac19741bb54 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:39:55.121494 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff64a7a-66c0-4d61-8e6b-cac19741bb54 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:39:55.121782 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff64a7a-66c0-4d61-8e6b-cac19741bb54 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:39:55.134332 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff64a7a-66c0-4d61-8e6b-cac19741bb54 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 16:39:55.141457 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: WARNING keystone.server.flask.application [None req-2ff64a7a-66c0-4d61-8e6b-cac19741bb54 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 12 16:39:55.142743 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 544/1104] 10.222.0.58 () {56 vars in 1123 bytes} [Tue Oct 12 16:39:55 2021] GET /identity/v3/roles/service => generated 85 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:39:55.150151 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca60367-60be-4a20-bd8a-9949c9e69670 None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:39:55.159910 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca60367-60be-4a20-bd8a-9949c9e69670 None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:39:55.165434 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0055ce8-e254-440a-8c21-6d65fc930939 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:39:55.166144 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0055ce8-e254-440a-8c21-6d65fc930939 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:39:55.166430 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0055ce8-e254-440a-8c21-6d65fc930939 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:39:55.166707 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0055ce8-e254-440a-8c21-6d65fc930939 admin admin] PATH_INFO: `/v3/roles` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:39:55.168033 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0055ce8-e254-440a-8c21-6d65fc930939 admin admin] RBAC: Adding query filter params (name=service) {{(pid=85204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:39:55.168387 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0055ce8-e254-440a-8c21-6d65fc930939 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:39:55.170038 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0055ce8-e254-440a-8c21-6d65fc930939 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:39:55.181212 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 561/1105] 10.222.0.58 () {56 vars in 1124 bytes} [Tue Oct 12 16:39:55 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:39:55.188495 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff64a7a-66c0-4d61-8e6b-cac19741bb54 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:39:55.198969 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff64a7a-66c0-4d61-8e6b-cac19741bb54 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:39:55.204208 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98488ac5-6dcc-450c-9476-57de865304d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:39:55.205000 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98488ac5-6dcc-450c-9476-57de865304d7 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:39:55.205301 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98488ac5-6dcc-450c-9476-57de865304d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:39:55.205548 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98488ac5-6dcc-450c-9476-57de865304d7 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:39:55.219605 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98488ac5-6dcc-450c-9476-57de865304d7 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:39:55.221659 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98488ac5-6dcc-450c-9476-57de865304d7 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:39:55.240431 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: WARNING keystone.server.flask.application [None req-98488ac5-6dcc-450c-9476-57de865304d7 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 16:39:55.243517 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 545/1106] 10.222.0.58 () {56 vars in 1129 bytes} [Tue Oct 12 16:39:55 2021] GET /identity/v3/domains/Default => generated 87 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:39:55.249124 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0055ce8-e254-440a-8c21-6d65fc930939 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:39:55.259469 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0055ce8-e254-440a-8c21-6d65fc930939 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:39:55.264364 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e44f4e-0108-42cb-a648-6f820bd8473c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:39:55.265032 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e44f4e-0108-42cb-a648-6f820bd8473c admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:39:55.265333 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e44f4e-0108-42cb-a648-6f820bd8473c admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:39:55.265586 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e44f4e-0108-42cb-a648-6f820bd8473c admin admin] PATH_INFO: `/v3/domains` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:39:55.266375 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e44f4e-0108-42cb-a648-6f820bd8473c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:39:55.267467 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e44f4e-0108-42cb-a648-6f820bd8473c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:39:55.268327 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e44f4e-0108-42cb-a648-6f820bd8473c admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:39:55.285509 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 562/1107] 10.222.0.58 () {56 vars in 1130 bytes} [Tue Oct 12 16:39:55 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 16:39:55.292674 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98488ac5-6dcc-450c-9476-57de865304d7 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:39:55.303203 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98488ac5-6dcc-450c-9476-57de865304d7 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:39:55.308595 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd36804-3f35-4abd-93d2-1ccb67570d48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:39:55.309387 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd36804-3f35-4abd-93d2-1ccb67570d48 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:39:55.309742 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd36804-3f35-4abd-93d2-1ccb67570d48 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:39:55.310039 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd36804-3f35-4abd-93d2-1ccb67570d48 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:39:55.318171 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd36804-3f35-4abd-93d2-1ccb67570d48 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:39:55.320726 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd36804-3f35-4abd-93d2-1ccb67570d48 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:39:55.336185 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: WARNING keystone.server.flask.application [None req-2fd36804-3f35-4abd-93d2-1ccb67570d48 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 12 16:39:55.337515 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 546/1108] 10.222.0.58 () {56 vars in 1129 bytes} [Tue Oct 12 16:39:55 2021] GET /identity/v3/users/placement => generated 87 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:39:55.344494 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e44f4e-0108-42cb-a648-6f820bd8473c admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:39:55.355879 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e44f4e-0108-42cb-a648-6f820bd8473c admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:39:55.365973 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6beeca36-d571-4ca8-a843-09ab72de5d75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:39:55.365973 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6beeca36-d571-4ca8-a843-09ab72de5d75 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:39:55.365973 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6beeca36-d571-4ca8-a843-09ab72de5d75 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:39:55.365973 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6beeca36-d571-4ca8-a843-09ab72de5d75 admin admin] PATH_INFO: `/v3/users` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:39:55.366356 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6beeca36-d571-4ca8-a843-09ab72de5d75 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=85204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:39:55.366356 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6beeca36-d571-4ca8-a843-09ab72de5d75 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:39:55.366356 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6beeca36-d571-4ca8-a843-09ab72de5d75 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:39:55.389229 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 563/1109] 10.222.0.58 () {56 vars in 1164 bytes} [Tue Oct 12 16:39:55 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:39:55.396029 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd36804-3f35-4abd-93d2-1ccb67570d48 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:39:55.407329 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd36804-3f35-4abd-93d2-1ccb67570d48 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:39:55.413555 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e69c32f-9426-4d57-93b3-a279eb36061e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:39:55.414367 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e69c32f-9426-4d57-93b3-a279eb36061e admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:39:55.414656 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e69c32f-9426-4d57-93b3-a279eb36061e admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:39:55.414918 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e69c32f-9426-4d57-93b3-a279eb36061e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:39:55.425531 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e69c32f-9426-4d57-93b3-a279eb36061e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:39:55.427438 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e69c32f-9426-4d57-93b3-a279eb36061e admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:39:55.436751 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 547/1110] 10.222.0.58 () {58 vars in 1324 bytes} [Tue Oct 12 16:39:55 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:39:55.444277 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6beeca36-d571-4ca8-a843-09ab72de5d75 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:39:55.454192 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6beeca36-d571-4ca8-a843-09ab72de5d75 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:39:55.459514 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb9dc83-5b4f-48dc-9915-9f636b72ba96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:39:55.460498 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb9dc83-5b4f-48dc-9915-9f636b72ba96 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:39:55.462001 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb9dc83-5b4f-48dc-9915-9f636b72ba96 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:39:55.462001 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb9dc83-5b4f-48dc-9915-9f636b72ba96 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:39:55.472840 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb9dc83-5b4f-48dc-9915-9f636b72ba96 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:39:55.474795 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb9dc83-5b4f-48dc-9915-9f636b72ba96 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:39:55.495530 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: WARNING keystone.server.flask.application [None req-ebb9dc83-5b4f-48dc-9915-9f636b72ba96 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 16:39:55.496735 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 564/1111] 10.222.0.58 () {56 vars in 1129 bytes} [Tue Oct 12 16:39:55 2021] GET /identity/v3/domains/Default => generated 87 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 16:39:55.503409 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e69c32f-9426-4d57-93b3-a279eb36061e admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:39:55.512207 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e69c32f-9426-4d57-93b3-a279eb36061e admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:39:55.517063 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c3e856-f04c-45b2-9f23-23cab9185b7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:39:55.517719 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c3e856-f04c-45b2-9f23-23cab9185b7e admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:39:55.519476 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c3e856-f04c-45b2-9f23-23cab9185b7e admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:39:55.519476 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c3e856-f04c-45b2-9f23-23cab9185b7e admin admin] PATH_INFO: `/v3/domains` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:39:55.519476 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c3e856-f04c-45b2-9f23-23cab9185b7e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:39:55.519476 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c3e856-f04c-45b2-9f23-23cab9185b7e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:39:55.520878 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c3e856-f04c-45b2-9f23-23cab9185b7e admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:39:55.533830 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 548/1112] 10.222.0.58 () {56 vars in 1130 bytes} [Tue Oct 12 16:39:55 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:39:55.540204 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb9dc83-5b4f-48dc-9915-9f636b72ba96 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:39:55.550919 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb9dc83-5b4f-48dc-9915-9f636b72ba96 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:39:55.556076 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61590e66-8a32-4810-9a02-e2ad47d051b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:39:55.558326 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61590e66-8a32-4810-9a02-e2ad47d051b7 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:39:55.558326 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61590e66-8a32-4810-9a02-e2ad47d051b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:39:55.558326 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61590e66-8a32-4810-9a02-e2ad47d051b7 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:39:55.564593 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61590e66-8a32-4810-9a02-e2ad47d051b7 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:39:55.566569 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61590e66-8a32-4810-9a02-e2ad47d051b7 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:39:55.579682 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: WARNING keystone.server.flask.application [None req-61590e66-8a32-4810-9a02-e2ad47d051b7 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 16:39:55.580788 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 565/1113] 10.222.0.58 () {56 vars in 1132 bytes} [Tue Oct 12 16:39:55 2021] GET /identity/v3/projects/service => generated 88 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 16:39:55.588326 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c3e856-f04c-45b2-9f23-23cab9185b7e admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:39:55.600624 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c3e856-f04c-45b2-9f23-23cab9185b7e admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:39:55.606813 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62f61f5-caa1-442a-8d9a-10c62f13eacc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:39:55.607716 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62f61f5-caa1-442a-8d9a-10c62f13eacc admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:39:55.608080 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62f61f5-caa1-442a-8d9a-10c62f13eacc admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:39:55.608399 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62f61f5-caa1-442a-8d9a-10c62f13eacc admin admin] PATH_INFO: `/v3/projects` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:39:55.609278 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62f61f5-caa1-442a-8d9a-10c62f13eacc admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=85205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:39:55.609763 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62f61f5-caa1-442a-8d9a-10c62f13eacc admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:39:55.612083 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62f61f5-caa1-442a-8d9a-10c62f13eacc admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:39:55.632803 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 549/1114] 10.222.0.58 () {56 vars in 1169 bytes} [Tue Oct 12 16:39:55 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:39:55.634120 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61590e66-8a32-4810-9a02-e2ad47d051b7 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:39:55.646989 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61590e66-8a32-4810-9a02-e2ad47d051b7 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:39:55.653445 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6480ff-66a5-421b-bdcd-8dbefc0301fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:39:55.654273 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6480ff-66a5-421b-bdcd-8dbefc0301fc admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:39:55.654672 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6480ff-66a5-421b-bdcd-8dbefc0301fc admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:39:55.654956 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6480ff-66a5-421b-bdcd-8dbefc0301fc admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:39:55.655809 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6480ff-66a5-421b-bdcd-8dbefc0301fc admin admin] RBAC: Adding query filter params (role.id=dea461b7131b413590d73da4994002ca, scope.project.id=f3531f242eaa43b69562d70bca5ec5a8, user.id=4102412c40bc4745bba8c31f1caf9788) {{(pid=85204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:39:55.656127 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6480ff-66a5-421b-bdcd-8dbefc0301fc admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:39:55.658329 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6480ff-66a5-421b-bdcd-8dbefc0301fc admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:39:55.665534 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 566/1115] 10.222.0.58 () {56 vars in 1395 bytes} [Tue Oct 12 16:39:55 2021] GET /identity/v3/role_assignments?user.id=4102412c40bc4745bba8c31f1caf9788&scope.project.id=f3531f242eaa43b69562d70bca5ec5a8&role.id=dea461b7131b413590d73da4994002ca => generated 259 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:39:57.935498 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed75b52f-a777-4b36-9452-63abc27b8625 None None] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:39:57.936051 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed75b52f-a777-4b36-9452-63abc27b8625 None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:39:57.936051 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed75b52f-a777-4b36-9452-63abc27b8625 None None] PATH_INFO: `/` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:39:57.937975 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 550/1116] 10.222.0.58 () {54 vars in 926 bytes} [Tue Oct 12 16:39:57 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:39:57.943586 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c230b9a-9b16-4645-88a7-5aff73ae2735 None None] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:39:57.943978 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c230b9a-9b16-4645-88a7-5aff73ae2735 None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:39:57.944147 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c230b9a-9b16-4645-88a7-5aff73ae2735 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:39:57.961192 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.auth.core [None req-8c230b9a-9b16-4645-88a7-5aff73ae2735 None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:39:57.962403 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-8c230b9a-9b16-4645-88a7-5aff73ae2735 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:39:57.970734 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 567/1117] 10.222.0.58 () {58 vars in 1023 bytes} [Tue Oct 12 16:39:57 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:39:57.994095 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed75b52f-a777-4b36-9452-63abc27b8625 None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:39:58.008957 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed75b52f-a777-4b36-9452-63abc27b8625 None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:39:58.013486 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720fb4d2-9383-4ce9-a5bd-e844e6c81a0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:39:58.014302 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720fb4d2-9383-4ce9-a5bd-e844e6c81a0e admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:39:58.014585 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720fb4d2-9383-4ce9-a5bd-e844e6c81a0e admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:39:58.014854 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720fb4d2-9383-4ce9-a5bd-e844e6c81a0e admin admin] PATH_INFO: `/v3/roles/service` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:39:58.025440 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720fb4d2-9383-4ce9-a5bd-e844e6c81a0e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 16:39:58.032513 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: WARNING keystone.server.flask.application [None req-720fb4d2-9383-4ce9-a5bd-e844e6c81a0e admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 12 16:39:58.033698 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 551/1118] 10.222.0.58 () {56 vars in 1123 bytes} [Tue Oct 12 16:39:57 2021] GET /identity/v3/roles/service => generated 85 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:39:58.040370 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c230b9a-9b16-4645-88a7-5aff73ae2735 None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:39:58.050040 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c230b9a-9b16-4645-88a7-5aff73ae2735 None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:39:58.054833 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f18a3e-5bb8-47bb-be54-3856b13f7d6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:39:58.055486 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f18a3e-5bb8-47bb-be54-3856b13f7d6c admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:39:58.055765 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f18a3e-5bb8-47bb-be54-3856b13f7d6c admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:39:58.056059 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f18a3e-5bb8-47bb-be54-3856b13f7d6c admin admin] PATH_INFO: `/v3/roles` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:39:58.056883 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f18a3e-5bb8-47bb-be54-3856b13f7d6c admin admin] RBAC: Adding query filter params (name=service) {{(pid=85204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:39:58.057155 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f18a3e-5bb8-47bb-be54-3856b13f7d6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:39:58.059350 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f18a3e-5bb8-47bb-be54-3856b13f7d6c admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:39:58.068202 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 568/1119] 10.222.0.58 () {56 vars in 1124 bytes} [Tue Oct 12 16:39:58 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 16:39:58.074567 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720fb4d2-9383-4ce9-a5bd-e844e6c81a0e admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:39:58.085213 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720fb4d2-9383-4ce9-a5bd-e844e6c81a0e admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:39:58.090214 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d878833-dc5e-48ab-87f6-c3ea143d6865 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:39:58.093364 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d878833-dc5e-48ab-87f6-c3ea143d6865 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:39:58.093648 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d878833-dc5e-48ab-87f6-c3ea143d6865 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:39:58.094020 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d878833-dc5e-48ab-87f6-c3ea143d6865 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:39:58.105190 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d878833-dc5e-48ab-87f6-c3ea143d6865 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:39:58.107613 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d878833-dc5e-48ab-87f6-c3ea143d6865 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:39:58.128171 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: WARNING keystone.server.flask.application [None req-7d878833-dc5e-48ab-87f6-c3ea143d6865 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 16:39:58.129444 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 552/1120] 10.222.0.58 () {56 vars in 1129 bytes} [Tue Oct 12 16:39:58 2021] GET /identity/v3/domains/Default => generated 87 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:39:58.135839 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f18a3e-5bb8-47bb-be54-3856b13f7d6c admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:39:58.146489 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f18a3e-5bb8-47bb-be54-3856b13f7d6c admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:39:58.151268 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f029668-814f-4e90-bd48-990fbb4fe319 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:39:58.151974 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f029668-814f-4e90-bd48-990fbb4fe319 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:39:58.152257 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f029668-814f-4e90-bd48-990fbb4fe319 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:39:58.152526 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f029668-814f-4e90-bd48-990fbb4fe319 admin admin] PATH_INFO: `/v3/domains` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:39:58.153253 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f029668-814f-4e90-bd48-990fbb4fe319 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:39:58.153556 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f029668-814f-4e90-bd48-990fbb4fe319 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:39:58.155184 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f029668-814f-4e90-bd48-990fbb4fe319 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:39:58.167026 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 569/1121] 10.222.0.58 () {56 vars in 1130 bytes} [Tue Oct 12 16:39:58 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 16:39:58.173938 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d878833-dc5e-48ab-87f6-c3ea143d6865 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:39:58.184537 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d878833-dc5e-48ab-87f6-c3ea143d6865 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:39:58.189542 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431ee659-14a1-4ac1-8fa9-02673220f62e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:39:58.190615 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431ee659-14a1-4ac1-8fa9-02673220f62e admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:39:58.191147 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431ee659-14a1-4ac1-8fa9-02673220f62e admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:39:58.191504 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431ee659-14a1-4ac1-8fa9-02673220f62e admin admin] PATH_INFO: `/v3/users/placement` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:39:58.199494 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431ee659-14a1-4ac1-8fa9-02673220f62e admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:39:58.201513 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431ee659-14a1-4ac1-8fa9-02673220f62e admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:39:58.217093 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: WARNING keystone.server.flask.application [None req-431ee659-14a1-4ac1-8fa9-02673220f62e admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 12 16:39:58.218289 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 553/1122] 10.222.0.58 () {56 vars in 1129 bytes} [Tue Oct 12 16:39:58 2021] GET /identity/v3/users/placement => generated 87 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:39:58.224880 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f029668-814f-4e90-bd48-990fbb4fe319 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:39:58.235781 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f029668-814f-4e90-bd48-990fbb4fe319 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:39:58.241393 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec2298e-3726-44be-8866-45afc6e14330 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:39:58.242255 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec2298e-3726-44be-8866-45afc6e14330 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:39:58.242711 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec2298e-3726-44be-8866-45afc6e14330 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:39:58.243163 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec2298e-3726-44be-8866-45afc6e14330 admin admin] PATH_INFO: `/v3/users` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:39:58.244287 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec2298e-3726-44be-8866-45afc6e14330 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=85204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:39:58.244791 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec2298e-3726-44be-8866-45afc6e14330 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:39:58.247585 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec2298e-3726-44be-8866-45afc6e14330 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:39:58.267608 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 570/1123] 10.222.0.58 () {56 vars in 1164 bytes} [Tue Oct 12 16:39:58 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 16:39:58.273806 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431ee659-14a1-4ac1-8fa9-02673220f62e admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:39:58.284520 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431ee659-14a1-4ac1-8fa9-02673220f62e admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:39:58.290144 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec18f6b-19c9-4dc4-99ee-4344dc2952eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:39:58.293224 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec18f6b-19c9-4dc4-99ee-4344dc2952eb admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:39:58.293603 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec18f6b-19c9-4dc4-99ee-4344dc2952eb admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:39:58.293928 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec18f6b-19c9-4dc4-99ee-4344dc2952eb admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:39:58.305330 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec18f6b-19c9-4dc4-99ee-4344dc2952eb admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:39:58.307207 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec18f6b-19c9-4dc4-99ee-4344dc2952eb admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:39:58.324678 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: WARNING keystone.server.flask.application [None req-eec18f6b-19c9-4dc4-99ee-4344dc2952eb admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 16:39:58.325857 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 554/1124] 10.222.0.58 () {56 vars in 1129 bytes} [Tue Oct 12 16:39:58 2021] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:39:58.332428 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec2298e-3726-44be-8866-45afc6e14330 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:39:58.342803 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec2298e-3726-44be-8866-45afc6e14330 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:39:58.347397 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8d2f06-f319-4db5-8ab4-176d7113a72c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:39:58.348022 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8d2f06-f319-4db5-8ab4-176d7113a72c admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:39:58.348334 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8d2f06-f319-4db5-8ab4-176d7113a72c admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:39:58.348583 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8d2f06-f319-4db5-8ab4-176d7113a72c admin admin] PATH_INFO: `/v3/domains` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:39:58.349424 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8d2f06-f319-4db5-8ab4-176d7113a72c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:39:58.349634 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8d2f06-f319-4db5-8ab4-176d7113a72c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:39:58.351222 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8d2f06-f319-4db5-8ab4-176d7113a72c admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:39:58.363471 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 571/1125] 10.222.0.58 () {56 vars in 1130 bytes} [Tue Oct 12 16:39:58 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:39:58.369652 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec18f6b-19c9-4dc4-99ee-4344dc2952eb admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:39:58.380016 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec18f6b-19c9-4dc4-99ee-4344dc2952eb admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:39:58.384790 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26616cb0-d9f8-4337-bd47-adb8747a56f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:39:58.385583 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26616cb0-d9f8-4337-bd47-adb8747a56f8 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:39:58.386028 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26616cb0-d9f8-4337-bd47-adb8747a56f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:39:58.386307 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26616cb0-d9f8-4337-bd47-adb8747a56f8 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:39:58.393728 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26616cb0-d9f8-4337-bd47-adb8747a56f8 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:39:58.395946 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26616cb0-d9f8-4337-bd47-adb8747a56f8 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:39:58.410378 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: WARNING keystone.server.flask.application [None req-26616cb0-d9f8-4337-bd47-adb8747a56f8 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 16:39:58.411715 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 555/1126] 10.222.0.58 () {56 vars in 1132 bytes} [Tue Oct 12 16:39:58 2021] GET /identity/v3/projects/service => generated 88 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:39:58.418344 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8d2f06-f319-4db5-8ab4-176d7113a72c admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:39:58.429597 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8d2f06-f319-4db5-8ab4-176d7113a72c admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:39:58.435040 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59be3f4-6f6c-4869-a630-7ee7f33c4c0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:39:58.435706 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59be3f4-6f6c-4869-a630-7ee7f33c4c0e admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:39:58.436066 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59be3f4-6f6c-4869-a630-7ee7f33c4c0e admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:39:58.436333 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59be3f4-6f6c-4869-a630-7ee7f33c4c0e admin admin] PATH_INFO: `/v3/projects` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:39:58.437265 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59be3f4-6f6c-4869-a630-7ee7f33c4c0e admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=85204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:39:58.437549 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59be3f4-6f6c-4869-a630-7ee7f33c4c0e admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:39:58.439515 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59be3f4-6f6c-4869-a630-7ee7f33c4c0e admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:39:58.453700 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 572/1127] 10.222.0.58 () {56 vars in 1169 bytes} [Tue Oct 12 16:39:58 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:39:58.460420 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26616cb0-d9f8-4337-bd47-adb8747a56f8 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:39:58.471243 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26616cb0-d9f8-4337-bd47-adb8747a56f8 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:39:58.476504 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015ef3c1-cfb8-42ee-988c-5f0c9c1eb7c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:39:58.477562 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015ef3c1-cfb8-42ee-988c-5f0c9c1eb7c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:39:58.478078 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015ef3c1-cfb8-42ee-988c-5f0c9c1eb7c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:39:58.478430 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015ef3c1-cfb8-42ee-988c-5f0c9c1eb7c4 admin admin] PATH_INFO: `/v3/projects/f3531f242eaa43b69562d70bca5ec5a8/users/4102412c40bc4745bba8c31f1caf9788/roles/dea461b7131b413590d73da4994002ca` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:39:58.494656 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015ef3c1-cfb8-42ee-988c-5f0c9c1eb7c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3531f242eaa43b69562d70bca5ec5a8, user_id=4102412c40bc4745bba8c31f1caf9788, role_id=dea461b7131b413590d73da4994002ca)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:39:58.497923 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015ef3c1-cfb8-42ee-988c-5f0c9c1eb7c4 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:39:58.521912 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 556/1128] 10.222.0.58 () {58 vars in 1460 bytes} [Tue Oct 12 16:39:58 2021] PUT /identity/v3/projects/f3531f242eaa43b69562d70bca5ec5a8/users/4102412c40bc4745bba8c31f1caf9788/roles/dea461b7131b413590d73da4994002ca => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 16:40:00.964956 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44462e47-f836-4d2d-9f27-e39a0831b6fb None None] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:00.965572 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44462e47-f836-4d2d-9f27-e39a0831b6fb None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:00.965572 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44462e47-f836-4d2d-9f27-e39a0831b6fb None None] PATH_INFO: `/` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:00.967377 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 573/1129] 10.222.0.58 () {54 vars in 926 bytes} [Tue Oct 12 16:40:00 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:40:00.973683 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ff5821-bb49-43cf-9bec-bbb087d9bd1b None None] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:00.974188 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ff5821-bb49-43cf-9bec-bbb087d9bd1b None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:00.974386 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ff5821-bb49-43cf-9bec-bbb087d9bd1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:00.993643 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.auth.core [None req-a6ff5821-bb49-43cf-9bec-bbb087d9bd1b None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:40:00.994952 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-a6ff5821-bb49-43cf-9bec-bbb087d9bd1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:40:01.056669 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 557/1130] 10.222.0.58 () {58 vars in 1023 bytes} [Tue Oct 12 16:40:00 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:40:01.080944 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44462e47-f836-4d2d-9f27-e39a0831b6fb None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:40:01.093960 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44462e47-f836-4d2d-9f27-e39a0831b6fb None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:40:01.099700 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86c8956-6bc4-450e-ba36-c571e3f2e676 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:40:01.100547 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86c8956-6bc4-450e-ba36-c571e3f2e676 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:01.100830 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86c8956-6bc4-450e-ba36-c571e3f2e676 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:01.101106 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86c8956-6bc4-450e-ba36-c571e3f2e676 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:01.112765 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86c8956-6bc4-450e-ba36-c571e3f2e676 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 16:40:01.120251 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: WARNING keystone.server.flask.application [None req-b86c8956-6bc4-450e-ba36-c571e3f2e676 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 12 16:40:01.121740 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 574/1131] 10.222.0.58 () {56 vars in 1123 bytes} [Tue Oct 12 16:40:01 2021] GET /identity/v3/roles/service => generated 85 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:40:01.128725 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ff5821-bb49-43cf-9bec-bbb087d9bd1b None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:40:01.139393 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ff5821-bb49-43cf-9bec-bbb087d9bd1b None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:40:01.144899 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4ad2ca-c97c-4913-91d2-d8a665e43eb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:40:01.145569 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4ad2ca-c97c-4913-91d2-d8a665e43eb9 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:01.145848 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4ad2ca-c97c-4913-91d2-d8a665e43eb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:01.146145 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4ad2ca-c97c-4913-91d2-d8a665e43eb9 admin admin] PATH_INFO: `/v3/roles` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:01.146897 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4ad2ca-c97c-4913-91d2-d8a665e43eb9 admin admin] RBAC: Adding query filter params (name=service) {{(pid=85205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:40:01.147202 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4ad2ca-c97c-4913-91d2-d8a665e43eb9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:40:01.148796 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4ad2ca-c97c-4913-91d2-d8a665e43eb9 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:40:01.159839 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 558/1132] 10.222.0.58 () {56 vars in 1124 bytes} [Tue Oct 12 16:40:01 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:40:01.166111 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86c8956-6bc4-450e-ba36-c571e3f2e676 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:40:01.177814 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86c8956-6bc4-450e-ba36-c571e3f2e676 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:40:01.183275 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdd9013-1229-40e1-9b8f-53e8a31251e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:40:01.184219 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdd9013-1229-40e1-9b8f-53e8a31251e2 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:01.184498 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdd9013-1229-40e1-9b8f-53e8a31251e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:01.184765 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdd9013-1229-40e1-9b8f-53e8a31251e2 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:01.196336 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdd9013-1229-40e1-9b8f-53e8a31251e2 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:40:01.199248 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdd9013-1229-40e1-9b8f-53e8a31251e2 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:40:01.218660 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: WARNING keystone.server.flask.application [None req-1fdd9013-1229-40e1-9b8f-53e8a31251e2 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 16:40:01.219986 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 575/1133] 10.222.0.58 () {56 vars in 1129 bytes} [Tue Oct 12 16:40:01 2021] GET /identity/v3/domains/Default => generated 87 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:40:01.226428 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4ad2ca-c97c-4913-91d2-d8a665e43eb9 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:40:01.237105 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4ad2ca-c97c-4913-91d2-d8a665e43eb9 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:40:01.242620 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd972a44-b24f-4be8-a585-1d465d2b9ddc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:40:01.243350 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd972a44-b24f-4be8-a585-1d465d2b9ddc admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:01.243700 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd972a44-b24f-4be8-a585-1d465d2b9ddc admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:01.244029 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd972a44-b24f-4be8-a585-1d465d2b9ddc admin admin] PATH_INFO: `/v3/domains` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:01.244855 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd972a44-b24f-4be8-a585-1d465d2b9ddc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:40:01.245220 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd972a44-b24f-4be8-a585-1d465d2b9ddc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:40:01.246995 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd972a44-b24f-4be8-a585-1d465d2b9ddc admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:40:01.259997 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 559/1134] 10.222.0.58 () {56 vars in 1130 bytes} [Tue Oct 12 16:40:01 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 16:40:01.266957 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdd9013-1229-40e1-9b8f-53e8a31251e2 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:40:01.279549 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdd9013-1229-40e1-9b8f-53e8a31251e2 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:40:01.285505 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b321f8-bbed-4755-acd3-684cb1e55f88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:40:01.286461 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b321f8-bbed-4755-acd3-684cb1e55f88 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:01.286803 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b321f8-bbed-4755-acd3-684cb1e55f88 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:01.287193 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b321f8-bbed-4755-acd3-684cb1e55f88 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:01.296759 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b321f8-bbed-4755-acd3-684cb1e55f88 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:40:01.299196 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b321f8-bbed-4755-acd3-684cb1e55f88 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:40:01.316275 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: WARNING keystone.server.flask.application [None req-f8b321f8-bbed-4755-acd3-684cb1e55f88 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 12 16:40:01.317728 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 576/1135] 10.222.0.58 () {56 vars in 1129 bytes} [Tue Oct 12 16:40:01 2021] GET /identity/v3/users/placement => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 16:40:01.325592 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd972a44-b24f-4be8-a585-1d465d2b9ddc admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:40:01.335430 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd972a44-b24f-4be8-a585-1d465d2b9ddc admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:40:01.340006 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac739de5-2c5b-467c-8a70-f9736f67082d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:40:01.340836 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac739de5-2c5b-467c-8a70-f9736f67082d admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:01.341124 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac739de5-2c5b-467c-8a70-f9736f67082d admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:01.341537 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac739de5-2c5b-467c-8a70-f9736f67082d admin admin] PATH_INFO: `/v3/users` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:01.342593 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac739de5-2c5b-467c-8a70-f9736f67082d admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=85205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:40:01.342935 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac739de5-2c5b-467c-8a70-f9736f67082d admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:40:01.345138 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac739de5-2c5b-467c-8a70-f9736f67082d admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:40:01.363788 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 560/1136] 10.222.0.58 () {56 vars in 1164 bytes} [Tue Oct 12 16:40:01 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:40:01.370124 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b321f8-bbed-4755-acd3-684cb1e55f88 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:40:01.382224 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b321f8-bbed-4755-acd3-684cb1e55f88 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:40:01.387869 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0e8a6a-8790-4520-b596-059c18eaf0c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:40:01.388646 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0e8a6a-8790-4520-b596-059c18eaf0c9 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:01.388979 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0e8a6a-8790-4520-b596-059c18eaf0c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:01.389261 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0e8a6a-8790-4520-b596-059c18eaf0c9 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:01.398503 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0e8a6a-8790-4520-b596-059c18eaf0c9 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:40:01.400293 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0e8a6a-8790-4520-b596-059c18eaf0c9 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:40:01.409884 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 577/1137] 10.222.0.58 () {58 vars in 1324 bytes} [Tue Oct 12 16:40:01 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 12 16:40:01.416550 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac739de5-2c5b-467c-8a70-f9736f67082d admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:40:01.427095 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac739de5-2c5b-467c-8a70-f9736f67082d admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:40:01.433296 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3332e93-5c03-4f6a-b939-0d419072cf6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:40:01.434385 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3332e93-5c03-4f6a-b939-0d419072cf6a admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:01.434661 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3332e93-5c03-4f6a-b939-0d419072cf6a admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:01.434986 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3332e93-5c03-4f6a-b939-0d419072cf6a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:01.445900 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3332e93-5c03-4f6a-b939-0d419072cf6a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:40:01.447852 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3332e93-5c03-4f6a-b939-0d419072cf6a admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:40:01.465637 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: WARNING keystone.server.flask.application [None req-b3332e93-5c03-4f6a-b939-0d419072cf6a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 16:40:01.466825 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 561/1138] 10.222.0.58 () {56 vars in 1129 bytes} [Tue Oct 12 16:40:01 2021] GET /identity/v3/domains/Default => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 16:40:01.473434 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0e8a6a-8790-4520-b596-059c18eaf0c9 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:40:01.482948 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0e8a6a-8790-4520-b596-059c18eaf0c9 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:40:01.489785 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa74c6d8-2b70-4dfa-8d9a-8460a65d5298 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:40:01.490474 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa74c6d8-2b70-4dfa-8d9a-8460a65d5298 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:01.490807 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa74c6d8-2b70-4dfa-8d9a-8460a65d5298 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:01.491113 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa74c6d8-2b70-4dfa-8d9a-8460a65d5298 admin admin] PATH_INFO: `/v3/domains` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:01.491936 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa74c6d8-2b70-4dfa-8d9a-8460a65d5298 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:40:01.492289 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa74c6d8-2b70-4dfa-8d9a-8460a65d5298 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:40:01.494222 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa74c6d8-2b70-4dfa-8d9a-8460a65d5298 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:40:01.507828 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 578/1139] 10.222.0.58 () {56 vars in 1130 bytes} [Tue Oct 12 16:40:01 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:40:01.515727 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3332e93-5c03-4f6a-b939-0d419072cf6a admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:40:01.527017 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3332e93-5c03-4f6a-b939-0d419072cf6a admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:40:01.531982 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923a068c-83d2-4d2a-9eb4-6cb5573b84dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:40:01.532759 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923a068c-83d2-4d2a-9eb4-6cb5573b84dd admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:01.533045 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923a068c-83d2-4d2a-9eb4-6cb5573b84dd admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:01.533333 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923a068c-83d2-4d2a-9eb4-6cb5573b84dd admin admin] PATH_INFO: `/v3/projects/service` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:01.540651 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923a068c-83d2-4d2a-9eb4-6cb5573b84dd admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:40:01.542847 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923a068c-83d2-4d2a-9eb4-6cb5573b84dd admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:40:01.556956 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: WARNING keystone.server.flask.application [None req-923a068c-83d2-4d2a-9eb4-6cb5573b84dd admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 16:40:01.558675 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 562/1140] 10.222.0.58 () {56 vars in 1132 bytes} [Tue Oct 12 16:40:01 2021] GET /identity/v3/projects/service => generated 88 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 16:40:01.566244 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa74c6d8-2b70-4dfa-8d9a-8460a65d5298 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:40:01.578035 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa74c6d8-2b70-4dfa-8d9a-8460a65d5298 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:40:01.583982 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846decb2-2294-4f93-8e76-838b61f824b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:40:01.584725 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846decb2-2294-4f93-8e76-838b61f824b1 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:01.585059 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846decb2-2294-4f93-8e76-838b61f824b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:01.585603 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846decb2-2294-4f93-8e76-838b61f824b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:01.586535 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846decb2-2294-4f93-8e76-838b61f824b1 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=85204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:40:01.586879 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846decb2-2294-4f93-8e76-838b61f824b1 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:40:01.589294 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846decb2-2294-4f93-8e76-838b61f824b1 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:40:01.603596 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 579/1141] 10.222.0.58 () {56 vars in 1169 bytes} [Tue Oct 12 16:40:01 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:40:01.611453 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923a068c-83d2-4d2a-9eb4-6cb5573b84dd admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:40:01.625856 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923a068c-83d2-4d2a-9eb4-6cb5573b84dd admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:40:01.631380 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36fa576-6de9-4f86-976c-57e5cad83cb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:40:01.632167 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36fa576-6de9-4f86-976c-57e5cad83cb7 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:01.632561 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36fa576-6de9-4f86-976c-57e5cad83cb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:01.632795 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36fa576-6de9-4f86-976c-57e5cad83cb7 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:01.633813 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36fa576-6de9-4f86-976c-57e5cad83cb7 admin admin] RBAC: Adding query filter params (role.id=dea461b7131b413590d73da4994002ca, scope.project.id=f3531f242eaa43b69562d70bca5ec5a8, user.id=4102412c40bc4745bba8c31f1caf9788) {{(pid=85205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:40:01.634273 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36fa576-6de9-4f86-976c-57e5cad83cb7 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:40:01.636402 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36fa576-6de9-4f86-976c-57e5cad83cb7 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:40:01.643757 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 563/1142] 10.222.0.58 () {56 vars in 1395 bytes} [Tue Oct 12 16:40:01 2021] GET /identity/v3/role_assignments?user.id=4102412c40bc4745bba8c31f1caf9788&scope.project.id=f3531f242eaa43b69562d70bca5ec5a8&role.id=dea461b7131b413590d73da4994002ca => generated 608 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 16:40:03.979741 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0a744b-9f11-4717-8da6-5f4418391a9e None None] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:03.980330 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0a744b-9f11-4717-8da6-5f4418391a9e None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:03.980330 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0a744b-9f11-4717-8da6-5f4418391a9e None None] PATH_INFO: `/` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:03.982278 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 580/1143] 10.222.0.58 () {54 vars in 926 bytes} [Tue Oct 12 16:40:03 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:40:03.988251 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ff2b68-a52f-4510-802c-fba8eb4dcd7d None None] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:03.988720 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ff2b68-a52f-4510-802c-fba8eb4dcd7d None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:03.988816 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ff2b68-a52f-4510-802c-fba8eb4dcd7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:04.006727 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.auth.core [None req-f4ff2b68-a52f-4510-802c-fba8eb4dcd7d None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:40:04.007915 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-f4ff2b68-a52f-4510-802c-fba8eb4dcd7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:40:04.016519 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 564/1144] 10.222.0.58 () {58 vars in 1023 bytes} [Tue Oct 12 16:40:03 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:40:04.041325 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0a744b-9f11-4717-8da6-5f4418391a9e None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:40:04.053958 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0a744b-9f11-4717-8da6-5f4418391a9e None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:40:04.058520 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa84a89-f049-4677-85c4-64f182a08650 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:40:04.059306 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa84a89-f049-4677-85c4-64f182a08650 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:04.059584 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa84a89-f049-4677-85c4-64f182a08650 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:04.059863 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa84a89-f049-4677-85c4-64f182a08650 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:04.070349 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa84a89-f049-4677-85c4-64f182a08650 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 16:40:04.077802 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: WARNING keystone.server.flask.application [None req-baa84a89-f049-4677-85c4-64f182a08650 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 16:40:04.079143 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 581/1145] 10.222.0.58 () {56 vars in 1117 bytes} [Tue Oct 12 16:40:04 2021] GET /identity/v3/roles/admin => generated 83 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:40:04.086024 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ff2b68-a52f-4510-802c-fba8eb4dcd7d None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:40:04.096513 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ff2b68-a52f-4510-802c-fba8eb4dcd7d None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:40:04.104610 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b99f4c-e598-4829-bac9-6483481eec7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:40:04.105305 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b99f4c-e598-4829-bac9-6483481eec7c admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:04.105588 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b99f4c-e598-4829-bac9-6483481eec7c admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:04.105907 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b99f4c-e598-4829-bac9-6483481eec7c admin admin] PATH_INFO: `/v3/roles` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:04.106657 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b99f4c-e598-4829-bac9-6483481eec7c admin admin] RBAC: Adding query filter params (name=admin) {{(pid=85205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:40:04.106995 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b99f4c-e598-4829-bac9-6483481eec7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:40:04.108544 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b99f4c-e598-4829-bac9-6483481eec7c admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:40:04.117161 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 565/1146] 10.222.0.58 () {56 vars in 1120 bytes} [Tue Oct 12 16:40:04 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:40:04.123810 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa84a89-f049-4677-85c4-64f182a08650 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:40:04.133699 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa84a89-f049-4677-85c4-64f182a08650 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:40:04.139004 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2814a0-4172-437f-9dbe-9eb0894d8f3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:40:04.139797 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2814a0-4172-437f-9dbe-9eb0894d8f3b admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:04.140079 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2814a0-4172-437f-9dbe-9eb0894d8f3b admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:04.140354 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2814a0-4172-437f-9dbe-9eb0894d8f3b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:04.150931 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2814a0-4172-437f-9dbe-9eb0894d8f3b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:40:04.153284 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2814a0-4172-437f-9dbe-9eb0894d8f3b admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:40:04.170453 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: WARNING keystone.server.flask.application [None req-8e2814a0-4172-437f-9dbe-9eb0894d8f3b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 16:40:04.171796 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 582/1147] 10.222.0.58 () {56 vars in 1129 bytes} [Tue Oct 12 16:40:04 2021] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 16:40:04.180572 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b99f4c-e598-4829-bac9-6483481eec7c admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:40:04.191734 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b99f4c-e598-4829-bac9-6483481eec7c admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:40:04.197180 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a03acae-db31-4fd3-9263-b2a078764812 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:40:04.197927 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a03acae-db31-4fd3-9263-b2a078764812 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:04.199050 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a03acae-db31-4fd3-9263-b2a078764812 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:04.199050 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a03acae-db31-4fd3-9263-b2a078764812 admin admin] PATH_INFO: `/v3/domains` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:04.199909 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a03acae-db31-4fd3-9263-b2a078764812 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:40:04.200225 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a03acae-db31-4fd3-9263-b2a078764812 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:40:04.202047 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a03acae-db31-4fd3-9263-b2a078764812 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:40:04.215945 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 566/1148] 10.222.0.58 () {56 vars in 1130 bytes} [Tue Oct 12 16:40:04 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:40:04.222811 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2814a0-4172-437f-9dbe-9eb0894d8f3b admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:40:04.232545 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2814a0-4172-437f-9dbe-9eb0894d8f3b admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:40:04.237040 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b3d3be-5365-4c17-bf25-2d3314b66e30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:40:04.237821 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b3d3be-5365-4c17-bf25-2d3314b66e30 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:04.238135 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b3d3be-5365-4c17-bf25-2d3314b66e30 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:04.238413 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b3d3be-5365-4c17-bf25-2d3314b66e30 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:04.246240 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b3d3be-5365-4c17-bf25-2d3314b66e30 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:40:04.248243 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b3d3be-5365-4c17-bf25-2d3314b66e30 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:40:04.265364 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: WARNING keystone.server.flask.application [None req-c5b3d3be-5365-4c17-bf25-2d3314b66e30 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 12 16:40:04.265364 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 583/1149] 10.222.0.58 () {56 vars in 1129 bytes} [Tue Oct 12 16:40:04 2021] GET /identity/v3/users/placement => generated 87 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:40:04.271632 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a03acae-db31-4fd3-9263-b2a078764812 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:40:04.285045 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a03acae-db31-4fd3-9263-b2a078764812 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:40:04.291086 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e434fe-4b7c-4aad-9e1d-e09bdf737fbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:40:04.291695 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e434fe-4b7c-4aad-9e1d-e09bdf737fbb admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:04.291982 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e434fe-4b7c-4aad-9e1d-e09bdf737fbb admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:04.292259 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e434fe-4b7c-4aad-9e1d-e09bdf737fbb admin admin] PATH_INFO: `/v3/users` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:04.293114 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e434fe-4b7c-4aad-9e1d-e09bdf737fbb admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=85205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:40:04.293425 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e434fe-4b7c-4aad-9e1d-e09bdf737fbb admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:40:04.295433 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e434fe-4b7c-4aad-9e1d-e09bdf737fbb admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:40:04.315113 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 567/1150] 10.222.0.58 () {56 vars in 1164 bytes} [Tue Oct 12 16:40:04 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 16:40:04.321635 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b3d3be-5365-4c17-bf25-2d3314b66e30 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:40:04.332371 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b3d3be-5365-4c17-bf25-2d3314b66e30 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:40:04.337096 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18b0a17-ef11-4267-9c9d-9edc759b2df3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:40:04.337741 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18b0a17-ef11-4267-9c9d-9edc759b2df3 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:04.338075 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18b0a17-ef11-4267-9c9d-9edc759b2df3 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:04.338372 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18b0a17-ef11-4267-9c9d-9edc759b2df3 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:04.347134 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18b0a17-ef11-4267-9c9d-9edc759b2df3 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:40:04.349308 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18b0a17-ef11-4267-9c9d-9edc759b2df3 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:40:04.359042 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 584/1151] 10.222.0.58 () {58 vars in 1324 bytes} [Tue Oct 12 16:40:04 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:40:04.365667 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e434fe-4b7c-4aad-9e1d-e09bdf737fbb admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:40:04.377594 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e434fe-4b7c-4aad-9e1d-e09bdf737fbb admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:40:04.382204 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6918f5ed-fb50-42ff-b88f-fa3d9ede30fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:40:04.382980 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6918f5ed-fb50-42ff-b88f-fa3d9ede30fc admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:04.383258 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6918f5ed-fb50-42ff-b88f-fa3d9ede30fc admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:04.383525 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6918f5ed-fb50-42ff-b88f-fa3d9ede30fc admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:04.396005 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6918f5ed-fb50-42ff-b88f-fa3d9ede30fc admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:40:04.397804 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6918f5ed-fb50-42ff-b88f-fa3d9ede30fc admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:40:04.417794 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: WARNING keystone.server.flask.application [None req-6918f5ed-fb50-42ff-b88f-fa3d9ede30fc admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 16:40:04.419139 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 568/1152] 10.222.0.58 () {56 vars in 1129 bytes} [Tue Oct 12 16:40:04 2021] GET /identity/v3/domains/Default => generated 87 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:40:04.425558 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18b0a17-ef11-4267-9c9d-9edc759b2df3 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:40:04.436115 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18b0a17-ef11-4267-9c9d-9edc759b2df3 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:40:04.441864 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33250f88-58bb-4855-a40a-2da4be470b4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:40:04.442535 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33250f88-58bb-4855-a40a-2da4be470b4b admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:04.442821 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33250f88-58bb-4855-a40a-2da4be470b4b admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:04.443093 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33250f88-58bb-4855-a40a-2da4be470b4b admin admin] PATH_INFO: `/v3/domains` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:04.443813 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33250f88-58bb-4855-a40a-2da4be470b4b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:40:04.444114 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33250f88-58bb-4855-a40a-2da4be470b4b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:40:04.445887 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33250f88-58bb-4855-a40a-2da4be470b4b admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:40:04.461093 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 585/1153] 10.222.0.58 () {56 vars in 1130 bytes} [Tue Oct 12 16:40:04 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:40:04.467405 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6918f5ed-fb50-42ff-b88f-fa3d9ede30fc admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:40:04.477666 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6918f5ed-fb50-42ff-b88f-fa3d9ede30fc admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:40:04.482801 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c784c7-9ab7-46dd-b12c-2fe072404613 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:40:04.483586 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c784c7-9ab7-46dd-b12c-2fe072404613 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:04.483873 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c784c7-9ab7-46dd-b12c-2fe072404613 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:04.484149 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c784c7-9ab7-46dd-b12c-2fe072404613 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:04.491239 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c784c7-9ab7-46dd-b12c-2fe072404613 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:40:04.493177 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c784c7-9ab7-46dd-b12c-2fe072404613 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:40:04.506962 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: WARNING keystone.server.flask.application [None req-f6c784c7-9ab7-46dd-b12c-2fe072404613 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 16:40:04.508136 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 569/1154] 10.222.0.58 () {56 vars in 1132 bytes} [Tue Oct 12 16:40:04 2021] GET /identity/v3/projects/service => generated 88 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:40:04.515320 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33250f88-58bb-4855-a40a-2da4be470b4b admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:40:04.524973 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33250f88-58bb-4855-a40a-2da4be470b4b admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:40:04.529675 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed587d6-7f27-4047-83ea-1c560be4b036 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:40:04.530356 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed587d6-7f27-4047-83ea-1c560be4b036 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:04.530641 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed587d6-7f27-4047-83ea-1c560be4b036 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:04.530911 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed587d6-7f27-4047-83ea-1c560be4b036 admin admin] PATH_INFO: `/v3/projects` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:04.531701 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed587d6-7f27-4047-83ea-1c560be4b036 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=85204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:40:04.532015 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed587d6-7f27-4047-83ea-1c560be4b036 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:40:04.533829 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed587d6-7f27-4047-83ea-1c560be4b036 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:40:04.545548 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 586/1155] 10.222.0.58 () {56 vars in 1169 bytes} [Tue Oct 12 16:40:04 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:40:04.552710 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c784c7-9ab7-46dd-b12c-2fe072404613 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:40:04.565413 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c784c7-9ab7-46dd-b12c-2fe072404613 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:40:04.570073 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117d815c-655a-47fd-8d34-755460a4e50d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:40:04.570717 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117d815c-655a-47fd-8d34-755460a4e50d admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:04.570998 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117d815c-655a-47fd-8d34-755460a4e50d admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:04.571278 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117d815c-655a-47fd-8d34-755460a4e50d admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:04.572176 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117d815c-655a-47fd-8d34-755460a4e50d admin admin] RBAC: Adding query filter params (role.id=610824e4f50f4fb8954610e98c1de784, scope.project.id=f3531f242eaa43b69562d70bca5ec5a8, user.id=4102412c40bc4745bba8c31f1caf9788) {{(pid=85205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:40:04.572435 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117d815c-655a-47fd-8d34-755460a4e50d admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:40:04.574864 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117d815c-655a-47fd-8d34-755460a4e50d admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:40:04.580560 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 570/1156] 10.222.0.58 () {56 vars in 1395 bytes} [Tue Oct 12 16:40:04 2021] GET /identity/v3/role_assignments?user.id=4102412c40bc4745bba8c31f1caf9788&scope.project.id=f3531f242eaa43b69562d70bca5ec5a8&role.id=610824e4f50f4fb8954610e98c1de784 => generated 259 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:40:06.930369 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52b6c2b-7b70-4d9c-b393-7a872b5b66be None None] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:06.930950 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52b6c2b-7b70-4d9c-b393-7a872b5b66be None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:06.930950 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52b6c2b-7b70-4d9c-b393-7a872b5b66be None None] PATH_INFO: `/` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:06.932672 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 587/1157] 10.222.0.58 () {54 vars in 926 bytes} [Tue Oct 12 16:40:06 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 12 16:40:06.941021 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7c9811-4968-4ffa-a21d-eaccf79c4231 None None] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:06.941501 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7c9811-4968-4ffa-a21d-eaccf79c4231 None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:06.941642 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7c9811-4968-4ffa-a21d-eaccf79c4231 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:06.961576 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.auth.core [None req-bb7c9811-4968-4ffa-a21d-eaccf79c4231 None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:40:06.962820 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-bb7c9811-4968-4ffa-a21d-eaccf79c4231 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:40:06.971646 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 571/1158] 10.222.0.58 () {58 vars in 1023 bytes} [Tue Oct 12 16:40:06 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:40:06.996521 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52b6c2b-7b70-4d9c-b393-7a872b5b66be None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:40:07.010120 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52b6c2b-7b70-4d9c-b393-7a872b5b66be None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:40:07.015635 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26493f58-2e2f-4a0a-abfb-378324507c95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:40:07.016407 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26493f58-2e2f-4a0a-abfb-378324507c95 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:07.016692 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26493f58-2e2f-4a0a-abfb-378324507c95 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:07.016965 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26493f58-2e2f-4a0a-abfb-378324507c95 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:07.028115 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26493f58-2e2f-4a0a-abfb-378324507c95 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 16:40:07.035504 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: WARNING keystone.server.flask.application [None req-26493f58-2e2f-4a0a-abfb-378324507c95 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 16:40:07.036817 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 588/1159] 10.222.0.58 () {56 vars in 1117 bytes} [Tue Oct 12 16:40:06 2021] GET /identity/v3/roles/admin => generated 83 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:40:07.044254 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7c9811-4968-4ffa-a21d-eaccf79c4231 None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:40:07.054738 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7c9811-4968-4ffa-a21d-eaccf79c4231 None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:40:07.060819 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad23d77-5697-43f9-8c42-59e31ea28264 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:40:07.061459 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad23d77-5697-43f9-8c42-59e31ea28264 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:07.061743 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad23d77-5697-43f9-8c42-59e31ea28264 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:07.062055 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad23d77-5697-43f9-8c42-59e31ea28264 admin admin] PATH_INFO: `/v3/roles` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:07.062886 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad23d77-5697-43f9-8c42-59e31ea28264 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=85205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:40:07.063198 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad23d77-5697-43f9-8c42-59e31ea28264 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:40:07.064804 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad23d77-5697-43f9-8c42-59e31ea28264 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:40:07.074149 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 572/1160] 10.222.0.58 () {56 vars in 1120 bytes} [Tue Oct 12 16:40:07 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:40:07.081624 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26493f58-2e2f-4a0a-abfb-378324507c95 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:40:07.093034 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26493f58-2e2f-4a0a-abfb-378324507c95 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:40:07.098129 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa1d637-c5ee-4bf6-9127-55805d9a9a37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:40:07.099011 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa1d637-c5ee-4bf6-9127-55805d9a9a37 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:07.099316 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa1d637-c5ee-4bf6-9127-55805d9a9a37 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:07.099630 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa1d637-c5ee-4bf6-9127-55805d9a9a37 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:07.112014 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa1d637-c5ee-4bf6-9127-55805d9a9a37 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:40:07.114073 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa1d637-c5ee-4bf6-9127-55805d9a9a37 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:40:07.132955 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: WARNING keystone.server.flask.application [None req-5fa1d637-c5ee-4bf6-9127-55805d9a9a37 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 16:40:07.134395 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 589/1161] 10.222.0.58 () {56 vars in 1129 bytes} [Tue Oct 12 16:40:07 2021] GET /identity/v3/domains/Default => generated 87 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:40:07.142623 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad23d77-5697-43f9-8c42-59e31ea28264 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:40:07.154913 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad23d77-5697-43f9-8c42-59e31ea28264 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:40:07.160463 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4139b7b0-ff68-449d-ac00-9442ed2ee89f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:40:07.161255 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4139b7b0-ff68-449d-ac00-9442ed2ee89f admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:07.161585 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4139b7b0-ff68-449d-ac00-9442ed2ee89f admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:07.161864 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4139b7b0-ff68-449d-ac00-9442ed2ee89f admin admin] PATH_INFO: `/v3/domains` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:07.162823 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4139b7b0-ff68-449d-ac00-9442ed2ee89f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:40:07.163207 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4139b7b0-ff68-449d-ac00-9442ed2ee89f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:40:07.165236 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4139b7b0-ff68-449d-ac00-9442ed2ee89f admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:40:07.179820 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 573/1162] 10.222.0.58 () {56 vars in 1130 bytes} [Tue Oct 12 16:40:07 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:40:07.187805 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa1d637-c5ee-4bf6-9127-55805d9a9a37 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:40:07.199911 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa1d637-c5ee-4bf6-9127-55805d9a9a37 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:40:07.205249 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282a1e6c-6afa-41c8-a3a1-598169fb173c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:40:07.206094 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282a1e6c-6afa-41c8-a3a1-598169fb173c admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:07.206383 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282a1e6c-6afa-41c8-a3a1-598169fb173c admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:07.206655 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282a1e6c-6afa-41c8-a3a1-598169fb173c admin admin] PATH_INFO: `/v3/users/placement` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:07.215717 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282a1e6c-6afa-41c8-a3a1-598169fb173c admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:40:07.217896 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282a1e6c-6afa-41c8-a3a1-598169fb173c admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:40:07.236445 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: WARNING keystone.server.flask.application [None req-282a1e6c-6afa-41c8-a3a1-598169fb173c admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 12 16:40:07.238558 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 590/1163] 10.222.0.58 () {56 vars in 1129 bytes} [Tue Oct 12 16:40:07 2021] GET /identity/v3/users/placement => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:40:07.247773 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4139b7b0-ff68-449d-ac00-9442ed2ee89f admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:40:07.260390 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4139b7b0-ff68-449d-ac00-9442ed2ee89f admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:40:07.267340 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ce0fd4-d390-4ab0-bc33-8636ab407cf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:40:07.268008 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ce0fd4-d390-4ab0-bc33-8636ab407cf8 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:07.268333 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ce0fd4-d390-4ab0-bc33-8636ab407cf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:07.268714 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ce0fd4-d390-4ab0-bc33-8636ab407cf8 admin admin] PATH_INFO: `/v3/users` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:07.270059 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ce0fd4-d390-4ab0-bc33-8636ab407cf8 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=85205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:40:07.270380 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ce0fd4-d390-4ab0-bc33-8636ab407cf8 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:40:07.272208 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ce0fd4-d390-4ab0-bc33-8636ab407cf8 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:40:07.296256 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 574/1164] 10.222.0.58 () {56 vars in 1164 bytes} [Tue Oct 12 16:40:07 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:40:07.304342 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282a1e6c-6afa-41c8-a3a1-598169fb173c admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:40:07.318368 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282a1e6c-6afa-41c8-a3a1-598169fb173c admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:40:07.324729 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785fa96c-523a-4085-8c2b-233ab29610d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:40:07.325717 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785fa96c-523a-4085-8c2b-233ab29610d8 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:07.326118 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785fa96c-523a-4085-8c2b-233ab29610d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:07.326561 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785fa96c-523a-4085-8c2b-233ab29610d8 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:07.340412 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785fa96c-523a-4085-8c2b-233ab29610d8 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:40:07.342930 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785fa96c-523a-4085-8c2b-233ab29610d8 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:40:07.367166 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: WARNING keystone.server.flask.application [None req-785fa96c-523a-4085-8c2b-233ab29610d8 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 16:40:07.368773 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 591/1165] 10.222.0.58 () {56 vars in 1129 bytes} [Tue Oct 12 16:40:07 2021] GET /identity/v3/domains/Default => generated 87 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:40:07.375345 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ce0fd4-d390-4ab0-bc33-8636ab407cf8 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:40:07.385807 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ce0fd4-d390-4ab0-bc33-8636ab407cf8 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:40:07.391393 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392c5c2e-d1b7-4641-b7cf-a36b993bd652 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:40:07.392146 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392c5c2e-d1b7-4641-b7cf-a36b993bd652 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:07.392472 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392c5c2e-d1b7-4641-b7cf-a36b993bd652 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:07.392749 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392c5c2e-d1b7-4641-b7cf-a36b993bd652 admin admin] PATH_INFO: `/v3/domains` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:07.393520 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392c5c2e-d1b7-4641-b7cf-a36b993bd652 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:40:07.393862 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392c5c2e-d1b7-4641-b7cf-a36b993bd652 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:40:07.395498 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392c5c2e-d1b7-4641-b7cf-a36b993bd652 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:40:07.407351 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 575/1166] 10.222.0.58 () {56 vars in 1130 bytes} [Tue Oct 12 16:40:07 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:40:07.414094 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785fa96c-523a-4085-8c2b-233ab29610d8 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:40:07.426261 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785fa96c-523a-4085-8c2b-233ab29610d8 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:40:07.431253 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab373a0-8aaa-4604-a7aa-2508df5454f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:40:07.432030 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab373a0-8aaa-4604-a7aa-2508df5454f0 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:07.432315 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab373a0-8aaa-4604-a7aa-2508df5454f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:07.432589 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab373a0-8aaa-4604-a7aa-2508df5454f0 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:07.440143 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab373a0-8aaa-4604-a7aa-2508df5454f0 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:40:07.442133 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab373a0-8aaa-4604-a7aa-2508df5454f0 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:40:07.456311 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: WARNING keystone.server.flask.application [None req-9ab373a0-8aaa-4604-a7aa-2508df5454f0 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 16:40:07.457748 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 592/1167] 10.222.0.58 () {56 vars in 1132 bytes} [Tue Oct 12 16:40:07 2021] GET /identity/v3/projects/service => generated 88 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:40:07.464177 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392c5c2e-d1b7-4641-b7cf-a36b993bd652 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:40:07.474596 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392c5c2e-d1b7-4641-b7cf-a36b993bd652 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:40:07.479618 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f92c8c-33cf-4e12-ade5-942442dc77d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:40:07.480333 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f92c8c-33cf-4e12-ade5-942442dc77d5 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:07.480621 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f92c8c-33cf-4e12-ade5-942442dc77d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:07.480959 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f92c8c-33cf-4e12-ade5-942442dc77d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:07.481789 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f92c8c-33cf-4e12-ade5-942442dc77d5 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=85205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:40:07.482109 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f92c8c-33cf-4e12-ade5-942442dc77d5 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:40:07.484080 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f92c8c-33cf-4e12-ade5-942442dc77d5 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:40:07.496913 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 576/1168] 10.222.0.58 () {56 vars in 1169 bytes} [Tue Oct 12 16:40:07 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:40:07.504224 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab373a0-8aaa-4604-a7aa-2508df5454f0 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:40:07.515756 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab373a0-8aaa-4604-a7aa-2508df5454f0 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:40:07.520676 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d0c922-bb79-4231-a8be-36e64dd9d371 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:40:07.521556 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d0c922-bb79-4231-a8be-36e64dd9d371 admin admin] REQUEST_METHOD: `PUT` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:07.521892 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d0c922-bb79-4231-a8be-36e64dd9d371 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:07.522178 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d0c922-bb79-4231-a8be-36e64dd9d371 admin admin] PATH_INFO: `/v3/projects/f3531f242eaa43b69562d70bca5ec5a8/users/4102412c40bc4745bba8c31f1caf9788/roles/610824e4f50f4fb8954610e98c1de784` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:07.524540 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d0c922-bb79-4231-a8be-36e64dd9d371 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3531f242eaa43b69562d70bca5ec5a8, user_id=4102412c40bc4745bba8c31f1caf9788, role_id=610824e4f50f4fb8954610e98c1de784)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:40:07.527359 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d0c922-bb79-4231-a8be-36e64dd9d371 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:40:07.547044 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 593/1169] 10.222.0.58 () {58 vars in 1460 bytes} [Tue Oct 12 16:40:07 2021] PUT /identity/v3/projects/f3531f242eaa43b69562d70bca5ec5a8/users/4102412c40bc4745bba8c31f1caf9788/roles/610824e4f50f4fb8954610e98c1de784 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:40:09.832650 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f310594d-0cc2-482e-8830-19a64d89046f None None] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:09.833085 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f310594d-0cc2-482e-8830-19a64d89046f None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:09.833197 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f310594d-0cc2-482e-8830-19a64d89046f None None] PATH_INFO: `/` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:09.835009 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 577/1170] 10.222.0.58 () {54 vars in 926 bytes} [Tue Oct 12 16:40:09 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:40:09.840858 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0db6f7c-dbd3-4391-be1d-ea6d0901a256 None None] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:09.841261 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0db6f7c-dbd3-4391-be1d-ea6d0901a256 None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:09.841402 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0db6f7c-dbd3-4391-be1d-ea6d0901a256 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:09.858071 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.auth.core [None req-d0db6f7c-dbd3-4391-be1d-ea6d0901a256 None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:40:09.859254 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-d0db6f7c-dbd3-4391-be1d-ea6d0901a256 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:40:09.913854 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 594/1171] 10.222.0.58 () {58 vars in 1023 bytes} [Tue Oct 12 16:40:09 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:40:09.938897 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f310594d-0cc2-482e-8830-19a64d89046f None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:40:09.950631 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f310594d-0cc2-482e-8830-19a64d89046f None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:40:09.954893 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c57254a-97f1-4f37-99c3-0ea9fff4c498 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:40:09.955652 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c57254a-97f1-4f37-99c3-0ea9fff4c498 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:09.955930 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c57254a-97f1-4f37-99c3-0ea9fff4c498 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:09.956200 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c57254a-97f1-4f37-99c3-0ea9fff4c498 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:09.965932 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c57254a-97f1-4f37-99c3-0ea9fff4c498 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 16:40:09.972701 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: WARNING keystone.server.flask.application [None req-4c57254a-97f1-4f37-99c3-0ea9fff4c498 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 16:40:09.973807 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 578/1172] 10.222.0.58 () {56 vars in 1117 bytes} [Tue Oct 12 16:40:09 2021] GET /identity/v3/roles/admin => generated 83 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:40:09.980420 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0db6f7c-dbd3-4391-be1d-ea6d0901a256 None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:40:09.989051 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0db6f7c-dbd3-4391-be1d-ea6d0901a256 None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:40:09.993530 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88d09f4-6daa-4a54-b58f-206ea8c81be1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:40:09.994213 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88d09f4-6daa-4a54-b58f-206ea8c81be1 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:09.994502 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88d09f4-6daa-4a54-b58f-206ea8c81be1 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:09.994777 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88d09f4-6daa-4a54-b58f-206ea8c81be1 admin admin] PATH_INFO: `/v3/roles` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:09.995535 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88d09f4-6daa-4a54-b58f-206ea8c81be1 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=85204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:40:09.996379 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88d09f4-6daa-4a54-b58f-206ea8c81be1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:40:09.998001 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88d09f4-6daa-4a54-b58f-206ea8c81be1 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:40:10.006260 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 595/1173] 10.222.0.58 () {56 vars in 1120 bytes} [Tue Oct 12 16:40:09 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:40:10.012093 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c57254a-97f1-4f37-99c3-0ea9fff4c498 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:40:10.021724 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c57254a-97f1-4f37-99c3-0ea9fff4c498 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:40:10.026129 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f7a4c6-fa80-4555-9c83-cbc4270d018a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:40:10.026907 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f7a4c6-fa80-4555-9c83-cbc4270d018a admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:10.027185 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f7a4c6-fa80-4555-9c83-cbc4270d018a admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:10.027453 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f7a4c6-fa80-4555-9c83-cbc4270d018a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:10.037083 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f7a4c6-fa80-4555-9c83-cbc4270d018a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:40:10.038909 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f7a4c6-fa80-4555-9c83-cbc4270d018a admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:40:10.055241 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: WARNING keystone.server.flask.application [None req-74f7a4c6-fa80-4555-9c83-cbc4270d018a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 16:40:10.056318 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 579/1174] 10.222.0.58 () {56 vars in 1129 bytes} [Tue Oct 12 16:40:10 2021] GET /identity/v3/domains/Default => generated 87 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:40:10.062835 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88d09f4-6daa-4a54-b58f-206ea8c81be1 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:40:10.071953 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88d09f4-6daa-4a54-b58f-206ea8c81be1 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:40:10.076596 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6335112-e4b1-4333-b79d-da50d6ef485b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:40:10.077221 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6335112-e4b1-4333-b79d-da50d6ef485b admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:10.077506 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6335112-e4b1-4333-b79d-da50d6ef485b admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:10.077785 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6335112-e4b1-4333-b79d-da50d6ef485b admin admin] PATH_INFO: `/v3/domains` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:10.078542 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6335112-e4b1-4333-b79d-da50d6ef485b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:40:10.078851 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6335112-e4b1-4333-b79d-da50d6ef485b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:40:10.080406 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6335112-e4b1-4333-b79d-da50d6ef485b admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:40:10.092680 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 596/1175] 10.222.0.58 () {56 vars in 1130 bytes} [Tue Oct 12 16:40:10 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 16:40:10.098468 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f7a4c6-fa80-4555-9c83-cbc4270d018a admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:40:10.108031 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f7a4c6-fa80-4555-9c83-cbc4270d018a admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:40:10.112441 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c8337e-824d-4331-8a37-c4474a33731a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:40:10.113172 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c8337e-824d-4331-8a37-c4474a33731a admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:10.113444 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c8337e-824d-4331-8a37-c4474a33731a admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:10.113713 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c8337e-824d-4331-8a37-c4474a33731a admin admin] PATH_INFO: `/v3/users/placement` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:10.120540 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c8337e-824d-4331-8a37-c4474a33731a admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:40:10.123128 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c8337e-824d-4331-8a37-c4474a33731a admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:40:10.136708 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: WARNING keystone.server.flask.application [None req-29c8337e-824d-4331-8a37-c4474a33731a admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 12 16:40:10.137778 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 580/1176] 10.222.0.58 () {56 vars in 1129 bytes} [Tue Oct 12 16:40:10 2021] GET /identity/v3/users/placement => generated 87 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 16:40:10.143566 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6335112-e4b1-4333-b79d-da50d6ef485b admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:40:10.152780 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6335112-e4b1-4333-b79d-da50d6ef485b admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:40:10.157297 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90244ecd-1be6-4773-8bc7-7827db7fda6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:40:10.157959 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90244ecd-1be6-4773-8bc7-7827db7fda6d admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:10.158245 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90244ecd-1be6-4773-8bc7-7827db7fda6d admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:10.158520 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90244ecd-1be6-4773-8bc7-7827db7fda6d admin admin] PATH_INFO: `/v3/users` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:10.159346 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90244ecd-1be6-4773-8bc7-7827db7fda6d admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=85204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:40:10.159653 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90244ecd-1be6-4773-8bc7-7827db7fda6d admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:40:10.161408 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90244ecd-1be6-4773-8bc7-7827db7fda6d admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:40:10.178383 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 597/1177] 10.222.0.58 () {56 vars in 1164 bytes} [Tue Oct 12 16:40:10 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:40:10.184604 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c8337e-824d-4331-8a37-c4474a33731a admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:40:10.193706 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c8337e-824d-4331-8a37-c4474a33731a admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:40:10.198173 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e553f1fe-15b2-4a26-9b12-7ad49decd176 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:40:10.198776 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e553f1fe-15b2-4a26-9b12-7ad49decd176 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:10.199053 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e553f1fe-15b2-4a26-9b12-7ad49decd176 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:10.199321 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e553f1fe-15b2-4a26-9b12-7ad49decd176 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:10.206720 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e553f1fe-15b2-4a26-9b12-7ad49decd176 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:40:10.208385 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e553f1fe-15b2-4a26-9b12-7ad49decd176 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:40:10.216824 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 581/1178] 10.222.0.58 () {58 vars in 1324 bytes} [Tue Oct 12 16:40:10 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:40:10.222651 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90244ecd-1be6-4773-8bc7-7827db7fda6d admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:40:10.232197 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90244ecd-1be6-4773-8bc7-7827db7fda6d admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:40:10.236681 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49a1064-0dd9-4858-a236-40e803ae34b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:40:10.237428 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49a1064-0dd9-4858-a236-40e803ae34b8 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:10.237712 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49a1064-0dd9-4858-a236-40e803ae34b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:10.238033 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49a1064-0dd9-4858-a236-40e803ae34b8 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:10.248510 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49a1064-0dd9-4858-a236-40e803ae34b8 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:40:10.250341 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49a1064-0dd9-4858-a236-40e803ae34b8 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:40:10.266701 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: WARNING keystone.server.flask.application [None req-f49a1064-0dd9-4858-a236-40e803ae34b8 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 16:40:10.267788 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 598/1179] 10.222.0.58 () {56 vars in 1129 bytes} [Tue Oct 12 16:40:10 2021] GET /identity/v3/domains/Default => generated 87 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 16:40:10.273401 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e553f1fe-15b2-4a26-9b12-7ad49decd176 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:40:10.283558 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e553f1fe-15b2-4a26-9b12-7ad49decd176 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:40:10.288914 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cef0a04-0bbc-4ec1-96c5-b1257f58ecc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:40:10.289710 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cef0a04-0bbc-4ec1-96c5-b1257f58ecc8 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:10.289989 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cef0a04-0bbc-4ec1-96c5-b1257f58ecc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:10.290323 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cef0a04-0bbc-4ec1-96c5-b1257f58ecc8 admin admin] PATH_INFO: `/v3/domains` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:10.291119 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cef0a04-0bbc-4ec1-96c5-b1257f58ecc8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:40:10.291449 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cef0a04-0bbc-4ec1-96c5-b1257f58ecc8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:40:10.293866 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cef0a04-0bbc-4ec1-96c5-b1257f58ecc8 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:40:10.307245 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 582/1180] 10.222.0.58 () {56 vars in 1130 bytes} [Tue Oct 12 16:40:10 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:40:10.313690 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49a1064-0dd9-4858-a236-40e803ae34b8 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:40:10.325287 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49a1064-0dd9-4858-a236-40e803ae34b8 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:40:10.330789 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8379fc-df30-4929-ba93-449bc96f9f8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:40:10.331645 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8379fc-df30-4929-ba93-449bc96f9f8f admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:10.332009 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8379fc-df30-4929-ba93-449bc96f9f8f admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:10.332287 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8379fc-df30-4929-ba93-449bc96f9f8f admin admin] PATH_INFO: `/v3/projects/service` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:10.340455 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8379fc-df30-4929-ba93-449bc96f9f8f admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:40:10.343077 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8379fc-df30-4929-ba93-449bc96f9f8f admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:40:10.357821 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: WARNING keystone.server.flask.application [None req-7e8379fc-df30-4929-ba93-449bc96f9f8f admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 16:40:10.358995 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 599/1181] 10.222.0.58 () {56 vars in 1132 bytes} [Tue Oct 12 16:40:10 2021] GET /identity/v3/projects/service => generated 88 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 16:40:10.365352 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cef0a04-0bbc-4ec1-96c5-b1257f58ecc8 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:40:10.374773 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cef0a04-0bbc-4ec1-96c5-b1257f58ecc8 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:40:10.379485 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d56912-8d08-4553-bfa7-fd1638dc1202 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:40:10.380111 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d56912-8d08-4553-bfa7-fd1638dc1202 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:10.380389 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d56912-8d08-4553-bfa7-fd1638dc1202 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:10.380664 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d56912-8d08-4553-bfa7-fd1638dc1202 admin admin] PATH_INFO: `/v3/projects` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:10.381453 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d56912-8d08-4553-bfa7-fd1638dc1202 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=85205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:40:10.381758 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d56912-8d08-4553-bfa7-fd1638dc1202 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:40:10.383580 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d56912-8d08-4553-bfa7-fd1638dc1202 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:40:10.395168 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 583/1182] 10.222.0.58 () {56 vars in 1169 bytes} [Tue Oct 12 16:40:10 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 16:40:10.401195 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8379fc-df30-4929-ba93-449bc96f9f8f admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:40:10.411928 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8379fc-df30-4929-ba93-449bc96f9f8f admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:40:10.416502 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97127ab-69ab-4745-ad77-71aba12c75b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:40:10.417124 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97127ab-69ab-4745-ad77-71aba12c75b8 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:10.417433 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97127ab-69ab-4745-ad77-71aba12c75b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:10.418367 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97127ab-69ab-4745-ad77-71aba12c75b8 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:10.419199 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97127ab-69ab-4745-ad77-71aba12c75b8 admin admin] RBAC: Adding query filter params (role.id=610824e4f50f4fb8954610e98c1de784, scope.project.id=f3531f242eaa43b69562d70bca5ec5a8, user.id=4102412c40bc4745bba8c31f1caf9788) {{(pid=85204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:40:10.419512 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97127ab-69ab-4745-ad77-71aba12c75b8 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:40:10.421313 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97127ab-69ab-4745-ad77-71aba12c75b8 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:40:10.426913 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 600/1183] 10.222.0.58 () {56 vars in 1395 bytes} [Tue Oct 12 16:40:10 2021] GET /identity/v3/role_assignments?user.id=4102412c40bc4745bba8c31f1caf9788&scope.project.id=f3531f242eaa43b69562d70bca5ec5a8&role.id=610824e4f50f4fb8954610e98c1de784 => generated 608 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 16:40:12.702190 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839d70c4-5337-4bc2-8190-365536a0cbbd None None] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:12.702753 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839d70c4-5337-4bc2-8190-365536a0cbbd None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:12.702753 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839d70c4-5337-4bc2-8190-365536a0cbbd None None] PATH_INFO: `/` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:12.704508 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 584/1184] 10.222.0.58 () {54 vars in 926 bytes} [Tue Oct 12 16:40:12 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:40:12.710393 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fa88d0-ca6b-4e81-bd21-ed25eb4f1161 None None] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:12.710822 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fa88d0-ca6b-4e81-bd21-ed25eb4f1161 None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:12.710938 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fa88d0-ca6b-4e81-bd21-ed25eb4f1161 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:12.727698 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.auth.core [None req-58fa88d0-ca6b-4e81-bd21-ed25eb4f1161 None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:40:12.728881 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-58fa88d0-ca6b-4e81-bd21-ed25eb4f1161 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:40:12.736347 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 601/1185] 10.222.0.58 () {58 vars in 1023 bytes} [Tue Oct 12 16:40:12 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:40:12.759752 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839d70c4-5337-4bc2-8190-365536a0cbbd None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:40:12.772197 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839d70c4-5337-4bc2-8190-365536a0cbbd None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:40:12.776489 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5615581-b7c4-4551-acca-73f376da9c9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:40:12.777258 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5615581-b7c4-4551-acca-73f376da9c9e admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:12.777537 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5615581-b7c4-4551-acca-73f376da9c9e admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:12.777806 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5615581-b7c4-4551-acca-73f376da9c9e admin admin] PATH_INFO: `/v3/services/placement` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:12.778491 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5615581-b7c4-4551-acca-73f376da9c9e admin admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:40:12.780050 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5615581-b7c4-4551-acca-73f376da9c9e admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:40:12.790750 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: WARNING keystone.server.flask.application [None req-b5615581-b7c4-4551-acca-73f376da9c9e admin admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 12 16:40:12.791842 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 585/1186] 10.222.0.58 () {56 vars in 1138 bytes} [Tue Oct 12 16:40:12 2021] GET /identity/v3/services/placement => generated 90 bytes in 33 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 16:40:12.798028 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fa88d0-ca6b-4e81-bd21-ed25eb4f1161 None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:40:12.806749 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fa88d0-ca6b-4e81-bd21-ed25eb4f1161 None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:40:12.811802 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3010b377-a702-496e-92b9-186a4903d3f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:40:12.812446 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3010b377-a702-496e-92b9-186a4903d3f9 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:12.812727 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3010b377-a702-496e-92b9-186a4903d3f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:12.813003 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3010b377-a702-496e-92b9-186a4903d3f9 admin admin] PATH_INFO: `/v3/services` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:12.813716 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3010b377-a702-496e-92b9-186a4903d3f9 admin admin] RBAC: Adding query filter params (name=placement) {{(pid=85204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:40:12.814056 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3010b377-a702-496e-92b9-186a4903d3f9 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:40:12.815617 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3010b377-a702-496e-92b9-186a4903d3f9 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:40:12.820377 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 602/1187] 10.222.0.58 () {56 vars in 1137 bytes} [Tue Oct 12 16:40:12 2021] GET /identity/v3/services?name=placement => generated 126 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:40:12.827154 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5615581-b7c4-4551-acca-73f376da9c9e admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:40:12.836465 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5615581-b7c4-4551-acca-73f376da9c9e admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:40:12.840963 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558d2d32-a9af-403e-876a-0a1084b33e2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:40:12.841587 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558d2d32-a9af-403e-876a-0a1084b33e2b admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:12.841868 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558d2d32-a9af-403e-876a-0a1084b33e2b admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:12.842182 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558d2d32-a9af-403e-876a-0a1084b33e2b admin admin] PATH_INFO: `/v3/services` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:12.842890 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558d2d32-a9af-403e-876a-0a1084b33e2b admin admin] RBAC: Adding query filter params (type=placement) {{(pid=85205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:40:12.843198 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558d2d32-a9af-403e-876a-0a1084b33e2b admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:40:12.844741 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558d2d32-a9af-403e-876a-0a1084b33e2b admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:40:12.849070 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 586/1188] 10.222.0.58 () {56 vars in 1137 bytes} [Tue Oct 12 16:40:12 2021] GET /identity/v3/services?type=placement => generated 126 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:40:15.098889 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b174c1-5c70-40b8-919d-52fc05dd726d None None] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:15.099386 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b174c1-5c70-40b8-919d-52fc05dd726d None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:15.099386 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b174c1-5c70-40b8-919d-52fc05dd726d None None] PATH_INFO: `/` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:15.101140 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 603/1189] 10.222.0.58 () {54 vars in 926 bytes} [Tue Oct 12 16:40:15 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:40:15.107519 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6354ba6f-dcce-4e96-960e-032f98450d60 None None] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:15.107893 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6354ba6f-dcce-4e96-960e-032f98450d60 None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:15.108105 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6354ba6f-dcce-4e96-960e-032f98450d60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:15.126456 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.auth.core [None req-6354ba6f-dcce-4e96-960e-032f98450d60 None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:40:15.127639 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-6354ba6f-dcce-4e96-960e-032f98450d60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:40:15.135220 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 587/1190] 10.222.0.58 () {58 vars in 1023 bytes} [Tue Oct 12 16:40:15 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:40:15.159204 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b174c1-5c70-40b8-919d-52fc05dd726d None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:40:15.171743 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b174c1-5c70-40b8-919d-52fc05dd726d None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:40:15.176121 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e94560-0618-4497-9975-50dfd4bd836f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:40:15.176761 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e94560-0618-4497-9975-50dfd4bd836f admin admin] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:15.177045 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e94560-0618-4497-9975-50dfd4bd836f admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:15.177321 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e94560-0618-4497-9975-50dfd4bd836f admin admin] PATH_INFO: `/v3/services` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:15.178091 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e94560-0618-4497-9975-50dfd4bd836f admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:40:15.179680 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e94560-0618-4497-9975-50dfd4bd836f admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:40:15.195848 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 604/1191] 10.222.0.58 () {60 vars in 1162 bytes} [Tue Oct 12 16:40:15 2021] POST /identity/v3/services => generated 246 bytes in 37 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:40:17.439609 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a99413-c863-4abb-b8a7-1d82f30e483a None None] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:17.440143 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a99413-c863-4abb-b8a7-1d82f30e483a None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:17.440143 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a99413-c863-4abb-b8a7-1d82f30e483a None None] PATH_INFO: `/` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:17.441926 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 588/1192] 10.222.0.58 () {54 vars in 926 bytes} [Tue Oct 12 16:40:17 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:40:17.447940 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67f80a3-9d96-41bf-9966-55690037bffd None None] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:17.448344 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67f80a3-9d96-41bf-9966-55690037bffd None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:17.448481 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67f80a3-9d96-41bf-9966-55690037bffd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:17.465479 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.auth.core [None req-a67f80a3-9d96-41bf-9966-55690037bffd None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:40:17.466671 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-a67f80a3-9d96-41bf-9966-55690037bffd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:40:17.483088 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 605/1193] 10.222.0.58 () {58 vars in 1023 bytes} [Tue Oct 12 16:40:17 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:40:17.506601 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a99413-c863-4abb-b8a7-1d82f30e483a None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:40:17.518416 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a99413-c863-4abb-b8a7-1d82f30e483a None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:40:17.522946 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2c6ba3-1c22-47fb-88c9-066912b1ea02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:40:17.523712 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2c6ba3-1c22-47fb-88c9-066912b1ea02 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:17.523989 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2c6ba3-1c22-47fb-88c9-066912b1ea02 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:17.524257 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2c6ba3-1c22-47fb-88c9-066912b1ea02 admin admin] PATH_INFO: `/v3/services/placement` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:17.524913 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2c6ba3-1c22-47fb-88c9-066912b1ea02 admin admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:40:17.526500 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2c6ba3-1c22-47fb-88c9-066912b1ea02 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:40:17.538193 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: WARNING keystone.server.flask.application [None req-1d2c6ba3-1c22-47fb-88c9-066912b1ea02 admin admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 12 16:40:17.541012 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 589/1194] 10.222.0.58 () {56 vars in 1138 bytes} [Tue Oct 12 16:40:17 2021] GET /identity/v3/services/placement => generated 90 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:40:17.550253 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67f80a3-9d96-41bf-9966-55690037bffd None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:40:17.561532 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67f80a3-9d96-41bf-9966-55690037bffd None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:40:17.566083 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0279c001-e26e-4e97-8849-d810f8f0dfa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:40:17.566727 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0279c001-e26e-4e97-8849-d810f8f0dfa6 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:17.567013 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0279c001-e26e-4e97-8849-d810f8f0dfa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:17.567286 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0279c001-e26e-4e97-8849-d810f8f0dfa6 admin admin] PATH_INFO: `/v3/services` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:17.567997 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0279c001-e26e-4e97-8849-d810f8f0dfa6 admin admin] RBAC: Adding query filter params (name=placement) {{(pid=85204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:40:17.568300 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0279c001-e26e-4e97-8849-d810f8f0dfa6 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:40:17.569984 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0279c001-e26e-4e97-8849-d810f8f0dfa6 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:40:17.574873 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 606/1195] 10.222.0.58 () {56 vars in 1137 bytes} [Tue Oct 12 16:40:17 2021] GET /identity/v3/services?name=placement => generated 358 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:40:17.581221 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2c6ba3-1c22-47fb-88c9-066912b1ea02 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:40:17.590660 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2c6ba3-1c22-47fb-88c9-066912b1ea02 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:40:17.595104 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53cb8a3-386c-412d-a49f-f7706e7f23df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:40:17.595728 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53cb8a3-386c-412d-a49f-f7706e7f23df admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:17.596005 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53cb8a3-386c-412d-a49f-f7706e7f23df admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:17.596275 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53cb8a3-386c-412d-a49f-f7706e7f23df admin admin] PATH_INFO: `/v3/endpoints` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:17.597061 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53cb8a3-386c-412d-a49f-f7706e7f23df admin admin] RBAC: Adding query filter params (interface=public, service_id=79dba41b6ccb4a83a7d964c4e0923570, region_id=RegionOne) {{(pid=85205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:40:17.597371 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53cb8a3-386c-412d-a49f-f7706e7f23df admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:40:17.598946 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53cb8a3-386c-412d-a49f-f7706e7f23df admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:40:17.603597 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 590/1196] 10.222.0.58 () {56 vars in 1272 bytes} [Tue Oct 12 16:40:17 2021] GET /identity/v3/endpoints?service_id=79dba41b6ccb4a83a7d964c4e0923570&interface=public®ion_id=RegionOne => generated 194 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:40:17.609732 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0279c001-e26e-4e97-8849-d810f8f0dfa6 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:40:17.619773 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0279c001-e26e-4e97-8849-d810f8f0dfa6 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:40:17.624878 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78c0c2a-97da-4ee7-b9be-9fed6d70d984 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:40:17.625496 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78c0c2a-97da-4ee7-b9be-9fed6d70d984 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:17.625772 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78c0c2a-97da-4ee7-b9be-9fed6d70d984 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:17.626072 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78c0c2a-97da-4ee7-b9be-9fed6d70d984 admin admin] PATH_INFO: `/v3/services` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:17.627001 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78c0c2a-97da-4ee7-b9be-9fed6d70d984 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:40:17.628523 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78c0c2a-97da-4ee7-b9be-9fed6d70d984 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:40:17.634993 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 607/1197] 10.222.0.58 () {56 vars in 1108 bytes} [Tue Oct 12 16:40:17 2021] GET /identity/v3/services => generated 2191 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:40:19.887677 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acb2499-f60a-4a52-abfa-912740ff555b None None] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:19.888203 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acb2499-f60a-4a52-abfa-912740ff555b None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:19.888203 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acb2499-f60a-4a52-abfa-912740ff555b None None] PATH_INFO: `/` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:19.890007 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 591/1198] 10.222.0.58 () {54 vars in 926 bytes} [Tue Oct 12 16:40:19 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:40:19.895982 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0352307-9343-4c73-beea-f4913f62efb5 None None] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:19.896402 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0352307-9343-4c73-beea-f4913f62efb5 None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:19.896538 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0352307-9343-4c73-beea-f4913f62efb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:19.914227 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.auth.core [None req-e0352307-9343-4c73-beea-f4913f62efb5 None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:40:19.915407 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-e0352307-9343-4c73-beea-f4913f62efb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:40:19.923021 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 608/1199] 10.222.0.58 () {58 vars in 1023 bytes} [Tue Oct 12 16:40:19 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:40:19.946628 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acb2499-f60a-4a52-abfa-912740ff555b None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:40:19.959002 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acb2499-f60a-4a52-abfa-912740ff555b None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:40:19.963365 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0888a9-079b-40c4-912c-b1ac48fdc403 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:40:19.964131 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0888a9-079b-40c4-912c-b1ac48fdc403 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:19.964416 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0888a9-079b-40c4-912c-b1ac48fdc403 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:19.964749 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0888a9-079b-40c4-912c-b1ac48fdc403 admin admin] PATH_INFO: `/v3/services/placement` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:19.965924 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0888a9-079b-40c4-912c-b1ac48fdc403 admin admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:40:19.967479 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0888a9-079b-40c4-912c-b1ac48fdc403 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:40:19.978167 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: WARNING keystone.server.flask.application [None req-bd0888a9-079b-40c4-912c-b1ac48fdc403 admin admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 12 16:40:19.979254 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 592/1200] 10.222.0.58 () {56 vars in 1138 bytes} [Tue Oct 12 16:40:19 2021] GET /identity/v3/services/placement => generated 90 bytes in 33 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:40:19.985363 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0352307-9343-4c73-beea-f4913f62efb5 None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:40:19.993948 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0352307-9343-4c73-beea-f4913f62efb5 None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:40:19.998409 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6581b3b7-6229-4071-822f-09b0294b30ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:40:19.999040 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6581b3b7-6229-4071-822f-09b0294b30ef admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:19.999320 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6581b3b7-6229-4071-822f-09b0294b30ef admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:19.999593 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6581b3b7-6229-4071-822f-09b0294b30ef admin admin] PATH_INFO: `/v3/services` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:20.000304 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6581b3b7-6229-4071-822f-09b0294b30ef admin admin] RBAC: Adding query filter params (name=placement) {{(pid=85204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:40:20.000612 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6581b3b7-6229-4071-822f-09b0294b30ef admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:40:20.002469 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6581b3b7-6229-4071-822f-09b0294b30ef admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:40:20.007359 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 609/1201] 10.222.0.58 () {56 vars in 1137 bytes} [Tue Oct 12 16:40:19 2021] GET /identity/v3/services?name=placement => generated 358 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:40:20.013604 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0888a9-079b-40c4-912c-b1ac48fdc403 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:40:20.022600 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0888a9-079b-40c4-912c-b1ac48fdc403 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:40:20.027042 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a15a178-caa0-49c1-bfd4-6896515af533 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:40:20.028351 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a15a178-caa0-49c1-bfd4-6896515af533 admin admin] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:20.028635 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a15a178-caa0-49c1-bfd4-6896515af533 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:20.028906 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a15a178-caa0-49c1-bfd4-6896515af533 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:20.029637 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a15a178-caa0-49c1-bfd4-6896515af533 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:40:20.031167 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a15a178-caa0-49c1-bfd4-6896515af533 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:40:20.049522 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 593/1202] 10.222.0.58 () {60 vars in 1165 bytes} [Tue Oct 12 16:40:20 2021] POST /identity/v3/endpoints => generated 331 bytes in 36 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:41:23.082653 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c439dabd-2589-4d5f-a780-36ad4e49126a None None] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:23.083246 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c439dabd-2589-4d5f-a780-36ad4e49126a None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:23.083246 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c439dabd-2589-4d5f-a780-36ad4e49126a None None] PATH_INFO: `/` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:23.084955 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 610/1203] 10.222.0.58 () {54 vars in 926 bytes} [Tue Oct 12 16:41:23 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:41:23.090942 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94c0688-9a3c-4caf-a147-2e03d3b1233f None None] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:23.091856 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94c0688-9a3c-4caf-a147-2e03d3b1233f None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:23.092338 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94c0688-9a3c-4caf-a147-2e03d3b1233f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:23.198144 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.auth.core [None req-c94c0688-9a3c-4caf-a147-2e03d3b1233f None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:41:23.199808 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-c94c0688-9a3c-4caf-a147-2e03d3b1233f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:41:23.319782 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 594/1204] 10.222.0.58 () {58 vars in 1023 bytes} [Tue Oct 12 16:41:23 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:41:23.343698 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c439dabd-2589-4d5f-a780-36ad4e49126a None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:23.345644 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-c439dabd-2589-4d5f-a780-36ad4e49126a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:41:23.482157 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c439dabd-2589-4d5f-a780-36ad4e49126a None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:23.579163 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3746a70e-da7d-45b4-a0bc-da65839caa0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:23.580062 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3746a70e-da7d-45b4-a0bc-da65839caa0f admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:23.580529 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3746a70e-da7d-45b4-a0bc-da65839caa0f admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:23.580990 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3746a70e-da7d-45b4-a0bc-da65839caa0f admin admin] PATH_INFO: `/v3/projects` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:23.581930 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3746a70e-da7d-45b4-a0bc-da65839caa0f admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:23.584086 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3746a70e-da7d-45b4-a0bc-da65839caa0f admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:23.604647 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 611/1205] 10.222.0.58 () {56 vars in 1108 bytes} [Tue Oct 12 16:41:23 2021] GET /identity/v3/projects => generated 2553 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:41:25.977700 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254992e4-a21e-4d5e-82bb-3dd57c63c4cd None None] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:25.978254 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254992e4-a21e-4d5e-82bb-3dd57c63c4cd None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:25.978373 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254992e4-a21e-4d5e-82bb-3dd57c63c4cd None None] PATH_INFO: `/` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:25.980047 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 595/1206] 10.222.0.58 () {54 vars in 926 bytes} [Tue Oct 12 16:41:25 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:41:25.986417 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79476da9-954a-4b03-8d73-8e8abdf5981c None None] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:25.986811 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79476da9-954a-4b03-8d73-8e8abdf5981c None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:25.986979 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79476da9-954a-4b03-8d73-8e8abdf5981c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:26.055361 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.auth.core [None req-79476da9-954a-4b03-8d73-8e8abdf5981c None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:41:26.056563 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-79476da9-954a-4b03-8d73-8e8abdf5981c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:41:26.150377 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 612/1207] 10.222.0.58 () {58 vars in 1023 bytes} [Tue Oct 12 16:41:25 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:41:26.201602 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468b0f8f-a642-45d3-92f5-e346d99d47f9 None None] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:26.201913 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468b0f8f-a642-45d3-92f5-e346d99d47f9 None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:26.202202 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468b0f8f-a642-45d3-92f5-e346d99d47f9 None None] PATH_INFO: `/` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:26.204561 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 596/1208] 10.222.0.58 () {54 vars in 963 bytes} [Tue Oct 12 16:41:26 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:41:26.210622 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1533d6ef-5bfc-4c8a-8cd5-eec60e1fc034 None None] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:26.210912 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1533d6ef-5bfc-4c8a-8cd5-eec60e1fc034 None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:26.211186 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1533d6ef-5bfc-4c8a-8cd5-eec60e1fc034 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:26.282905 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.auth.core [None req-1533d6ef-5bfc-4c8a-8cd5-eec60e1fc034 None None] MFA Rules not processed for user `6e65f6d0598e4c539134292b86fb43d2`. Rule list: `[]` (Enabled: `True`). {{(pid=85204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:41:26.284090 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-1533d6ef-5bfc-4c8a-8cd5-eec60e1fc034 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:41:26.355681 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 613/1209] 10.222.0.58 () {58 vars in 1060 bytes} [Tue Oct 12 16:41:26 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:41:26.364935 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468b0f8f-a642-45d3-92f5-e346d99d47f9 None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:26.366509 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-468b0f8f-a642-45d3-92f5-e346d99d47f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:41:26.464335 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468b0f8f-a642-45d3-92f5-e346d99d47f9 None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:26.532750 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6a72ed-0e6f-476d-9efb-411956b2100d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e65f6d0598e4c539134292b86fb43d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:26.533384 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6a72ed-0e6f-476d-9efb-411956b2100d service neutron] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:26.533671 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6a72ed-0e6f-476d-9efb-411956b2100d service neutron] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:26.533983 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6a72ed-0e6f-476d-9efb-411956b2100d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:26.535586 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-5d6a72ed-0e6f-476d-9efb-411956b2100d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:41:26.643054 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6a72ed-0e6f-476d-9efb-411956b2100d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:26.644481 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6a72ed-0e6f-476d-9efb-411956b2100d service neutron] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:26.662500 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 597/1210] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Oct 12 16:41:26 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 12 16:41:29.146184 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d1d01e-7677-43c7-819d-ca4515054590 None None] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:29.146688 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d1d01e-7677-43c7-819d-ca4515054590 None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:29.146688 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d1d01e-7677-43c7-819d-ca4515054590 None None] PATH_INFO: `/` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:29.148464 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 614/1211] 10.222.0.58 () {54 vars in 926 bytes} [Tue Oct 12 16:41:29 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:41:29.154314 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09da198e-077f-484e-8700-a945a6d7c664 None None] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:29.154713 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09da198e-077f-484e-8700-a945a6d7c664 None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:29.154862 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09da198e-077f-484e-8700-a945a6d7c664 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:29.215226 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.auth.core [None req-09da198e-077f-484e-8700-a945a6d7c664 None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:41:29.216425 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-09da198e-077f-484e-8700-a945a6d7c664 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:41:29.309761 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 598/1212] 10.222.0.58 () {58 vars in 1023 bytes} [Tue Oct 12 16:41:29 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:41:29.349269 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d1d01e-7677-43c7-819d-ca4515054590 None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:29.350825 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-e6d1d01e-7677-43c7-819d-ca4515054590 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:41:29.448739 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d1d01e-7677-43c7-819d-ca4515054590 None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:29.517588 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f216bd65-3a1f-4988-bd73-32e73bf64448 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e65f6d0598e4c539134292b86fb43d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:29.518572 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f216bd65-3a1f-4988-bd73-32e73bf64448 service neutron] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:29.518860 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f216bd65-3a1f-4988-bd73-32e73bf64448 service neutron] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:29.519127 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f216bd65-3a1f-4988-bd73-32e73bf64448 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:29.520722 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-f216bd65-3a1f-4988-bd73-32e73bf64448 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:41:29.622088 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f216bd65-3a1f-4988-bd73-32e73bf64448 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:29.623493 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f216bd65-3a1f-4988-bd73-32e73bf64448 service neutron] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:29.641500 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 615/1213] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Oct 12 16:41:29 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:41:32.188838 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e6d1c4-f7a8-4891-a66b-832d8124a191 None None] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:32.189358 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e6d1c4-f7a8-4891-a66b-832d8124a191 None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:32.189453 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e6d1c4-f7a8-4891-a66b-832d8124a191 None None] PATH_INFO: `/` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:32.191212 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 599/1214] 10.222.0.58 () {54 vars in 926 bytes} [Tue Oct 12 16:41:32 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:41:32.196942 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc7849c-1fb1-4c31-bff8-5cabdbb34b1a None None] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:32.197321 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc7849c-1fb1-4c31-bff8-5cabdbb34b1a None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:32.197487 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc7849c-1fb1-4c31-bff8-5cabdbb34b1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:32.265303 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.auth.core [None req-edc7849c-1fb1-4c31-bff8-5cabdbb34b1a None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:41:32.266560 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-edc7849c-1fb1-4c31-bff8-5cabdbb34b1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:41:32.357741 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 616/1215] 10.222.0.58 () {58 vars in 1023 bytes} [Tue Oct 12 16:41:32 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:41:32.394027 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e6d1c4-f7a8-4891-a66b-832d8124a191 None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:32.395541 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-13e6d1c4-f7a8-4891-a66b-832d8124a191 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:41:32.512684 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e6d1c4-f7a8-4891-a66b-832d8124a191 None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:32.599891 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438a41f9-3bcc-4e6d-a61d-89a153f4d349 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:32.600736 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438a41f9-3bcc-4e6d-a61d-89a153f4d349 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:32.601022 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438a41f9-3bcc-4e6d-a61d-89a153f4d349 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:32.601297 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438a41f9-3bcc-4e6d-a61d-89a153f4d349 admin admin] PATH_INFO: `/v3/projects/78966be562ca4918a5e25eac86ccd8ab` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:32.610637 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438a41f9-3bcc-4e6d-a61d-89a153f4d349 admin admin] RBAC: Authorizing `identity:get_project(project_id=78966be562ca4918a5e25eac86ccd8ab)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:32.612691 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438a41f9-3bcc-4e6d-a61d-89a153f4d349 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:32.614394 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 600/1216] 10.222.0.58 () {56 vars in 1207 bytes} [Tue Oct 12 16:41:32 2021] GET /identity/v3/projects/78966be562ca4918a5e25eac86ccd8ab => generated 298 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:41:32.643407 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d59830a-a5d6-4514-a2ad-947a2e2c0ebe None None] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:32.643693 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d59830a-a5d6-4514-a2ad-947a2e2c0ebe None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:32.643968 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d59830a-a5d6-4514-a2ad-947a2e2c0ebe None None] PATH_INFO: `/` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:32.645777 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 617/1217] 10.222.0.58 () {54 vars in 963 bytes} [Tue Oct 12 16:41:32 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:41:32.651818 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37640432-1805-4019-b590-70e594db9e55 None None] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:32.652107 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37640432-1805-4019-b590-70e594db9e55 None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:32.652388 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37640432-1805-4019-b590-70e594db9e55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:32.724897 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.auth.core [None req-37640432-1805-4019-b590-70e594db9e55 None None] MFA Rules not processed for user `6e65f6d0598e4c539134292b86fb43d2`. Rule list: `[]` (Enabled: `True`). {{(pid=85205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:41:32.726137 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-37640432-1805-4019-b590-70e594db9e55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:41:32.797199 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 601/1218] 10.222.0.58 () {58 vars in 1060 bytes} [Tue Oct 12 16:41:32 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:41:32.806520 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d59830a-a5d6-4514-a2ad-947a2e2c0ebe None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:32.808036 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-6d59830a-a5d6-4514-a2ad-947a2e2c0ebe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:41:32.905928 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d59830a-a5d6-4514-a2ad-947a2e2c0ebe None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:32.973821 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e9924b-1b7f-4d10-9dcd-8428c5221048 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e65f6d0598e4c539134292b86fb43d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:32.974481 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e9924b-1b7f-4d10-9dcd-8428c5221048 service neutron] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:32.974762 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e9924b-1b7f-4d10-9dcd-8428c5221048 service neutron] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:32.975036 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e9924b-1b7f-4d10-9dcd-8428c5221048 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:32.976641 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-38e9924b-1b7f-4d10-9dcd-8428c5221048 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:41:33.079692 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e9924b-1b7f-4d10-9dcd-8428c5221048 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:33.081039 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e9924b-1b7f-4d10-9dcd-8428c5221048 service neutron] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:33.098089 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 618/1219] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Oct 12 16:41:32 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:41:36.298804 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5751071-2dc5-4e20-bf41-681bb674c20b None None] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:36.299394 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5751071-2dc5-4e20-bf41-681bb674c20b None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:36.299583 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5751071-2dc5-4e20-bf41-681bb674c20b None None] PATH_INFO: `/` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:36.301621 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 602/1220] 10.222.0.58 () {54 vars in 926 bytes} [Tue Oct 12 16:41:36 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 12 16:41:36.307573 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0000c66b-b9db-482c-a566-23118aa52ce1 None None] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:36.307975 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0000c66b-b9db-482c-a566-23118aa52ce1 None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:36.308121 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0000c66b-b9db-482c-a566-23118aa52ce1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:36.380172 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.auth.core [None req-0000c66b-b9db-482c-a566-23118aa52ce1 None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:41:36.381365 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-0000c66b-b9db-482c-a566-23118aa52ce1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:41:36.473251 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 619/1221] 10.222.0.58 () {58 vars in 1023 bytes} [Tue Oct 12 16:41:36 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:41:36.508610 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5751071-2dc5-4e20-bf41-681bb674c20b None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:36.510158 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-b5751071-2dc5-4e20-bf41-681bb674c20b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:41:36.628049 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5751071-2dc5-4e20-bf41-681bb674c20b None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:36.714093 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a369235c-fc48-4d0f-8b2c-0e7905b507d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:36.714935 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a369235c-fc48-4d0f-8b2c-0e7905b507d0 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:36.715214 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a369235c-fc48-4d0f-8b2c-0e7905b507d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:36.715486 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a369235c-fc48-4d0f-8b2c-0e7905b507d0 admin admin] PATH_INFO: `/v3/projects/78966be562ca4918a5e25eac86ccd8ab` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:36.725269 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a369235c-fc48-4d0f-8b2c-0e7905b507d0 admin admin] RBAC: Authorizing `identity:get_project(project_id=78966be562ca4918a5e25eac86ccd8ab)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:36.727326 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a369235c-fc48-4d0f-8b2c-0e7905b507d0 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:36.728995 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 603/1222] 10.222.0.58 () {56 vars in 1207 bytes} [Tue Oct 12 16:41:36 2021] GET /identity/v3/projects/78966be562ca4918a5e25eac86ccd8ab => generated 298 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:41:36.742121 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0000c66b-b9db-482c-a566-23118aa52ce1 None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:36.743330 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-0000c66b-b9db-482c-a566-23118aa52ce1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:41:36.829208 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0000c66b-b9db-482c-a566-23118aa52ce1 None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:36.897251 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47a4980-f0f4-4009-aac8-0887fe99b7a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e65f6d0598e4c539134292b86fb43d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:36.897824 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47a4980-f0f4-4009-aac8-0887fe99b7a4 service neutron] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:36.898132 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47a4980-f0f4-4009-aac8-0887fe99b7a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:36.898404 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47a4980-f0f4-4009-aac8-0887fe99b7a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:36.899993 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-e47a4980-f0f4-4009-aac8-0887fe99b7a4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:41:37.001826 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47a4980-f0f4-4009-aac8-0887fe99b7a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:37.003261 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47a4980-f0f4-4009-aac8-0887fe99b7a4 service neutron] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:37.020509 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 620/1223] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Oct 12 16:41:36 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:41:40.005406 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5287291-dc0b-40c5-861c-916b8aaafe49 None None] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:40.006002 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5287291-dc0b-40c5-861c-916b8aaafe49 None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:40.006002 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5287291-dc0b-40c5-861c-916b8aaafe49 None None] PATH_INFO: `/` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:40.007760 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 604/1224] 10.222.0.58 () {54 vars in 926 bytes} [Tue Oct 12 16:41:40 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:41:40.014422 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc2dcd7-33f5-4c83-88d9-822225d66c19 None None] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:40.014958 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc2dcd7-33f5-4c83-88d9-822225d66c19 None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:40.014958 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc2dcd7-33f5-4c83-88d9-822225d66c19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:40.081310 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.auth.core [None req-bcc2dcd7-33f5-4c83-88d9-822225d66c19 None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:41:40.082548 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-bcc2dcd7-33f5-4c83-88d9-822225d66c19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:41:40.179850 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 621/1225] 10.222.0.58 () {58 vars in 1023 bytes} [Tue Oct 12 16:41:40 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:41:40.216507 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5287291-dc0b-40c5-861c-916b8aaafe49 None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:40.218050 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-a5287291-dc0b-40c5-861c-916b8aaafe49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:41:40.318295 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5287291-dc0b-40c5-861c-916b8aaafe49 None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:40.389987 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8eb1d21-2ea1-4f0f-9d1c-41a527cb5bef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e65f6d0598e4c539134292b86fb43d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:40.390547 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8eb1d21-2ea1-4f0f-9d1c-41a527cb5bef service neutron] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:40.390829 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8eb1d21-2ea1-4f0f-9d1c-41a527cb5bef service neutron] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:40.391105 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8eb1d21-2ea1-4f0f-9d1c-41a527cb5bef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:40.392743 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-a8eb1d21-2ea1-4f0f-9d1c-41a527cb5bef service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:41:40.494083 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8eb1d21-2ea1-4f0f-9d1c-41a527cb5bef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:40.495503 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8eb1d21-2ea1-4f0f-9d1c-41a527cb5bef service neutron] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:40.513494 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 605/1226] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Oct 12 16:41:40 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:41:42.828306 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d94ea29-9176-4b32-911f-bfa0375f60ff None None] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:42.828896 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d94ea29-9176-4b32-911f-bfa0375f60ff None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:42.828896 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d94ea29-9176-4b32-911f-bfa0375f60ff None None] PATH_INFO: `/` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:42.830751 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 622/1227] 10.222.0.58 () {54 vars in 926 bytes} [Tue Oct 12 16:41:42 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:41:42.836871 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af4e306-7a6e-401d-ab73-56d95a0f9758 None None] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:42.837327 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af4e306-7a6e-401d-ab73-56d95a0f9758 None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:42.837443 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af4e306-7a6e-401d-ab73-56d95a0f9758 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:42.899642 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.auth.core [None req-4af4e306-7a6e-401d-ab73-56d95a0f9758 None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:41:42.900831 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-4af4e306-7a6e-401d-ab73-56d95a0f9758 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:41:42.997074 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 606/1228] 10.222.0.58 () {58 vars in 1023 bytes} [Tue Oct 12 16:41:42 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:41:43.034340 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d94ea29-9176-4b32-911f-bfa0375f60ff None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:43.035919 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-1d94ea29-9176-4b32-911f-bfa0375f60ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:41:43.134263 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d94ea29-9176-4b32-911f-bfa0375f60ff None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:43.203425 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb87275b-d94f-4ef6-ae64-b15c92e17797 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e65f6d0598e4c539134292b86fb43d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:43.204115 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb87275b-d94f-4ef6-ae64-b15c92e17797 service neutron] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:43.204394 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb87275b-d94f-4ef6-ae64-b15c92e17797 service neutron] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:43.204665 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb87275b-d94f-4ef6-ae64-b15c92e17797 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:43.206413 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-cb87275b-d94f-4ef6-ae64-b15c92e17797 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:41:43.323759 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb87275b-d94f-4ef6-ae64-b15c92e17797 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:43.325195 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb87275b-d94f-4ef6-ae64-b15c92e17797 service neutron] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:43.343148 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 623/1229] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Oct 12 16:41:43 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 12 16:41:45.619658 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971a2e38-7cae-4e41-a45a-2d9a8b0d4dca None None] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:45.620251 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971a2e38-7cae-4e41-a45a-2d9a8b0d4dca None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:45.620251 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971a2e38-7cae-4e41-a45a-2d9a8b0d4dca None None] PATH_INFO: `/` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:45.622232 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 607/1230] 10.222.0.58 () {54 vars in 926 bytes} [Tue Oct 12 16:41:45 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:41:45.628134 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6264d3b-5d0f-4c6e-a089-93f36548a80a None None] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:45.628545 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6264d3b-5d0f-4c6e-a089-93f36548a80a None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:45.628691 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6264d3b-5d0f-4c6e-a089-93f36548a80a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:45.692548 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.auth.core [None req-f6264d3b-5d0f-4c6e-a089-93f36548a80a None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:41:45.693751 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-f6264d3b-5d0f-4c6e-a089-93f36548a80a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:41:45.790781 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 624/1231] 10.222.0.58 () {58 vars in 1023 bytes} [Tue Oct 12 16:41:45 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:41:45.823882 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971a2e38-7cae-4e41-a45a-2d9a8b0d4dca None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:45.825409 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-971a2e38-7cae-4e41-a45a-2d9a8b0d4dca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:41:45.960521 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971a2e38-7cae-4e41-a45a-2d9a8b0d4dca None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:46.053133 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87e77cb-d92e-44e2-9b14-6001cb20b94e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:46.054015 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87e77cb-d92e-44e2-9b14-6001cb20b94e admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:46.054297 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87e77cb-d92e-44e2-9b14-6001cb20b94e admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:46.054567 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87e77cb-d92e-44e2-9b14-6001cb20b94e admin admin] PATH_INFO: `/v3/projects/78966be562ca4918a5e25eac86ccd8ab` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:46.064722 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87e77cb-d92e-44e2-9b14-6001cb20b94e admin admin] RBAC: Authorizing `identity:get_project(project_id=78966be562ca4918a5e25eac86ccd8ab)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:46.066818 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87e77cb-d92e-44e2-9b14-6001cb20b94e admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:46.068680 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 608/1232] 10.222.0.58 () {56 vars in 1207 bytes} [Tue Oct 12 16:41:45 2021] GET /identity/v3/projects/78966be562ca4918a5e25eac86ccd8ab => generated 298 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:41:46.081576 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6264d3b-5d0f-4c6e-a089-93f36548a80a None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:46.082827 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-f6264d3b-5d0f-4c6e-a089-93f36548a80a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:41:46.183299 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6264d3b-5d0f-4c6e-a089-93f36548a80a None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:46.274030 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f30c481-b229-412f-81d4-5541756cb3db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e65f6d0598e4c539134292b86fb43d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:46.274942 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f30c481-b229-412f-81d4-5541756cb3db service neutron] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:46.275221 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f30c481-b229-412f-81d4-5541756cb3db service neutron] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:46.275547 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f30c481-b229-412f-81d4-5541756cb3db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:46.277138 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-4f30c481-b229-412f-81d4-5541756cb3db service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:41:46.401399 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f30c481-b229-412f-81d4-5541756cb3db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:46.404014 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f30c481-b229-412f-81d4-5541756cb3db service neutron] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:46.424413 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 625/1233] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Oct 12 16:41:46 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:41:48.920228 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0f2a0f-d742-4744-bc67-a0066118f598 None None] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:48.920788 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0f2a0f-d742-4744-bc67-a0066118f598 None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:48.920788 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0f2a0f-d742-4744-bc67-a0066118f598 None None] PATH_INFO: `/` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:48.922612 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 609/1234] 10.222.0.58 () {54 vars in 926 bytes} [Tue Oct 12 16:41:48 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:41:48.928613 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ac03a9-f9d2-45d7-9d6f-108690110588 None None] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:48.929008 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ac03a9-f9d2-45d7-9d6f-108690110588 None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:48.929201 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ac03a9-f9d2-45d7-9d6f-108690110588 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:48.993058 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.auth.core [None req-46ac03a9-f9d2-45d7-9d6f-108690110588 None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:41:48.994321 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-46ac03a9-f9d2-45d7-9d6f-108690110588 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:41:49.087845 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 626/1235] 10.222.0.58 () {58 vars in 1023 bytes} [Tue Oct 12 16:41:48 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:41:49.125049 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0f2a0f-d742-4744-bc67-a0066118f598 None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:49.127122 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-0b0f2a0f-d742-4744-bc67-a0066118f598 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:41:49.225755 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0f2a0f-d742-4744-bc67-a0066118f598 None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:49.302055 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd8f288-d051-4d0b-bd9d-3d66d6413651 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e65f6d0598e4c539134292b86fb43d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:49.302699 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd8f288-d051-4d0b-bd9d-3d66d6413651 service neutron] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:49.302983 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd8f288-d051-4d0b-bd9d-3d66d6413651 service neutron] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:49.303258 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd8f288-d051-4d0b-bd9d-3d66d6413651 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:49.304904 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-dbd8f288-d051-4d0b-bd9d-3d66d6413651 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:41:49.409063 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd8f288-d051-4d0b-bd9d-3d66d6413651 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:49.410516 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd8f288-d051-4d0b-bd9d-3d66d6413651 service neutron] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:49.428106 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 610/1236] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Oct 12 16:41:49 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:41:51.721304 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab02513c-3de6-4146-bf19-81f9952c92ae None None] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:51.721856 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab02513c-3de6-4146-bf19-81f9952c92ae None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:51.721989 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab02513c-3de6-4146-bf19-81f9952c92ae None None] PATH_INFO: `/` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:51.723791 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 627/1237] 10.222.0.58 () {54 vars in 926 bytes} [Tue Oct 12 16:41:51 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:41:51.729566 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9727458-e1a8-4d83-8af6-7eecfc54d120 None None] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:51.730036 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9727458-e1a8-4d83-8af6-7eecfc54d120 None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:51.730137 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9727458-e1a8-4d83-8af6-7eecfc54d120 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:51.791778 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.auth.core [None req-e9727458-e1a8-4d83-8af6-7eecfc54d120 None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:41:51.792972 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-e9727458-e1a8-4d83-8af6-7eecfc54d120 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:41:51.882412 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 611/1238] 10.222.0.58 () {58 vars in 1023 bytes} [Tue Oct 12 16:41:51 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:41:51.924404 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab02513c-3de6-4146-bf19-81f9952c92ae None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:51.926248 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-ab02513c-3de6-4146-bf19-81f9952c92ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:41:52.028863 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab02513c-3de6-4146-bf19-81f9952c92ae None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:52.100829 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05fdb8b-e86c-4ad6-80ee-227da4c7a57a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e65f6d0598e4c539134292b86fb43d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:52.101480 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05fdb8b-e86c-4ad6-80ee-227da4c7a57a service neutron] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:52.101770 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05fdb8b-e86c-4ad6-80ee-227da4c7a57a service neutron] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:52.102073 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05fdb8b-e86c-4ad6-80ee-227da4c7a57a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:52.103705 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-a05fdb8b-e86c-4ad6-80ee-227da4c7a57a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:41:52.206987 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05fdb8b-e86c-4ad6-80ee-227da4c7a57a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:52.208443 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05fdb8b-e86c-4ad6-80ee-227da4c7a57a service neutron] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:52.225434 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 628/1239] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Oct 12 16:41:51 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:41:54.753053 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f0cbdd-a7da-4b2a-9875-e75d6aef7d3c None None] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:54.753608 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f0cbdd-a7da-4b2a-9875-e75d6aef7d3c None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:54.753608 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f0cbdd-a7da-4b2a-9875-e75d6aef7d3c None None] PATH_INFO: `/` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:54.755422 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 612/1240] 10.222.0.58 () {54 vars in 926 bytes} [Tue Oct 12 16:41:54 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:41:54.761362 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e471fc6-a033-4f47-9318-c9ba5be2b28f None None] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:54.761779 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e471fc6-a033-4f47-9318-c9ba5be2b28f None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:54.761952 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e471fc6-a033-4f47-9318-c9ba5be2b28f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:54.830219 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.auth.core [None req-0e471fc6-a033-4f47-9318-c9ba5be2b28f None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:41:54.831426 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-0e471fc6-a033-4f47-9318-c9ba5be2b28f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:41:54.929899 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 629/1241] 10.222.0.58 () {58 vars in 1023 bytes} [Tue Oct 12 16:41:54 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:41:54.967353 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f0cbdd-a7da-4b2a-9875-e75d6aef7d3c None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:54.969430 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-84f0cbdd-a7da-4b2a-9875-e75d6aef7d3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:41:55.058540 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f0cbdd-a7da-4b2a-9875-e75d6aef7d3c None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:55.061999 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f13c997-8c9f-4f73-a31b-285d08ac22e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e65f6d0598e4c539134292b86fb43d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:55.062645 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f13c997-8c9f-4f73-a31b-285d08ac22e2 service neutron] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:55.062928 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f13c997-8c9f-4f73-a31b-285d08ac22e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:55.063203 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f13c997-8c9f-4f73-a31b-285d08ac22e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:55.072775 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f13c997-8c9f-4f73-a31b-285d08ac22e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:55.074218 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f13c997-8c9f-4f73-a31b-285d08ac22e2 service neutron] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:55.084801 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 613/1242] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Oct 12 16:41:54 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:41:59.329958 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62699aa8-2e43-4de6-a80a-af2930de54c9 None None] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:59.330969 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62699aa8-2e43-4de6-a80a-af2930de54c9 None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:59.330969 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62699aa8-2e43-4de6-a80a-af2930de54c9 None None] PATH_INFO: `/` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:59.332770 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 630/1243] 10.222.0.58 () {54 vars in 926 bytes} [Tue Oct 12 16:41:59 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:41:59.338617 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151fe855-1f41-4741-a4cf-3114f58d1f0c None None] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:59.339074 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151fe855-1f41-4741-a4cf-3114f58d1f0c None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:59.339185 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151fe855-1f41-4741-a4cf-3114f58d1f0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:59.356686 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.auth.core [None req-151fe855-1f41-4741-a4cf-3114f58d1f0c None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:41:59.357901 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-151fe855-1f41-4741-a4cf-3114f58d1f0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:41:59.365741 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 614/1244] 10.222.0.58 () {58 vars in 1023 bytes} [Tue Oct 12 16:41:59 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:41:59.405795 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62699aa8-2e43-4de6-a80a-af2930de54c9 None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:59.416904 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62699aa8-2e43-4de6-a80a-af2930de54c9 None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:59.420434 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9597bfff-e5a3-4362-9641-7855c30d47cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e65f6d0598e4c539134292b86fb43d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:59.421068 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9597bfff-e5a3-4362-9641-7855c30d47cb service neutron] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:59.421351 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9597bfff-e5a3-4362-9641-7855c30d47cb service neutron] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:59.421627 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9597bfff-e5a3-4362-9641-7855c30d47cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:59.438341 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9597bfff-e5a3-4362-9641-7855c30d47cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:59.440275 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9597bfff-e5a3-4362-9641-7855c30d47cb service neutron] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:59.449570 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 631/1245] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Oct 12 16:41:59 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:42:02.325481 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d69b45-5899-4379-b043-33f204e45965 None None] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:42:02.326081 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d69b45-5899-4379-b043-33f204e45965 None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:42:02.326081 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d69b45-5899-4379-b043-33f204e45965 None None] PATH_INFO: `/` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:42:02.327863 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 615/1246] 10.222.0.58 () {54 vars in 926 bytes} [Tue Oct 12 16:42:02 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:42:02.334387 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19c7107-be66-4c83-9b29-f4677cf87e93 None None] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:42:02.334811 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19c7107-be66-4c83-9b29-f4677cf87e93 None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:42:02.334938 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19c7107-be66-4c83-9b29-f4677cf87e93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:42:02.353150 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.auth.core [None req-a19c7107-be66-4c83-9b29-f4677cf87e93 None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:42:02.354368 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-a19c7107-be66-4c83-9b29-f4677cf87e93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:42:02.362323 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 632/1247] 10.222.0.58 () {58 vars in 1023 bytes} [Tue Oct 12 16:42:02 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:42:02.400842 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d69b45-5899-4379-b043-33f204e45965 None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:42:02.411705 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d69b45-5899-4379-b043-33f204e45965 None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:42:02.415148 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b00b3a1-7464-483b-b22e-d4b5d02ba9f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e65f6d0598e4c539134292b86fb43d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:42:02.415772 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b00b3a1-7464-483b-b22e-d4b5d02ba9f8 service neutron] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:42:02.416051 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b00b3a1-7464-483b-b22e-d4b5d02ba9f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:42:02.416323 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b00b3a1-7464-483b-b22e-d4b5d02ba9f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:42:02.424886 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b00b3a1-7464-483b-b22e-d4b5d02ba9f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:42:02.426320 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b00b3a1-7464-483b-b22e-d4b5d02ba9f8 service neutron] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:42:02.435366 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 616/1248] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Oct 12 16:42:02 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:42:06.745418 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd36bb7-e23f-4df7-818a-01998c44860f None None] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:42:06.745964 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd36bb7-e23f-4df7-818a-01998c44860f None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:42:06.746083 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd36bb7-e23f-4df7-818a-01998c44860f None None] PATH_INFO: `/` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:42:06.747795 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 633/1249] 10.222.0.58 () {54 vars in 926 bytes} [Tue Oct 12 16:42:06 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:42:06.754015 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7ce75b-3b83-446b-b271-b59cde4ef3f5 None None] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:42:06.754428 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7ce75b-3b83-446b-b271-b59cde4ef3f5 None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:42:06.754572 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7ce75b-3b83-446b-b271-b59cde4ef3f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:42:06.773592 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.auth.core [None req-3e7ce75b-3b83-446b-b271-b59cde4ef3f5 None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:42:06.774824 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-3e7ce75b-3b83-446b-b271-b59cde4ef3f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:42:06.783016 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 617/1250] 10.222.0.58 () {58 vars in 1023 bytes} [Tue Oct 12 16:42:06 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:42:06.822431 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd36bb7-e23f-4df7-818a-01998c44860f None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:42:06.834020 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd36bb7-e23f-4df7-818a-01998c44860f None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:42:06.837599 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ee9c26-445c-4621-9378-cd306283158b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e65f6d0598e4c539134292b86fb43d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:42:06.838253 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ee9c26-445c-4621-9378-cd306283158b service neutron] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:42:06.838539 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ee9c26-445c-4621-9378-cd306283158b service neutron] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:42:06.838812 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ee9c26-445c-4621-9378-cd306283158b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:42:06.848417 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ee9c26-445c-4621-9378-cd306283158b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:42:06.849837 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ee9c26-445c-4621-9378-cd306283158b service neutron] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:42:06.859053 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 634/1251] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Oct 12 16:42:06 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:42:11.944360 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0c013e-2d86-48da-983f-5c2930d257b7 None None] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:42:11.944866 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0c013e-2d86-48da-983f-5c2930d257b7 None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:42:11.944957 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0c013e-2d86-48da-983f-5c2930d257b7 None None] PATH_INFO: `/` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:42:11.947188 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 618/1252] 10.222.0.58 () {54 vars in 921 bytes} [Tue Oct 12 16:42:11 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:42:11.952711 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0cf49d-2ec9-4192-aae4-eb61a89a9623 None None] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:42:11.953181 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0cf49d-2ec9-4192-aae4-eb61a89a9623 None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:42:11.953263 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0cf49d-2ec9-4192-aae4-eb61a89a9623 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:42:12.064121 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.auth.core [None req-8a0cf49d-2ec9-4192-aae4-eb61a89a9623 None None] MFA Rules not processed for user `4102412c40bc4745bba8c31f1caf9788`. Rule list: `[]` (Enabled: `True`). {{(pid=85204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:42:12.068147 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-8a0cf49d-2ec9-4192-aae4-eb61a89a9623 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:42:12.180497 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 635/1253] 10.222.0.58 () {58 vars in 1018 bytes} [Tue Oct 12 16:42:11 2021] POST /identity/v3/auth/tokens => generated 3451 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:42:16.629369 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b03cdc-3a57-4b9d-8122-bb676db903c1 None None] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:42:16.629956 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b03cdc-3a57-4b9d-8122-bb676db903c1 None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:42:16.630059 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b03cdc-3a57-4b9d-8122-bb676db903c1 None None] PATH_INFO: `/` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:42:16.632230 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 619/1254] 10.222.0.58 () {54 vars in 921 bytes} [Tue Oct 12 16:42:16 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:42:16.637914 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4bea46-55e1-4cc1-b8f3-a07ae3666c1f None None] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:42:16.638760 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4bea46-55e1-4cc1-b8f3-a07ae3666c1f None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:42:16.639106 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4bea46-55e1-4cc1-b8f3-a07ae3666c1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:42:16.663393 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.auth.core [None req-aa4bea46-55e1-4cc1-b8f3-a07ae3666c1f None None] MFA Rules not processed for user `4102412c40bc4745bba8c31f1caf9788`. Rule list: `[]` (Enabled: `True`). {{(pid=85204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:42:16.664768 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-aa4bea46-55e1-4cc1-b8f3-a07ae3666c1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:42:16.673898 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 636/1255] 10.222.0.58 () {58 vars in 1018 bytes} [Tue Oct 12 16:42:16 2021] POST /identity/v3/auth/tokens => generated 3451 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:42:17.971464 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002448f4-5011-4a03-a1cc-aa7e4aa570a1 None None] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:42:17.972006 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002448f4-5011-4a03-a1cc-aa7e4aa570a1 None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:42:17.972006 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002448f4-5011-4a03-a1cc-aa7e4aa570a1 None None] PATH_INFO: `/` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:42:17.973788 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 620/1256] 10.222.0.58 () {54 vars in 921 bytes} [Tue Oct 12 16:42:17 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:42:17.978963 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99c69e2-f0af-4ec6-80ce-dfe4b442a4cb None None] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:42:17.979406 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99c69e2-f0af-4ec6-80ce-dfe4b442a4cb None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:42:17.979824 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99c69e2-f0af-4ec6-80ce-dfe4b442a4cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:42:17.998389 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.auth.core [None req-f99c69e2-f0af-4ec6-80ce-dfe4b442a4cb None None] MFA Rules not processed for user `4102412c40bc4745bba8c31f1caf9788`. Rule list: `[]` (Enabled: `True`). {{(pid=85204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:42:17.999560 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-f99c69e2-f0af-4ec6-80ce-dfe4b442a4cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:42:18.008515 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 637/1257] 10.222.0.58 () {58 vars in 1018 bytes} [Tue Oct 12 16:42:17 2021] POST /identity/v3/auth/tokens => generated 3451 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:42:21.734758 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693635a5-f754-4f0a-944d-ac63965d7f8b None None] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:42:21.735265 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693635a5-f754-4f0a-944d-ac63965d7f8b None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:42:21.735265 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693635a5-f754-4f0a-944d-ac63965d7f8b None None] PATH_INFO: `/` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:42:21.736990 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 621/1258] 10.222.0.58 () {54 vars in 926 bytes} [Tue Oct 12 16:42:21 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:42:21.744958 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa9c0e9-4241-4ba1-a58f-88015c1704a8 None None] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:42:21.745744 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa9c0e9-4241-4ba1-a58f-88015c1704a8 None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:42:21.746059 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa9c0e9-4241-4ba1-a58f-88015c1704a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:42:21.764261 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.auth.core [None req-0aa9c0e9-4241-4ba1-a58f-88015c1704a8 None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:42:21.765464 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-0aa9c0e9-4241-4ba1-a58f-88015c1704a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:42:21.774151 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 638/1259] 10.222.0.58 () {58 vars in 1023 bytes} [Tue Oct 12 16:42:21 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:42:21.825600 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308c7f55-f571-4ef0-9553-ab5db37dd781 None None] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:42:21.825917 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308c7f55-f571-4ef0-9553-ab5db37dd781 None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:42:21.826231 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308c7f55-f571-4ef0-9553-ab5db37dd781 None None] PATH_INFO: `/` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:42:21.828166 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 622/1260] 10.222.0.58 () {54 vars in 960 bytes} [Tue Oct 12 16:42:21 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:42:21.834154 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe32715-0c7c-45af-92e2-782a3cc9ee1d None None] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:42:21.834554 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe32715-0c7c-45af-92e2-782a3cc9ee1d None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:42:21.834932 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe32715-0c7c-45af-92e2-782a3cc9ee1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:42:21.886389 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.auth.core [None req-bfe32715-0c7c-45af-92e2-782a3cc9ee1d None None] MFA Rules not processed for user `29d30b574eec4ad3990d77d235c8b424`. Rule list: `[]` (Enabled: `True`). {{(pid=85204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:42:21.887616 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-bfe32715-0c7c-45af-92e2-782a3cc9ee1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:42:21.967921 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 639/1261] 10.222.0.58 () {58 vars in 1057 bytes} [Tue Oct 12 16:42:21 2021] POST /identity/v3/auth/tokens => generated 3515 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:42:21.976486 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308c7f55-f571-4ef0-9553-ab5db37dd781 None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:42:21.991630 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308c7f55-f571-4ef0-9553-ab5db37dd781 None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:42:21.997469 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6f29ee-c7c1-47a4-8acb-d8893bc35e4d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29d30b574eec4ad3990d77d235c8b424', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:42:21.998317 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6f29ee-c7c1-47a4-8acb-d8893bc35e4d service nova] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:42:21.998704 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6f29ee-c7c1-47a4-8acb-d8893bc35e4d service nova] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:42:21.999083 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6f29ee-c7c1-47a4-8acb-d8893bc35e4d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:42:22.007679 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6f29ee-c7c1-47a4-8acb-d8893bc35e4d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:42:22.009344 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6f29ee-c7c1-47a4-8acb-d8893bc35e4d service nova] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:42:22.019184 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 623/1262] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Oct 12 16:42:21 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 12 16:42:24.515848 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90259ee-e197-429d-aa51-112fb774a5a0 None None] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:42:24.516360 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90259ee-e197-429d-aa51-112fb774a5a0 None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:42:24.516443 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90259ee-e197-429d-aa51-112fb774a5a0 None None] PATH_INFO: `/` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:42:24.518460 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 640/1263] 10.222.0.58 () {54 vars in 926 bytes} [Tue Oct 12 16:42:24 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:42:24.524614 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c9b7bf-fd7a-43d0-aba0-2dfa019ad461 None None] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:42:24.525029 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c9b7bf-fd7a-43d0-aba0-2dfa019ad461 None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:42:24.525178 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c9b7bf-fd7a-43d0-aba0-2dfa019ad461 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:42:24.543601 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.auth.core [None req-06c9b7bf-fd7a-43d0-aba0-2dfa019ad461 None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:42:24.544770 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-06c9b7bf-fd7a-43d0-aba0-2dfa019ad461 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:42:24.553188 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 624/1264] 10.222.0.58 () {58 vars in 1023 bytes} [Tue Oct 12 16:42:24 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:42:24.599261 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90259ee-e197-429d-aa51-112fb774a5a0 None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:42:24.613613 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90259ee-e197-429d-aa51-112fb774a5a0 None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:42:24.619190 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af40a758-4e85-4311-9564-eadb94ab64e9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29d30b574eec4ad3990d77d235c8b424', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:42:24.620035 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af40a758-4e85-4311-9564-eadb94ab64e9 service nova] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:42:24.620488 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af40a758-4e85-4311-9564-eadb94ab64e9 service nova] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:42:24.620838 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af40a758-4e85-4311-9564-eadb94ab64e9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:42:24.629146 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af40a758-4e85-4311-9564-eadb94ab64e9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:42:24.630920 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af40a758-4e85-4311-9564-eadb94ab64e9 service nova] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:42:24.640689 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 641/1265] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Oct 12 16:42:24 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:42:27.198397 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d7d953-f4ec-4acd-a90b-b2b4de8fdbb1 None None] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:42:27.198866 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d7d953-f4ec-4acd-a90b-b2b4de8fdbb1 None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:42:27.198985 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d7d953-f4ec-4acd-a90b-b2b4de8fdbb1 None None] PATH_INFO: `/` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:42:27.201035 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 625/1266] 10.222.0.58 () {54 vars in 926 bytes} [Tue Oct 12 16:42:27 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:42:27.209343 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa57e9ba-2bb2-4d6f-8587-dcd5a3d34d04 None None] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:42:27.209343 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa57e9ba-2bb2-4d6f-8587-dcd5a3d34d04 None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:42:27.209343 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa57e9ba-2bb2-4d6f-8587-dcd5a3d34d04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:42:27.233455 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.auth.core [None req-aa57e9ba-2bb2-4d6f-8587-dcd5a3d34d04 None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:42:27.234890 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-aa57e9ba-2bb2-4d6f-8587-dcd5a3d34d04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:42:27.244040 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 642/1267] 10.222.0.58 () {58 vars in 1023 bytes} [Tue Oct 12 16:42:27 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:42:27.291997 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719e7f42-02e8-49a0-938c-223b6e4476ae None None] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:42:27.292387 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719e7f42-02e8-49a0-938c-223b6e4476ae None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:42:27.292763 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719e7f42-02e8-49a0-938c-223b6e4476ae None None] PATH_INFO: `/` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:42:27.294689 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 626/1268] 10.222.0.58 () {54 vars in 960 bytes} [Tue Oct 12 16:42:27 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:42:27.301135 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee86a54-792f-4656-9f2d-879311d8fd2d None None] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:42:27.301564 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee86a54-792f-4656-9f2d-879311d8fd2d None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:42:27.301866 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee86a54-792f-4656-9f2d-879311d8fd2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:42:27.321992 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.auth.core [None req-4ee86a54-792f-4656-9f2d-879311d8fd2d None None] MFA Rules not processed for user `29d30b574eec4ad3990d77d235c8b424`. Rule list: `[]` (Enabled: `True`). {{(pid=85204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:42:27.323168 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-4ee86a54-792f-4656-9f2d-879311d8fd2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:42:27.333283 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 643/1269] 10.222.0.58 () {58 vars in 1057 bytes} [Tue Oct 12 16:42:27 2021] POST /identity/v3/auth/tokens => generated 3515 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:42:27.341807 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719e7f42-02e8-49a0-938c-223b6e4476ae None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:42:27.356681 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719e7f42-02e8-49a0-938c-223b6e4476ae None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:42:27.362386 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dceb4779-4ea6-4c89-b0f1-0906efbc6f19 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29d30b574eec4ad3990d77d235c8b424', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:42:27.363100 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dceb4779-4ea6-4c89-b0f1-0906efbc6f19 service nova] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:42:27.363555 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dceb4779-4ea6-4c89-b0f1-0906efbc6f19 service nova] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:42:27.364022 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dceb4779-4ea6-4c89-b0f1-0906efbc6f19 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:42:27.374060 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dceb4779-4ea6-4c89-b0f1-0906efbc6f19 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:42:27.375845 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dceb4779-4ea6-4c89-b0f1-0906efbc6f19 service nova] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:42:27.386809 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 627/1270] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Oct 12 16:42:27 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:42:29.593486 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc51a83-28d2-4c44-8599-a5acc24a79ff None None] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:42:29.594125 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc51a83-28d2-4c44-8599-a5acc24a79ff None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:42:29.594358 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc51a83-28d2-4c44-8599-a5acc24a79ff None None] PATH_INFO: `/` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:42:29.596485 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 644/1271] 10.222.0.58 () {54 vars in 926 bytes} [Tue Oct 12 16:42:29 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:42:29.603359 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d3dbf2-d595-4669-81f9-35de0ea3eb27 None None] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:42:29.603918 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d3dbf2-d595-4669-81f9-35de0ea3eb27 None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:42:29.604140 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d3dbf2-d595-4669-81f9-35de0ea3eb27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:42:29.622204 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.auth.core [None req-05d3dbf2-d595-4669-81f9-35de0ea3eb27 None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:42:29.623535 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-05d3dbf2-d595-4669-81f9-35de0ea3eb27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:42:29.632069 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 628/1272] 10.222.0.58 () {58 vars in 1023 bytes} [Tue Oct 12 16:42:29 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:42:29.694208 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4930ccf4-2a5b-4703-9138-93001309ebb9 None None] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:42:29.694614 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4930ccf4-2a5b-4703-9138-93001309ebb9 None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:42:29.694896 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4930ccf4-2a5b-4703-9138-93001309ebb9 None None] PATH_INFO: `/` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:42:29.696898 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 645/1273] 10.222.0.58 () {54 vars in 962 bytes} [Tue Oct 12 16:42:29 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:42:29.702418 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2189b64-643e-463c-b000-e8a0e5867345 None None] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:42:29.702961 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2189b64-643e-463c-b000-e8a0e5867345 None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:42:29.703349 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2189b64-643e-463c-b000-e8a0e5867345 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:42:29.734846 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3207144-b703-4186-a2e7-c56c226b4a21 None None] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:42:29.735137 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3207144-b703-4186-a2e7-c56c226b4a21 None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:42:29.735416 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3207144-b703-4186-a2e7-c56c226b4a21 None None] PATH_INFO: `/` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:42:29.737287 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 646/1274] 10.222.0.58 () {54 vars in 926 bytes} [Tue Oct 12 16:42:29 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:42:29.744430 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349b049f-b1d0-4c92-8723-4140d6f59b87 None None] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:42:29.744958 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349b049f-b1d0-4c92-8723-4140d6f59b87 None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:42:29.745389 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349b049f-b1d0-4c92-8723-4140d6f59b87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:42:29.763841 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.auth.core [None req-f2189b64-643e-463c-b000-e8a0e5867345 None None] MFA Rules not processed for user `04704222b3d64a33a6c092fc641ccbb0`. Rule list: `[]` (Enabled: `True`). {{(pid=85205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:42:29.765657 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-f2189b64-643e-463c-b000-e8a0e5867345 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:42:29.766221 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.auth.core [None req-349b049f-b1d0-4c92-8723-4140d6f59b87 None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:42:29.767391 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-349b049f-b1d0-4c92-8723-4140d6f59b87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:42:29.776235 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 647/1275] 10.222.0.58 () {58 vars in 1023 bytes} [Tue Oct 12 16:42:29 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:42:29.826037 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349b049f-b1d0-4c92-8723-4140d6f59b87 None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:42:29.830799 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 629/1276] 10.222.0.58 () {58 vars in 1059 bytes} [Tue Oct 12 16:42:29 2021] POST /identity/v3/auth/tokens => generated 3263 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:42:29.840316 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349b049f-b1d0-4c92-8723-4140d6f59b87 None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:42:29.843838 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2189b64-643e-463c-b000-e8a0e5867345 None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:42:29.846262 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bc534f-8a29-4a92-97d1-326e7a85a7fe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29d30b574eec4ad3990d77d235c8b424', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:42:29.847703 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bc534f-8a29-4a92-97d1-326e7a85a7fe service nova] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:42:29.848057 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bc534f-8a29-4a92-97d1-326e7a85a7fe service nova] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:42:29.848431 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bc534f-8a29-4a92-97d1-326e7a85a7fe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:42:29.856262 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2189b64-643e-463c-b000-e8a0e5867345 None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:42:29.861053 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4c10fd-15e8-4900-8f07-bb3b63786b4d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04704222b3d64a33a6c092fc641ccbb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:42:29.861201 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bc534f-8a29-4a92-97d1-326e7a85a7fe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:42:29.861709 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4c10fd-15e8-4900-8f07-bb3b63786b4d service cinder] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:42:29.862037 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4c10fd-15e8-4900-8f07-bb3b63786b4d service cinder] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:42:29.862316 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4c10fd-15e8-4900-8f07-bb3b63786b4d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:42:29.862999 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bc534f-8a29-4a92-97d1-326e7a85a7fe service nova] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:42:29.876898 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4c10fd-15e8-4900-8f07-bb3b63786b4d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:42:29.879270 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4c10fd-15e8-4900-8f07-bb3b63786b4d service cinder] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:42:29.884060 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 648/1277] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Oct 12 16:42:29 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 12 16:42:29.894057 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 630/1278] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Oct 12 16:42:29 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:42:32.190477 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81f4aae-f60f-46c6-a4a9-06bf15e66ecd None None] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:42:32.191002 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81f4aae-f60f-46c6-a4a9-06bf15e66ecd None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:42:32.191002 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81f4aae-f60f-46c6-a4a9-06bf15e66ecd None None] PATH_INFO: `/` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:42:32.192800 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 649/1279] 10.222.0.58 () {54 vars in 926 bytes} [Tue Oct 12 16:42:32 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:42:32.198619 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a132b11-b6b4-45f6-98da-5285a7eba1fd None None] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:42:32.199046 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a132b11-b6b4-45f6-98da-5285a7eba1fd None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:42:32.199182 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a132b11-b6b4-45f6-98da-5285a7eba1fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:42:32.216779 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.auth.core [None req-8a132b11-b6b4-45f6-98da-5285a7eba1fd None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:42:32.217986 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-8a132b11-b6b4-45f6-98da-5285a7eba1fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:42:32.226365 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 631/1280] 10.222.0.58 () {58 vars in 1023 bytes} [Tue Oct 12 16:42:32 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:42:32.273607 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81f4aae-f60f-46c6-a4a9-06bf15e66ecd None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:42:32.291935 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81f4aae-f60f-46c6-a4a9-06bf15e66ecd None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:42:32.298606 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156aeb3a-f55d-4b9e-b855-3295cecf7c07 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29d30b574eec4ad3990d77d235c8b424', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:42:32.299229 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156aeb3a-f55d-4b9e-b855-3295cecf7c07 service nova] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:42:32.299554 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156aeb3a-f55d-4b9e-b855-3295cecf7c07 service nova] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:42:32.299807 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156aeb3a-f55d-4b9e-b855-3295cecf7c07 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:42:32.308415 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156aeb3a-f55d-4b9e-b855-3295cecf7c07 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:42:32.310074 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156aeb3a-f55d-4b9e-b855-3295cecf7c07 service nova] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:42:32.319627 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 650/1281] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Oct 12 16:42:32 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:42:34.603298 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da3c55f-8dd5-40f9-9a37-3f8ca0a9dbd3 None None] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:42:34.603827 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da3c55f-8dd5-40f9-9a37-3f8ca0a9dbd3 None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:42:34.603827 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da3c55f-8dd5-40f9-9a37-3f8ca0a9dbd3 None None] PATH_INFO: `/` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:42:34.605594 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 632/1282] 10.222.0.58 () {54 vars in 926 bytes} [Tue Oct 12 16:42:34 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:42:34.611605 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dd0247-523c-4698-8372-2fd081b71565 None None] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:42:34.612013 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dd0247-523c-4698-8372-2fd081b71565 None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:42:34.612184 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dd0247-523c-4698-8372-2fd081b71565 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:42:34.631403 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.auth.core [None req-46dd0247-523c-4698-8372-2fd081b71565 None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:42:34.632608 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-46dd0247-523c-4698-8372-2fd081b71565 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:42:34.640913 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 651/1283] 10.222.0.58 () {58 vars in 1023 bytes} [Tue Oct 12 16:42:34 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:42:34.686314 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da3c55f-8dd5-40f9-9a37-3f8ca0a9dbd3 None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:42:34.701199 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da3c55f-8dd5-40f9-9a37-3f8ca0a9dbd3 None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:42:34.708986 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6440d6c0-f3f6-403b-a2a0-3c98cebad490 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29d30b574eec4ad3990d77d235c8b424', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:42:34.709732 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6440d6c0-f3f6-403b-a2a0-3c98cebad490 service nova] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:42:34.710137 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6440d6c0-f3f6-403b-a2a0-3c98cebad490 service nova] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:42:34.710508 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6440d6c0-f3f6-403b-a2a0-3c98cebad490 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:42:34.719477 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6440d6c0-f3f6-403b-a2a0-3c98cebad490 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:42:34.721133 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6440d6c0-f3f6-403b-a2a0-3c98cebad490 service nova] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:42:34.731576 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 633/1284] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Oct 12 16:42:34 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:42:37.059479 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ceb0708-b604-4d21-879a-29649460b3f7 None None] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:42:37.059975 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ceb0708-b604-4d21-879a-29649460b3f7 None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:42:37.059975 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ceb0708-b604-4d21-879a-29649460b3f7 None None] PATH_INFO: `/` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:42:37.061730 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 652/1285] 10.222.0.58 () {54 vars in 926 bytes} [Tue Oct 12 16:42:37 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:42:37.067980 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03517e8-affc-4b02-9f7e-5a45a83ea8b0 None None] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:42:37.068455 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03517e8-affc-4b02-9f7e-5a45a83ea8b0 None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:42:37.068551 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03517e8-affc-4b02-9f7e-5a45a83ea8b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:42:37.086056 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.auth.core [None req-d03517e8-affc-4b02-9f7e-5a45a83ea8b0 None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:42:37.087354 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-d03517e8-affc-4b02-9f7e-5a45a83ea8b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:42:37.095442 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 634/1286] 10.222.0.58 () {58 vars in 1023 bytes} [Tue Oct 12 16:42:37 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:42:37.141571 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ceb0708-b604-4d21-879a-29649460b3f7 None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:42:37.156301 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ceb0708-b604-4d21-879a-29649460b3f7 None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:42:37.163538 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f9c9c8-ad7f-43c7-bd94-0371599f3bd2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29d30b574eec4ad3990d77d235c8b424', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:42:37.164318 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f9c9c8-ad7f-43c7-bd94-0371599f3bd2 service nova] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:42:37.164687 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f9c9c8-ad7f-43c7-bd94-0371599f3bd2 service nova] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:42:37.165032 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f9c9c8-ad7f-43c7-bd94-0371599f3bd2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:42:37.174625 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f9c9c8-ad7f-43c7-bd94-0371599f3bd2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:42:37.176453 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f9c9c8-ad7f-43c7-bd94-0371599f3bd2 service nova] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:42:37.187642 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 653/1287] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Oct 12 16:42:37 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 12 16:42:39.573387 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c202809c-b427-432e-bada-85df7519ab61 None None] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:42:39.574025 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c202809c-b427-432e-bada-85df7519ab61 None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:42:39.574025 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c202809c-b427-432e-bada-85df7519ab61 None None] PATH_INFO: `/` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:42:39.575769 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 635/1288] 10.222.0.58 () {54 vars in 926 bytes} [Tue Oct 12 16:42:39 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:42:39.581704 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b437d747-31da-4da7-8e78-6f994be9bb68 None None] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:42:39.582366 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b437d747-31da-4da7-8e78-6f994be9bb68 None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:42:39.582366 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b437d747-31da-4da7-8e78-6f994be9bb68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:42:39.601843 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.auth.core [None req-b437d747-31da-4da7-8e78-6f994be9bb68 None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:42:39.603724 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-b437d747-31da-4da7-8e78-6f994be9bb68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:42:39.615292 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 654/1289] 10.222.0.58 () {58 vars in 1023 bytes} [Tue Oct 12 16:42:39 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:42:39.664970 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c202809c-b427-432e-bada-85df7519ab61 None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:42:39.679480 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c202809c-b427-432e-bada-85df7519ab61 None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:42:39.685256 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56181f5f-8f7e-45b2-8ec9-d205d8d6d5ba service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29d30b574eec4ad3990d77d235c8b424', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:42:39.685933 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56181f5f-8f7e-45b2-8ec9-d205d8d6d5ba service nova] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:42:39.686227 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56181f5f-8f7e-45b2-8ec9-d205d8d6d5ba service nova] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:42:39.686507 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56181f5f-8f7e-45b2-8ec9-d205d8d6d5ba service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:42:39.695132 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56181f5f-8f7e-45b2-8ec9-d205d8d6d5ba service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:42:39.696721 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56181f5f-8f7e-45b2-8ec9-d205d8d6d5ba service nova] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:42:39.706359 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 636/1290] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Oct 12 16:42:39 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:42:42.398260 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882147de-2b3d-44f4-a27f-9bc0d16506e4 None None] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:42:42.398823 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882147de-2b3d-44f4-a27f-9bc0d16506e4 None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:42:42.398928 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882147de-2b3d-44f4-a27f-9bc0d16506e4 None None] PATH_INFO: `/` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:42:42.401173 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 655/1291] 10.222.0.58 () {54 vars in 926 bytes} [Tue Oct 12 16:42:42 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:42:42.408248 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e365784-e4c8-47fc-a425-bd9127045192 None None] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:42:42.408690 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e365784-e4c8-47fc-a425-bd9127045192 None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:42:42.408807 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e365784-e4c8-47fc-a425-bd9127045192 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:42:42.426583 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.auth.core [None req-2e365784-e4c8-47fc-a425-bd9127045192 None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:42:42.427817 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-2e365784-e4c8-47fc-a425-bd9127045192 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:42:42.436049 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 637/1292] 10.222.0.58 () {58 vars in 1023 bytes} [Tue Oct 12 16:42:42 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:42:42.502177 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882147de-2b3d-44f4-a27f-9bc0d16506e4 None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:42:42.517559 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882147de-2b3d-44f4-a27f-9bc0d16506e4 None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:42:42.523971 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774c87be-6e8c-4b42-8dfd-9c9585c0197b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29d30b574eec4ad3990d77d235c8b424', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:42:42.524616 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774c87be-6e8c-4b42-8dfd-9c9585c0197b service nova] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:42:42.524902 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774c87be-6e8c-4b42-8dfd-9c9585c0197b service nova] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:42:42.525205 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774c87be-6e8c-4b42-8dfd-9c9585c0197b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:42:42.533725 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774c87be-6e8c-4b42-8dfd-9c9585c0197b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:42:42.535324 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774c87be-6e8c-4b42-8dfd-9c9585c0197b service nova] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:42:42.544713 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 656/1293] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Oct 12 16:42:42 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:42:44.987817 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378b2ad9-ee59-4763-ba04-5352d8539b57 None None] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:42:44.988294 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378b2ad9-ee59-4763-ba04-5352d8539b57 None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:42:44.988389 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378b2ad9-ee59-4763-ba04-5352d8539b57 None None] PATH_INFO: `/` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:42:44.990229 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 638/1294] 10.222.0.58 () {54 vars in 926 bytes} [Tue Oct 12 16:42:44 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:42:44.996155 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cd6861-4cb7-4841-9938-d3e486018eb6 None None] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:42:44.996591 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cd6861-4cb7-4841-9938-d3e486018eb6 None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:42:44.996819 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cd6861-4cb7-4841-9938-d3e486018eb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:42:45.014105 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.auth.core [None req-46cd6861-4cb7-4841-9938-d3e486018eb6 None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:42:45.015277 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-46cd6861-4cb7-4841-9938-d3e486018eb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:42:45.023618 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 657/1295] 10.222.0.58 () {58 vars in 1023 bytes} [Tue Oct 12 16:42:44 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:42:45.069169 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378b2ad9-ee59-4763-ba04-5352d8539b57 None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:42:45.083197 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378b2ad9-ee59-4763-ba04-5352d8539b57 None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:42:45.089123 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31efdaf5-6b96-4213-af1d-31a3718175f9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29d30b574eec4ad3990d77d235c8b424', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:42:45.089767 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31efdaf5-6b96-4213-af1d-31a3718175f9 service nova] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:42:45.090084 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31efdaf5-6b96-4213-af1d-31a3718175f9 service nova] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:42:45.090366 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31efdaf5-6b96-4213-af1d-31a3718175f9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:42:45.098568 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31efdaf5-6b96-4213-af1d-31a3718175f9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:42:45.100754 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31efdaf5-6b96-4213-af1d-31a3718175f9 service nova] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:42:45.110135 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 639/1296] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Oct 12 16:42:45 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:42:45.776649 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21047161-8aa7-4789-9373-ee6a558eb2b6 None None] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:42:45.776985 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21047161-8aa7-4789-9373-ee6a558eb2b6 None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:42:45.777208 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21047161-8aa7-4789-9373-ee6a558eb2b6 None None] PATH_INFO: `/` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:42:45.779011 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 658/1297] 10.222.0.58 () {54 vars in 926 bytes} [Tue Oct 12 16:42:45 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:42:45.785007 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c73a0bb-026c-4c3d-a9dc-6711729ba4fb None None] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:42:45.785299 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c73a0bb-026c-4c3d-a9dc-6711729ba4fb None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:42:45.785579 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c73a0bb-026c-4c3d-a9dc-6711729ba4fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:42:45.802958 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.auth.core [None req-2c73a0bb-026c-4c3d-a9dc-6711729ba4fb None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:42:45.804685 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-2c73a0bb-026c-4c3d-a9dc-6711729ba4fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:42:45.812930 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 640/1298] 10.222.0.58 () {58 vars in 1023 bytes} [Tue Oct 12 16:42:45 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:42:45.870018 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17074425-e29a-486b-99a6-af4bb965ba6d None None] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:42:45.870382 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17074425-e29a-486b-99a6-af4bb965ba6d None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:42:45.870730 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17074425-e29a-486b-99a6-af4bb965ba6d None None] PATH_INFO: `/` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:42:45.872606 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 659/1299] 10.222.0.58 () {54 vars in 961 bytes} [Tue Oct 12 16:42:45 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:42:45.878440 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebcb8de-ad15-4ff5-99fa-bb104d6184d9 None None] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:42:45.878733 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebcb8de-ad15-4ff5-99fa-bb104d6184d9 None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:42:45.879041 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebcb8de-ad15-4ff5-99fa-bb104d6184d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:42:45.925831 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.auth.core [None req-aebcb8de-ad15-4ff5-99fa-bb104d6184d9 None None] MFA Rules not processed for user `8ff84015069041f2bf33e3fd55b92e44`. Rule list: `[]` (Enabled: `True`). {{(pid=85205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:42:45.927055 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-aebcb8de-ad15-4ff5-99fa-bb104d6184d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:42:45.985628 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 641/1300] 10.222.0.58 () {58 vars in 1058 bytes} [Tue Oct 12 16:42:45 2021] POST /identity/v3/auth/tokens => generated 3263 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:42:45.994279 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17074425-e29a-486b-99a6-af4bb965ba6d None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:42:46.004862 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17074425-e29a-486b-99a6-af4bb965ba6d None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:42:46.008490 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d922f2-6b76-49d1-b4be-77e6390751f3 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ff84015069041f2bf33e3fd55b92e44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:42:46.009123 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d922f2-6b76-49d1-b4be-77e6390751f3 service glance] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:42:46.009408 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d922f2-6b76-49d1-b4be-77e6390751f3 service glance] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:42:46.009684 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d922f2-6b76-49d1-b4be-77e6390751f3 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:42:46.018886 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d922f2-6b76-49d1-b4be-77e6390751f3 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:42:46.020374 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d922f2-6b76-49d1-b4be-77e6390751f3 service glance] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:42:46.030156 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 660/1301] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Oct 12 16:42:45 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:42:46.460418 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1946e052-0d18-4bce-bfb0-abaa6432f201 None None] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:42:46.460911 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1946e052-0d18-4bce-bfb0-abaa6432f201 None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:42:46.461118 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1946e052-0d18-4bce-bfb0-abaa6432f201 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:42:46.512364 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.auth.core [None req-1946e052-0d18-4bce-bfb0-abaa6432f201 None None] MFA Rules not processed for user `387a65d2bfb142499c9b3b0ac946f48b`. Rule list: `[]` (Enabled: `True`). {{(pid=85205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:42:46.513566 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-1946e052-0d18-4bce-bfb0-abaa6432f201 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:42:46.573459 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 642/1302] 10.222.0.58 () {58 vars in 1009 bytes} [Tue Oct 12 16:42:46 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:42:46.618761 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfe0805-9796-4641-a417-9e54c271ba41 None None] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:42:46.619164 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfe0805-9796-4641-a417-9e54c271ba41 None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:42:46.619507 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfe0805-9796-4641-a417-9e54c271ba41 None None] PATH_INFO: `/` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:42:46.621338 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 661/1303] 10.222.0.58 () {54 vars in 942 bytes} [Tue Oct 12 16:42:46 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:42:46.628354 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e30294-7680-4899-a8f3-3bd9c6530a16 None None] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:42:46.628649 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e30294-7680-4899-a8f3-3bd9c6530a16 None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:42:46.628931 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e30294-7680-4899-a8f3-3bd9c6530a16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:42:46.676026 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.auth.core [None req-b8e30294-7680-4899-a8f3-3bd9c6530a16 None None] MFA Rules not processed for user `9fdeb0a451344c9987b4134b957ffa22`. Rule list: `[]` (Enabled: `True`). {{(pid=85205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:42:46.677225 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-b8e30294-7680-4899-a8f3-3bd9c6530a16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:42:46.745978 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 643/1304] 10.222.0.58 () {58 vars in 1039 bytes} [Tue Oct 12 16:42:46 2021] POST /identity/v3/auth/tokens => generated 3447 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:42:46.755120 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfe0805-9796-4641-a417-9e54c271ba41 None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:42:46.769314 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfe0805-9796-4641-a417-9e54c271ba41 None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:42:46.775126 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220c4d19-4448-40f2-904c-68a99d48d3f1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdeb0a451344c9987b4134b957ffa22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:42:46.775833 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220c4d19-4448-40f2-904c-68a99d48d3f1 service swift] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:42:46.776188 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220c4d19-4448-40f2-904c-68a99d48d3f1 service swift] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:42:46.776560 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220c4d19-4448-40f2-904c-68a99d48d3f1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:42:46.784599 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220c4d19-4448-40f2-904c-68a99d48d3f1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:42:46.786202 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220c4d19-4448-40f2-904c-68a99d48d3f1 service swift] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:42:46.794029 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 662/1305] 10.222.0.58 () {60 vars in 1384 bytes} [Tue Oct 12 16:42:46 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 12 16:42:47.379048 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d194db1-87b1-49f8-b5bd-755cb0501371 None None] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:42:47.379442 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d194db1-87b1-49f8-b5bd-755cb0501371 None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:42:47.379823 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d194db1-87b1-49f8-b5bd-755cb0501371 None None] PATH_INFO: `/` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:42:47.382480 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 644/1306] 10.222.0.58 () {54 vars in 926 bytes} [Tue Oct 12 16:42:47 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:42:47.389533 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fdbe60-22c9-41c7-a194-f47d4c6ba3b6 None None] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:42:47.390063 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fdbe60-22c9-41c7-a194-f47d4c6ba3b6 None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:42:47.390166 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fdbe60-22c9-41c7-a194-f47d4c6ba3b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:42:47.408761 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.auth.core [None req-26fdbe60-22c9-41c7-a194-f47d4c6ba3b6 None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:42:47.409974 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-26fdbe60-22c9-41c7-a194-f47d4c6ba3b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:42:47.430060 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 663/1307] 10.222.0.58 () {58 vars in 1023 bytes} [Tue Oct 12 16:42:47 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:42:47.465650 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d194db1-87b1-49f8-b5bd-755cb0501371 None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:42:47.482220 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d194db1-87b1-49f8-b5bd-755cb0501371 None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:42:47.487787 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da096de3-b6c5-41dd-a563-ff7174fa8230 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29d30b574eec4ad3990d77d235c8b424', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:42:47.488680 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da096de3-b6c5-41dd-a563-ff7174fa8230 service nova] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:42:47.489180 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da096de3-b6c5-41dd-a563-ff7174fa8230 service nova] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:42:47.489529 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da096de3-b6c5-41dd-a563-ff7174fa8230 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:42:47.498618 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da096de3-b6c5-41dd-a563-ff7174fa8230 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:42:47.500245 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da096de3-b6c5-41dd-a563-ff7174fa8230 service nova] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:42:47.510072 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 645/1308] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Oct 12 16:42:47 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 12 16:42:49.897474 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3225cd07-caf7-4077-9736-34e893e424d4 None None] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:42:49.898098 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3225cd07-caf7-4077-9736-34e893e424d4 None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:42:49.898098 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3225cd07-caf7-4077-9736-34e893e424d4 None None] PATH_INFO: `/` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:42:49.900038 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 664/1309] 10.222.0.58 () {54 vars in 926 bytes} [Tue Oct 12 16:42:49 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:42:49.907830 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c35a22-d7c4-4852-9c93-58d64af27389 None None] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:42:49.908641 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c35a22-d7c4-4852-9c93-58d64af27389 None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:42:49.908991 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c35a22-d7c4-4852-9c93-58d64af27389 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:42:49.927508 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.auth.core [None req-21c35a22-d7c4-4852-9c93-58d64af27389 None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:42:49.929319 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-21c35a22-d7c4-4852-9c93-58d64af27389 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:42:49.937920 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 646/1310] 10.222.0.58 () {58 vars in 1023 bytes} [Tue Oct 12 16:42:49 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:42:49.984059 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3225cd07-caf7-4077-9736-34e893e424d4 None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:42:49.999423 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3225cd07-caf7-4077-9736-34e893e424d4 None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:42:50.005028 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb2f8b5-6703-4e3f-8de5-ae198d6842d8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29d30b574eec4ad3990d77d235c8b424', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:42:50.005658 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb2f8b5-6703-4e3f-8de5-ae198d6842d8 service nova] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:42:50.005967 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb2f8b5-6703-4e3f-8de5-ae198d6842d8 service nova] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:42:50.006242 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb2f8b5-6703-4e3f-8de5-ae198d6842d8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:42:50.014297 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb2f8b5-6703-4e3f-8de5-ae198d6842d8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:42:50.018085 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb2f8b5-6703-4e3f-8de5-ae198d6842d8 service nova] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:42:50.025927 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 665/1311] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Oct 12 16:42:49 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:43:04.235069 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fee9ffb-7242-4445-90eb-eb6238df221f None None] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:43:04.235617 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fee9ffb-7242-4445-90eb-eb6238df221f None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:43:04.235719 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fee9ffb-7242-4445-90eb-eb6238df221f None None] PATH_INFO: `/` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:43:04.237415 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 647/1312] 10.222.0.58 () {54 vars in 926 bytes} [Tue Oct 12 16:43:04 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:43:04.243951 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88a3dfe-64f8-43a4-9c82-350b106868ad None None] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:43:04.244391 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88a3dfe-64f8-43a4-9c82-350b106868ad None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:43:04.244506 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88a3dfe-64f8-43a4-9c82-350b106868ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:43:04.261763 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.auth.core [None req-a88a3dfe-64f8-43a4-9c82-350b106868ad None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:43:04.262975 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-a88a3dfe-64f8-43a4-9c82-350b106868ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:43:04.270809 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 666/1313] 10.222.0.58 () {58 vars in 1023 bytes} [Tue Oct 12 16:43:04 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:43:04.294641 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fee9ffb-7242-4445-90eb-eb6238df221f None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:43:04.307644 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fee9ffb-7242-4445-90eb-eb6238df221f None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:43:04.312122 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0806ef-cc35-4e4c-abe5-abcf04b03e56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:43:04.312757 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0806ef-cc35-4e4c-abe5-abcf04b03e56 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:43:04.313038 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0806ef-cc35-4e4c-abe5-abcf04b03e56 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:43:04.313310 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0806ef-cc35-4e4c-abe5-abcf04b03e56 admin admin] PATH_INFO: `/v3/projects` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:43:04.314118 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0806ef-cc35-4e4c-abe5-abcf04b03e56 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:43:04.315962 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0806ef-cc35-4e4c-abe5-abcf04b03e56 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:43:04.334141 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 648/1314] 10.222.0.58 () {56 vars in 1108 bytes} [Tue Oct 12 16:43:04 2021] GET /identity/v3/projects => generated 2553 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:43:06.519024 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afa9a37-5f34-4dce-b337-822717f419ac None None] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:43:06.519652 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afa9a37-5f34-4dce-b337-822717f419ac None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:43:06.519652 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afa9a37-5f34-4dce-b337-822717f419ac None None] PATH_INFO: `/` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:43:06.521315 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 667/1315] 10.222.0.58 () {54 vars in 926 bytes} [Tue Oct 12 16:43:06 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:43:06.527295 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dbc708-5700-4764-8707-5f371160ea17 None None] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:43:06.527734 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dbc708-5700-4764-8707-5f371160ea17 None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:43:06.527844 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dbc708-5700-4764-8707-5f371160ea17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:43:06.545688 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.auth.core [None req-98dbc708-5700-4764-8707-5f371160ea17 None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:43:06.546900 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-98dbc708-5700-4764-8707-5f371160ea17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:43:06.554555 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 649/1316] 10.222.0.58 () {58 vars in 1023 bytes} [Tue Oct 12 16:43:06 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:43:06.577800 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afa9a37-5f34-4dce-b337-822717f419ac None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:43:06.590230 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afa9a37-5f34-4dce-b337-822717f419ac None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:43:06.594571 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02aaadee-b58f-4f79-b268-684a05f15b10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:43:06.595385 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02aaadee-b58f-4f79-b268-684a05f15b10 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:43:06.595662 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02aaadee-b58f-4f79-b268-684a05f15b10 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:43:06.595928 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02aaadee-b58f-4f79-b268-684a05f15b10 admin admin] PATH_INFO: `/v3/projects/0e02c6f40aa0446b8745907c5f4d05eb` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:43:06.606713 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02aaadee-b58f-4f79-b268-684a05f15b10 admin admin] RBAC: Authorizing `identity:get_project(project_id=0e02c6f40aa0446b8745907c5f4d05eb)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:43:06.608726 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02aaadee-b58f-4f79-b268-684a05f15b10 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:43:06.610394 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 668/1317] 10.222.0.58 () {56 vars in 1207 bytes} [Tue Oct 12 16:43:06 2021] GET /identity/v3/projects/0e02c6f40aa0446b8745907c5f4d05eb => generated 311 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:43:06.616641 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98dbc708-5700-4764-8707-5f371160ea17 None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:43:06.625928 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98dbc708-5700-4764-8707-5f371160ea17 None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:43:06.630422 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e388738-7f30-4cf0-9f7a-30265d675ff5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:43:06.631049 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e388738-7f30-4cf0-9f7a-30265d675ff5 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:43:06.631328 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e388738-7f30-4cf0-9f7a-30265d675ff5 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:43:06.631598 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e388738-7f30-4cf0-9f7a-30265d675ff5 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:43:06.632395 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e388738-7f30-4cf0-9f7a-30265d675ff5 admin admin] RBAC: Adding query filter params (scope.project.id=0e02c6f40aa0446b8745907c5f4d05eb) {{(pid=85205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:43:06.632699 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e388738-7f30-4cf0-9f7a-30265d675ff5 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:43:06.634532 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e388738-7f30-4cf0-9f7a-30265d675ff5 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:43:06.641023 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 650/1318] 10.222.0.58 () {56 vars in 1231 bytes} [Tue Oct 12 16:43:06 2021] GET /identity/v3/role_assignments?scope.project.id=0e02c6f40aa0446b8745907c5f4d05eb => generated 877 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:43:06.647150 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02aaadee-b58f-4f79-b268-684a05f15b10 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:43:06.661096 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02aaadee-b58f-4f79-b268-684a05f15b10 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:43:06.666825 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388e0ef6-84bf-44a7-bc14-9983071e32e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:43:06.667715 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388e0ef6-84bf-44a7-bc14-9983071e32e4 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:43:06.667992 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388e0ef6-84bf-44a7-bc14-9983071e32e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:43:06.668261 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388e0ef6-84bf-44a7-bc14-9983071e32e4 admin admin] PATH_INFO: `/v3/users/3e78421f32bd45d7bca3b280d9b2ac9a` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:43:06.682021 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388e0ef6-84bf-44a7-bc14-9983071e32e4 admin admin] RBAC: Authorizing `identity:get_user(user_id=3e78421f32bd45d7bca3b280d9b2ac9a)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:43:06.684157 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388e0ef6-84bf-44a7-bc14-9983071e32e4 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:43:06.685768 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 669/1319] 10.222.0.58 () {56 vars in 1198 bytes} [Tue Oct 12 16:43:06 2021] GET /identity/v3/users/3e78421f32bd45d7bca3b280d9b2ac9a => generated 285 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:43:06.692058 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e388738-7f30-4cf0-9f7a-30265d675ff5 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:43:06.701477 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e388738-7f30-4cf0-9f7a-30265d675ff5 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:43:06.706235 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08235641-cf5b-4dd7-946e-99cb48c2c55d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:43:06.707100 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08235641-cf5b-4dd7-946e-99cb48c2c55d admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:43:06.707379 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08235641-cf5b-4dd7-946e-99cb48c2c55d admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:43:06.707650 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08235641-cf5b-4dd7-946e-99cb48c2c55d admin admin] PATH_INFO: `/v3/users/a281f63371c54748b4003d341895e37e` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:43:06.721169 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08235641-cf5b-4dd7-946e-99cb48c2c55d admin admin] RBAC: Authorizing `identity:get_user(user_id=a281f63371c54748b4003d341895e37e)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:43:06.723316 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08235641-cf5b-4dd7-946e-99cb48c2c55d admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:43:06.724915 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 651/1320] 10.222.0.58 () {56 vars in 1198 bytes} [Tue Oct 12 16:43:06 2021] GET /identity/v3/users/a281f63371c54748b4003d341895e37e => generated 286 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:43:09.019226 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08a6669-d626-4a18-8c1b-8399714622d8 None None] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:43:09.019655 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08a6669-d626-4a18-8c1b-8399714622d8 None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:43:09.019760 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08a6669-d626-4a18-8c1b-8399714622d8 None None] PATH_INFO: `/` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:43:09.021511 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 670/1321] 10.222.0.58 () {54 vars in 926 bytes} [Tue Oct 12 16:43:09 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:43:09.027959 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab990ff-7c96-40ab-a9fe-63bf34e5641b None None] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:43:09.028374 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab990ff-7c96-40ab-a9fe-63bf34e5641b None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:43:09.028548 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab990ff-7c96-40ab-a9fe-63bf34e5641b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:43:09.046173 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.auth.core [None req-bab990ff-7c96-40ab-a9fe-63bf34e5641b None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:43:09.047358 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-bab990ff-7c96-40ab-a9fe-63bf34e5641b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:43:09.054986 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 652/1322] 10.222.0.58 () {58 vars in 1023 bytes} [Tue Oct 12 16:43:09 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:43:09.078175 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08a6669-d626-4a18-8c1b-8399714622d8 None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:43:09.090991 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08a6669-d626-4a18-8c1b-8399714622d8 None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:43:09.095775 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2ef537-2507-48cc-8b24-d78c275f8872 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:43:09.096599 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2ef537-2507-48cc-8b24-d78c275f8872 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:43:09.096877 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2ef537-2507-48cc-8b24-d78c275f8872 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:43:09.097148 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2ef537-2507-48cc-8b24-d78c275f8872 admin admin] PATH_INFO: `/v3/projects/1415d5493e784eb7919162a50f191476` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:43:09.108150 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2ef537-2507-48cc-8b24-d78c275f8872 admin admin] RBAC: Authorizing `identity:get_project(project_id=1415d5493e784eb7919162a50f191476)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:43:09.110196 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2ef537-2507-48cc-8b24-d78c275f8872 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:43:09.111840 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 671/1323] 10.222.0.58 () {56 vars in 1207 bytes} [Tue Oct 12 16:43:09 2021] GET /identity/v3/projects/1415d5493e784eb7919162a50f191476 => generated 312 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:43:09.118332 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab990ff-7c96-40ab-a9fe-63bf34e5641b None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:43:09.127154 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab990ff-7c96-40ab-a9fe-63bf34e5641b None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:43:09.131695 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a506397-bbf8-4536-9f6e-d6fc79eb1446 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:43:09.132324 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a506397-bbf8-4536-9f6e-d6fc79eb1446 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:43:09.132608 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a506397-bbf8-4536-9f6e-d6fc79eb1446 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:43:09.132884 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a506397-bbf8-4536-9f6e-d6fc79eb1446 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:43:09.133654 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a506397-bbf8-4536-9f6e-d6fc79eb1446 admin admin] RBAC: Adding query filter params (scope.project.id=1415d5493e784eb7919162a50f191476) {{(pid=85205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:43:09.134003 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a506397-bbf8-4536-9f6e-d6fc79eb1446 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:43:09.135807 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a506397-bbf8-4536-9f6e-d6fc79eb1446 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:43:09.140936 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 653/1324] 10.222.0.58 () {56 vars in 1231 bytes} [Tue Oct 12 16:43:09 2021] GET /identity/v3/role_assignments?scope.project.id=1415d5493e784eb7919162a50f191476 => generated 526 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:43:09.147001 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2ef537-2507-48cc-8b24-d78c275f8872 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:43:09.156769 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2ef537-2507-48cc-8b24-d78c275f8872 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:43:09.161221 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9e62c1-0713-4318-8d06-3ee81094746c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:43:09.162074 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9e62c1-0713-4318-8d06-3ee81094746c admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:43:09.162356 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9e62c1-0713-4318-8d06-3ee81094746c admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:43:09.162629 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9e62c1-0713-4318-8d06-3ee81094746c admin admin] PATH_INFO: `/v3/users/3e3ad764755947d6af5bc63c40f75cda` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:43:09.176460 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9e62c1-0713-4318-8d06-3ee81094746c admin admin] RBAC: Authorizing `identity:get_user(user_id=3e3ad764755947d6af5bc63c40f75cda)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:43:09.178598 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9e62c1-0713-4318-8d06-3ee81094746c admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:43:09.180286 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 672/1325] 10.222.0.58 () {56 vars in 1198 bytes} [Tue Oct 12 16:43:09 2021] GET /identity/v3/users/3e3ad764755947d6af5bc63c40f75cda => generated 275 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:43:11.440340 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc7eddd-fddf-4b3e-a76e-e400343eac50 None None] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:43:11.440905 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc7eddd-fddf-4b3e-a76e-e400343eac50 None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:43:11.441011 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc7eddd-fddf-4b3e-a76e-e400343eac50 None None] PATH_INFO: `/` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:43:11.442734 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 654/1326] 10.222.0.58 () {54 vars in 926 bytes} [Tue Oct 12 16:43:11 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:43:11.449057 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f059e66-acc2-48d9-b2ed-a9b005c63c13 None None] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:43:11.449529 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f059e66-acc2-48d9-b2ed-a9b005c63c13 None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:43:11.449629 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f059e66-acc2-48d9-b2ed-a9b005c63c13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:43:11.467542 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.auth.core [None req-1f059e66-acc2-48d9-b2ed-a9b005c63c13 None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:43:11.468733 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-1f059e66-acc2-48d9-b2ed-a9b005c63c13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:43:11.476473 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 673/1327] 10.222.0.58 () {58 vars in 1023 bytes} [Tue Oct 12 16:43:11 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:43:11.499538 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc7eddd-fddf-4b3e-a76e-e400343eac50 None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:43:11.511995 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc7eddd-fddf-4b3e-a76e-e400343eac50 None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:43:11.516397 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a75cc76-9702-48b8-bc9f-a17b6b095233 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:43:11.517218 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a75cc76-9702-48b8-bc9f-a17b6b095233 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:43:11.517495 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a75cc76-9702-48b8-bc9f-a17b6b095233 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:43:11.517763 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a75cc76-9702-48b8-bc9f-a17b6b095233 admin admin] PATH_INFO: `/v3/projects/2b6dd1730b03490493bf39ae8707f333` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:43:11.529104 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a75cc76-9702-48b8-bc9f-a17b6b095233 admin admin] RBAC: Authorizing `identity:get_project(project_id=2b6dd1730b03490493bf39ae8707f333)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:43:11.531193 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a75cc76-9702-48b8-bc9f-a17b6b095233 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:43:11.532834 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 655/1328] 10.222.0.58 () {56 vars in 1207 bytes} [Tue Oct 12 16:43:11 2021] GET /identity/v3/projects/2b6dd1730b03490493bf39ae8707f333 => generated 302 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:43:11.539059 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f059e66-acc2-48d9-b2ed-a9b005c63c13 None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:43:11.547824 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f059e66-acc2-48d9-b2ed-a9b005c63c13 None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:43:11.552354 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dcba51-8dd7-49ec-a9d2-98a80ad4dd45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:43:11.552981 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dcba51-8dd7-49ec-a9d2-98a80ad4dd45 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:43:11.553263 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dcba51-8dd7-49ec-a9d2-98a80ad4dd45 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:43:11.553538 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dcba51-8dd7-49ec-a9d2-98a80ad4dd45 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:43:11.554342 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2dcba51-8dd7-49ec-a9d2-98a80ad4dd45 admin admin] RBAC: Adding query filter params (scope.project.id=2b6dd1730b03490493bf39ae8707f333) {{(pid=85204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:43:11.554658 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2dcba51-8dd7-49ec-a9d2-98a80ad4dd45 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:43:11.556497 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2dcba51-8dd7-49ec-a9d2-98a80ad4dd45 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:43:11.563898 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 674/1329] 10.222.0.58 () {56 vars in 1231 bytes} [Tue Oct 12 16:43:11 2021] GET /identity/v3/role_assignments?scope.project.id=2b6dd1730b03490493bf39ae8707f333 => generated 1934 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:43:11.570034 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a75cc76-9702-48b8-bc9f-a17b6b095233 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:43:11.580060 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a75cc76-9702-48b8-bc9f-a17b6b095233 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:43:11.584731 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80fe4dd-bd96-4d3f-9958-8edb80863cb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:43:11.585569 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80fe4dd-bd96-4d3f-9958-8edb80863cb9 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:43:11.585855 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80fe4dd-bd96-4d3f-9958-8edb80863cb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:43:11.586164 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80fe4dd-bd96-4d3f-9958-8edb80863cb9 admin admin] PATH_INFO: `/v3/users/36547cd3c64e4501b62c6e4de1b5c0a8` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:43:11.600750 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80fe4dd-bd96-4d3f-9958-8edb80863cb9 admin admin] RBAC: Authorizing `identity:get_user(user_id=36547cd3c64e4501b62c6e4de1b5c0a8)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:43:11.602878 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80fe4dd-bd96-4d3f-9958-8edb80863cb9 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:43:11.604466 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 656/1330] 10.222.0.58 () {56 vars in 1198 bytes} [Tue Oct 12 16:43:11 2021] GET /identity/v3/users/36547cd3c64e4501b62c6e4de1b5c0a8 => generated 283 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:43:11.610462 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dcba51-8dd7-49ec-a9d2-98a80ad4dd45 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:43:11.619796 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dcba51-8dd7-49ec-a9d2-98a80ad4dd45 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:43:11.624244 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26fb1b5-ea1f-45d4-9e33-687a5b91292b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:43:11.625085 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26fb1b5-ea1f-45d4-9e33-687a5b91292b admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:43:11.625373 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26fb1b5-ea1f-45d4-9e33-687a5b91292b admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:43:11.625652 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26fb1b5-ea1f-45d4-9e33-687a5b91292b admin admin] PATH_INFO: `/v3/users/296f95d6453b448dad63081ef9a200d3` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:43:11.626871 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26fb1b5-ea1f-45d4-9e33-687a5b91292b admin admin] RBAC: Authorizing `identity:get_user(user_id=296f95d6453b448dad63081ef9a200d3)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:43:11.628630 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26fb1b5-ea1f-45d4-9e33-687a5b91292b admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:43:11.630275 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 675/1331] 10.222.0.58 () {56 vars in 1198 bytes} [Tue Oct 12 16:43:11 2021] GET /identity/v3/users/296f95d6453b448dad63081ef9a200d3 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:43:13.930938 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f6012c-47e6-4453-9eb9-20d742a5597e None None] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:43:13.931486 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f6012c-47e6-4453-9eb9-20d742a5597e None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:43:13.931486 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f6012c-47e6-4453-9eb9-20d742a5597e None None] PATH_INFO: `/` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:43:13.933261 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 657/1332] 10.222.0.58 () {54 vars in 926 bytes} [Tue Oct 12 16:43:13 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:43:13.939127 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115d64b2-988d-4899-8fd3-90c51dcc8dae None None] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:43:13.939714 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115d64b2-988d-4899-8fd3-90c51dcc8dae None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:43:13.939714 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115d64b2-988d-4899-8fd3-90c51dcc8dae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:43:13.957592 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.auth.core [None req-115d64b2-988d-4899-8fd3-90c51dcc8dae None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:43:13.958809 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-115d64b2-988d-4899-8fd3-90c51dcc8dae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:43:13.967318 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 676/1333] 10.222.0.58 () {58 vars in 1023 bytes} [Tue Oct 12 16:43:13 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:43:13.990054 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f6012c-47e6-4453-9eb9-20d742a5597e None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:43:14.002000 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f6012c-47e6-4453-9eb9-20d742a5597e None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:43:14.006396 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3eb2a2-95ea-4d70-ba90-267e0496cd63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:43:14.007219 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3eb2a2-95ea-4d70-ba90-267e0496cd63 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:43:14.007500 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3eb2a2-95ea-4d70-ba90-267e0496cd63 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:43:14.007774 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3eb2a2-95ea-4d70-ba90-267e0496cd63 admin admin] PATH_INFO: `/v3/projects/78966be562ca4918a5e25eac86ccd8ab` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:43:14.018472 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3eb2a2-95ea-4d70-ba90-267e0496cd63 admin admin] RBAC: Authorizing `identity:get_project(project_id=78966be562ca4918a5e25eac86ccd8ab)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:43:14.020746 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3eb2a2-95ea-4d70-ba90-267e0496cd63 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:43:14.022425 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 658/1334] 10.222.0.58 () {56 vars in 1207 bytes} [Tue Oct 12 16:43:13 2021] GET /identity/v3/projects/78966be562ca4918a5e25eac86ccd8ab => generated 298 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:43:14.029144 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115d64b2-988d-4899-8fd3-90c51dcc8dae None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:43:14.037938 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115d64b2-988d-4899-8fd3-90c51dcc8dae None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:43:14.042408 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f625ea62-c0a5-47b0-80a1-0e16e6091304 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:43:14.043036 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f625ea62-c0a5-47b0-80a1-0e16e6091304 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:43:14.043315 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f625ea62-c0a5-47b0-80a1-0e16e6091304 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:43:14.043585 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f625ea62-c0a5-47b0-80a1-0e16e6091304 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:43:14.044348 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f625ea62-c0a5-47b0-80a1-0e16e6091304 admin admin] RBAC: Adding query filter params (scope.project.id=78966be562ca4918a5e25eac86ccd8ab) {{(pid=85204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:43:14.044652 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f625ea62-c0a5-47b0-80a1-0e16e6091304 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:43:14.046488 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f625ea62-c0a5-47b0-80a1-0e16e6091304 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:43:14.052871 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 677/1335] 10.222.0.58 () {56 vars in 1231 bytes} [Tue Oct 12 16:43:14 2021] GET /identity/v3/role_assignments?scope.project.id=78966be562ca4918a5e25eac86ccd8ab => generated 1934 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:43:14.059612 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3eb2a2-95ea-4d70-ba90-267e0496cd63 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:43:14.069858 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3eb2a2-95ea-4d70-ba90-267e0496cd63 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:43:14.074966 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14aba8a5-4aad-40f6-9266-ec6e6ab8d992 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:43:14.075799 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14aba8a5-4aad-40f6-9266-ec6e6ab8d992 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:43:14.076077 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14aba8a5-4aad-40f6-9266-ec6e6ab8d992 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:43:14.076352 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14aba8a5-4aad-40f6-9266-ec6e6ab8d992 admin admin] PATH_INFO: `/v3/users/3e3ad764755947d6af5bc63c40f75cda` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:43:14.077538 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14aba8a5-4aad-40f6-9266-ec6e6ab8d992 admin admin] RBAC: Authorizing `identity:get_user(user_id=3e3ad764755947d6af5bc63c40f75cda)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:43:14.079636 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14aba8a5-4aad-40f6-9266-ec6e6ab8d992 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:43:14.081197 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 659/1336] 10.222.0.58 () {56 vars in 1198 bytes} [Tue Oct 12 16:43:14 2021] GET /identity/v3/users/3e3ad764755947d6af5bc63c40f75cda => generated 275 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:43:14.087229 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f625ea62-c0a5-47b0-80a1-0e16e6091304 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:43:14.096468 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f625ea62-c0a5-47b0-80a1-0e16e6091304 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:43:14.100960 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a41ad81-6a09-47e5-a47a-469a5afd4ca6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:43:14.101778 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a41ad81-6a09-47e5-a47a-469a5afd4ca6 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:43:14.102084 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a41ad81-6a09-47e5-a47a-469a5afd4ca6 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:43:14.102373 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a41ad81-6a09-47e5-a47a-469a5afd4ca6 admin admin] PATH_INFO: `/v3/users/296f95d6453b448dad63081ef9a200d3` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:43:14.103580 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a41ad81-6a09-47e5-a47a-469a5afd4ca6 admin admin] RBAC: Authorizing `identity:get_user(user_id=296f95d6453b448dad63081ef9a200d3)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:43:14.105331 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a41ad81-6a09-47e5-a47a-469a5afd4ca6 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:43:14.106879 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 678/1337] 10.222.0.58 () {56 vars in 1198 bytes} [Tue Oct 12 16:43:14 2021] GET /identity/v3/users/296f95d6453b448dad63081ef9a200d3 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:43:16.405329 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6905e4f-f1b5-4c14-909d-fc980a500361 None None] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:43:16.405906 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6905e4f-f1b5-4c14-909d-fc980a500361 None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:43:16.405906 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6905e4f-f1b5-4c14-909d-fc980a500361 None None] PATH_INFO: `/` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:43:16.407706 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 660/1338] 10.222.0.58 () {54 vars in 926 bytes} [Tue Oct 12 16:43:16 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:43:16.413656 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44f9d52-9233-4b25-85c5-708174e5d610 None None] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:43:16.414081 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44f9d52-9233-4b25-85c5-708174e5d610 None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:43:16.414241 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44f9d52-9233-4b25-85c5-708174e5d610 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:43:16.432060 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.auth.core [None req-d44f9d52-9233-4b25-85c5-708174e5d610 None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:43:16.433223 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-d44f9d52-9233-4b25-85c5-708174e5d610 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:43:16.441157 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 679/1339] 10.222.0.58 () {58 vars in 1023 bytes} [Tue Oct 12 16:43:16 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:43:16.465122 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6905e4f-f1b5-4c14-909d-fc980a500361 None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:43:16.477332 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6905e4f-f1b5-4c14-909d-fc980a500361 None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:43:16.482264 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c439994e-3265-47ab-b469-c38e2c91c719 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:43:16.483088 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c439994e-3265-47ab-b469-c38e2c91c719 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:43:16.483365 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c439994e-3265-47ab-b469-c38e2c91c719 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:43:16.483637 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c439994e-3265-47ab-b469-c38e2c91c719 admin admin] PATH_INFO: `/v3/projects/7ad5e168316c4f9495f58192944eaf86` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:43:16.494172 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c439994e-3265-47ab-b469-c38e2c91c719 admin admin] RBAC: Authorizing `identity:get_project(project_id=7ad5e168316c4f9495f58192944eaf86)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:43:16.496180 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c439994e-3265-47ab-b469-c38e2c91c719 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:43:16.497825 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 661/1340] 10.222.0.58 () {56 vars in 1207 bytes} [Tue Oct 12 16:43:16 2021] GET /identity/v3/projects/7ad5e168316c4f9495f58192944eaf86 => generated 311 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:43:16.504244 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44f9d52-9233-4b25-85c5-708174e5d610 None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:43:16.513356 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44f9d52-9233-4b25-85c5-708174e5d610 None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:43:16.517817 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb12c375-ecc9-48d7-bae3-b68c15a73057 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:43:16.518483 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb12c375-ecc9-48d7-bae3-b68c15a73057 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:43:16.518758 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb12c375-ecc9-48d7-bae3-b68c15a73057 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:43:16.519025 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb12c375-ecc9-48d7-bae3-b68c15a73057 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:43:16.520049 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb12c375-ecc9-48d7-bae3-b68c15a73057 admin admin] RBAC: Adding query filter params (scope.project.id=7ad5e168316c4f9495f58192944eaf86) {{(pid=85204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:43:16.520353 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb12c375-ecc9-48d7-bae3-b68c15a73057 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:43:16.522167 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb12c375-ecc9-48d7-bae3-b68c15a73057 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:43:16.527780 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 680/1341] 10.222.0.58 () {56 vars in 1231 bytes} [Tue Oct 12 16:43:16 2021] GET /identity/v3/role_assignments?scope.project.id=7ad5e168316c4f9495f58192944eaf86 => generated 526 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:43:16.533756 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c439994e-3265-47ab-b469-c38e2c91c719 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:43:16.543734 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c439994e-3265-47ab-b469-c38e2c91c719 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:43:16.548230 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcfc97d-690d-425a-9ba7-49e205dfef79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:43:16.549056 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcfc97d-690d-425a-9ba7-49e205dfef79 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:43:16.549365 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcfc97d-690d-425a-9ba7-49e205dfef79 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:43:16.549638 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcfc97d-690d-425a-9ba7-49e205dfef79 admin admin] PATH_INFO: `/v3/users/73e2d657af2e4c94b01fd3fdc6e8e341` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:43:16.562992 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcfc97d-690d-425a-9ba7-49e205dfef79 admin admin] RBAC: Authorizing `identity:get_user(user_id=73e2d657af2e4c94b01fd3fdc6e8e341)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:43:16.565078 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcfc97d-690d-425a-9ba7-49e205dfef79 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:43:16.566738 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 662/1342] 10.222.0.58 () {56 vars in 1198 bytes} [Tue Oct 12 16:43:16 2021] GET /identity/v3/users/73e2d657af2e4c94b01fd3fdc6e8e341 => generated 286 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:43:18.819545 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2804a6f4-1295-4fba-88c8-79c42803c1cb None None] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:43:18.820097 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2804a6f4-1295-4fba-88c8-79c42803c1cb None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:43:18.820199 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2804a6f4-1295-4fba-88c8-79c42803c1cb None None] PATH_INFO: `/` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:43:18.821956 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 681/1343] 10.222.0.58 () {54 vars in 926 bytes} [Tue Oct 12 16:43:18 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:43:18.827884 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31353614-959c-4835-ad0c-a422c1cdb5e2 None None] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:43:18.828296 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31353614-959c-4835-ad0c-a422c1cdb5e2 None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:43:18.828443 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31353614-959c-4835-ad0c-a422c1cdb5e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:43:18.846676 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.auth.core [None req-31353614-959c-4835-ad0c-a422c1cdb5e2 None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:43:18.847867 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-31353614-959c-4835-ad0c-a422c1cdb5e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:43:18.856526 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 663/1344] 10.222.0.58 () {58 vars in 1023 bytes} [Tue Oct 12 16:43:18 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:43:18.880193 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2804a6f4-1295-4fba-88c8-79c42803c1cb None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:43:18.892149 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2804a6f4-1295-4fba-88c8-79c42803c1cb None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:43:18.896734 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a46942-b3f5-4346-9a67-f43221d15a5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:43:18.897561 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a46942-b3f5-4346-9a67-f43221d15a5d admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:43:18.897846 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a46942-b3f5-4346-9a67-f43221d15a5d admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:43:18.898179 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a46942-b3f5-4346-9a67-f43221d15a5d admin admin] PATH_INFO: `/v3/projects/7ce3537317ae47bda54936a55a7d765e` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:43:18.899342 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a46942-b3f5-4346-9a67-f43221d15a5d admin admin] RBAC: Authorizing `identity:get_project(project_id=7ce3537317ae47bda54936a55a7d765e)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:43:18.901595 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a46942-b3f5-4346-9a67-f43221d15a5d admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:43:18.903240 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 682/1345] 10.222.0.58 () {56 vars in 1207 bytes} [Tue Oct 12 16:43:18 2021] GET /identity/v3/projects/7ce3537317ae47bda54936a55a7d765e => generated 344 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:43:18.909469 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31353614-959c-4835-ad0c-a422c1cdb5e2 None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:43:18.918953 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31353614-959c-4835-ad0c-a422c1cdb5e2 None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:43:18.923488 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89dabbe9-42ae-4d96-bd56-d7f28fcc712e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:43:18.924114 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dabbe9-42ae-4d96-bd56-d7f28fcc712e admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:43:18.924392 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dabbe9-42ae-4d96-bd56-d7f28fcc712e admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:43:18.924664 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dabbe9-42ae-4d96-bd56-d7f28fcc712e admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:43:18.925430 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89dabbe9-42ae-4d96-bd56-d7f28fcc712e admin admin] RBAC: Adding query filter params (scope.project.id=7ce3537317ae47bda54936a55a7d765e) {{(pid=85205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:43:18.925736 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89dabbe9-42ae-4d96-bd56-d7f28fcc712e admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:43:18.927593 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89dabbe9-42ae-4d96-bd56-d7f28fcc712e admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:43:18.933193 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 664/1346] 10.222.0.58 () {56 vars in 1231 bytes} [Tue Oct 12 16:43:18 2021] GET /identity/v3/role_assignments?scope.project.id=7ce3537317ae47bda54936a55a7d765e => generated 879 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 16:43:18.939332 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a46942-b3f5-4346-9a67-f43221d15a5d admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:43:18.949115 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a46942-b3f5-4346-9a67-f43221d15a5d admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:43:18.953664 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9b9c2e-856e-45a0-b7de-27a0f5152eea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:43:18.954512 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9b9c2e-856e-45a0-b7de-27a0f5152eea admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:43:18.954792 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9b9c2e-856e-45a0-b7de-27a0f5152eea admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:43:18.955064 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9b9c2e-856e-45a0-b7de-27a0f5152eea admin admin] PATH_INFO: `/v3/users/296f95d6453b448dad63081ef9a200d3` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:43:18.956253 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9b9c2e-856e-45a0-b7de-27a0f5152eea admin admin] RBAC: Authorizing `identity:get_user(user_id=296f95d6453b448dad63081ef9a200d3)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:43:18.958022 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9b9c2e-856e-45a0-b7de-27a0f5152eea admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:43:18.959539 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 683/1347] 10.222.0.58 () {56 vars in 1198 bytes} [Tue Oct 12 16:43:18 2021] GET /identity/v3/users/296f95d6453b448dad63081ef9a200d3 => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:43:21.233993 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f619f9d8-0a79-4121-8bda-31d239db4b5f None None] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:43:21.234508 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f619f9d8-0a79-4121-8bda-31d239db4b5f None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:43:21.234615 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f619f9d8-0a79-4121-8bda-31d239db4b5f None None] PATH_INFO: `/` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:43:21.236366 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 665/1348] 10.222.0.58 () {54 vars in 926 bytes} [Tue Oct 12 16:43:21 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:43:21.242301 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8edf52f-fdee-4d7d-9762-b65bbc8bc4c0 None None] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:43:21.242699 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8edf52f-fdee-4d7d-9762-b65bbc8bc4c0 None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:43:21.242855 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8edf52f-fdee-4d7d-9762-b65bbc8bc4c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:43:21.260869 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.auth.core [None req-b8edf52f-fdee-4d7d-9762-b65bbc8bc4c0 None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:43:21.262155 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-b8edf52f-fdee-4d7d-9762-b65bbc8bc4c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:43:21.269733 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 684/1349] 10.222.0.58 () {58 vars in 1023 bytes} [Tue Oct 12 16:43:21 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:43:21.293611 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f619f9d8-0a79-4121-8bda-31d239db4b5f None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:43:21.306181 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f619f9d8-0a79-4121-8bda-31d239db4b5f None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:43:21.311020 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce112bb-0170-47de-aeac-49e6ab8852dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:43:21.311844 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce112bb-0170-47de-aeac-49e6ab8852dd admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:43:21.312122 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce112bb-0170-47de-aeac-49e6ab8852dd admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:43:21.312393 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce112bb-0170-47de-aeac-49e6ab8852dd admin admin] PATH_INFO: `/v3/projects/86a7296e12774eb79f28fb849849c792` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:43:21.323529 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce112bb-0170-47de-aeac-49e6ab8852dd admin admin] RBAC: Authorizing `identity:get_project(project_id=86a7296e12774eb79f28fb849849c792)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:43:21.325531 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce112bb-0170-47de-aeac-49e6ab8852dd admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:43:21.327230 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 666/1350] 10.222.0.58 () {56 vars in 1207 bytes} [Tue Oct 12 16:43:21 2021] GET /identity/v3/projects/86a7296e12774eb79f28fb849849c792 => generated 361 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:43:21.333761 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8edf52f-fdee-4d7d-9762-b65bbc8bc4c0 None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:43:21.343297 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8edf52f-fdee-4d7d-9762-b65bbc8bc4c0 None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:43:21.347791 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c98f26-bebe-4512-9b08-e50c1e3c5c95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:43:21.348424 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c98f26-bebe-4512-9b08-e50c1e3c5c95 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:43:21.348708 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c98f26-bebe-4512-9b08-e50c1e3c5c95 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:43:21.348981 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c98f26-bebe-4512-9b08-e50c1e3c5c95 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:43:21.349747 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c98f26-bebe-4512-9b08-e50c1e3c5c95 admin admin] RBAC: Adding query filter params (scope.project.id=86a7296e12774eb79f28fb849849c792) {{(pid=85204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:43:21.350085 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c98f26-bebe-4512-9b08-e50c1e3c5c95 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:43:21.351893 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c98f26-bebe-4512-9b08-e50c1e3c5c95 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:43:21.357544 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 685/1351] 10.222.0.58 () {56 vars in 1231 bytes} [Tue Oct 12 16:43:21 2021] GET /identity/v3/role_assignments?scope.project.id=86a7296e12774eb79f28fb849849c792 => generated 526 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:43:21.363842 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce112bb-0170-47de-aeac-49e6ab8852dd admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:43:21.373293 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce112bb-0170-47de-aeac-49e6ab8852dd admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:43:21.377744 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978125fa-c12b-4fdc-b49b-d8a7685c4720 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:43:21.378619 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978125fa-c12b-4fdc-b49b-d8a7685c4720 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:43:21.378905 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978125fa-c12b-4fdc-b49b-d8a7685c4720 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:43:21.379178 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978125fa-c12b-4fdc-b49b-d8a7685c4720 admin admin] PATH_INFO: `/v3/users/09cf1469c56643048ecf9c7d3f71e3cb` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:43:21.392962 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978125fa-c12b-4fdc-b49b-d8a7685c4720 admin admin] RBAC: Authorizing `identity:get_user(user_id=09cf1469c56643048ecf9c7d3f71e3cb)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:43:21.395094 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978125fa-c12b-4fdc-b49b-d8a7685c4720 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:43:21.396972 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 667/1352] 10.222.0.58 () {56 vars in 1198 bytes} [Tue Oct 12 16:43:21 2021] GET /identity/v3/users/09cf1469c56643048ecf9c7d3f71e3cb => generated 311 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:43:26.574946 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bd2a2d-c5ea-4e64-ac25-324ae740c04e None None] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:43:26.575542 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bd2a2d-c5ea-4e64-ac25-324ae740c04e None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:43:26.575542 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bd2a2d-c5ea-4e64-ac25-324ae740c04e None None] PATH_INFO: `/` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:43:26.577313 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 686/1353] 10.222.0.58 () {54 vars in 918 bytes} [Tue Oct 12 16:43:26 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:43:26.583052 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91177d1-4c69-4f8f-b5c6-8a2b2bcfe847 None None] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:43:26.583482 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91177d1-4c69-4f8f-b5c6-8a2b2bcfe847 None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:43:26.583590 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91177d1-4c69-4f8f-b5c6-8a2b2bcfe847 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:43:26.601244 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.auth.core [None req-f91177d1-4c69-4f8f-b5c6-8a2b2bcfe847 None None] MFA Rules not processed for user `4102412c40bc4745bba8c31f1caf9788`. Rule list: `[]` (Enabled: `True`). {{(pid=85205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:43:26.602466 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-f91177d1-4c69-4f8f-b5c6-8a2b2bcfe847 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:43:26.611082 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 668/1354] 10.222.0.58 () {58 vars in 1015 bytes} [Tue Oct 12 16:43:26 2021] POST /identity/v3/auth/tokens => generated 3451 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:43:26.625594 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c4e9da-0ef3-4b48-b60c-7c9c7d5bc05f None None] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:43:26.625896 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c4e9da-0ef3-4b48-b60c-7c9c7d5bc05f None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:43:26.626195 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c4e9da-0ef3-4b48-b60c-7c9c7d5bc05f None None] PATH_INFO: `/` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:43:26.627909 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 687/1355] 10.222.0.58 () {54 vars in 918 bytes} [Tue Oct 12 16:43:26 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:43:26.632801 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5628cb-4baa-4098-851d-eb76a2477ba2 None None] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:43:26.633089 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5628cb-4baa-4098-851d-eb76a2477ba2 None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:43:26.633366 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5628cb-4baa-4098-851d-eb76a2477ba2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:43:26.652119 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.auth.core [None req-4e5628cb-4baa-4098-851d-eb76a2477ba2 None None] MFA Rules not processed for user `29d30b574eec4ad3990d77d235c8b424`. Rule list: `[]` (Enabled: `True`). {{(pid=85205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:43:26.653281 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-4e5628cb-4baa-4098-851d-eb76a2477ba2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:43:26.662202 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 669/1356] 10.222.0.58 () {58 vars in 1015 bytes} [Tue Oct 12 16:43:26 2021] POST /identity/v3/auth/tokens => generated 3515 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:43:29.523996 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2b4efa-d80a-4074-90e0-b063ed9d078d None None] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:43:29.524694 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2b4efa-d80a-4074-90e0-b063ed9d078d None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:43:29.524694 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2b4efa-d80a-4074-90e0-b063ed9d078d None None] PATH_INFO: `/` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:43:29.526372 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 688/1357] 10.222.0.58 () {54 vars in 926 bytes} [Tue Oct 12 16:43:29 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:43:29.532190 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea970ed-7d02-484c-9dd8-b367240e5caa None None] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:43:29.532624 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea970ed-7d02-484c-9dd8-b367240e5caa None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:43:29.532772 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea970ed-7d02-484c-9dd8-b367240e5caa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:43:29.550844 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.auth.core [None req-dea970ed-7d02-484c-9dd8-b367240e5caa None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:43:29.552045 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-dea970ed-7d02-484c-9dd8-b367240e5caa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:43:29.560379 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 670/1358] 10.222.0.58 () {58 vars in 1023 bytes} [Tue Oct 12 16:43:29 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:43:29.603413 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2b4efa-d80a-4074-90e0-b063ed9d078d None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:43:29.617483 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2b4efa-d80a-4074-90e0-b063ed9d078d None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:43:29.623300 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c478607-0283-48cc-bdb7-8921b6e34400 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29d30b574eec4ad3990d77d235c8b424', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:43:29.623919 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c478607-0283-48cc-bdb7-8921b6e34400 service nova] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:43:29.624199 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c478607-0283-48cc-bdb7-8921b6e34400 service nova] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:43:29.624471 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c478607-0283-48cc-bdb7-8921b6e34400 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:43:29.632195 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c478607-0283-48cc-bdb7-8921b6e34400 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:43:29.633739 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c478607-0283-48cc-bdb7-8921b6e34400 service nova] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:43:29.643068 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 689/1359] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Oct 12 16:43:29 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:43:31.119991 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6d8ca5-6da4-4b9c-85a2-14e993bcfe39 None None] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:43:31.121006 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6d8ca5-6da4-4b9c-85a2-14e993bcfe39 None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:43:31.121006 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6d8ca5-6da4-4b9c-85a2-14e993bcfe39 None None] PATH_INFO: `/` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:43:31.122785 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 671/1360] 10.222.0.58 () {54 vars in 911 bytes} [Tue Oct 12 16:43:31 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:43:31.128182 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5602aca-8feb-4b8a-b51c-158961074f00 None None] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:43:31.128628 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5602aca-8feb-4b8a-b51c-158961074f00 None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:43:31.128733 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5602aca-8feb-4b8a-b51c-158961074f00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:43:31.146003 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.auth.core [None req-b5602aca-8feb-4b8a-b51c-158961074f00 None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:43:31.147448 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-b5602aca-8feb-4b8a-b51c-158961074f00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:43:31.155456 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 690/1361] 10.222.0.58 () {58 vars in 1008 bytes} [Tue Oct 12 16:43:31 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:43:31.306192 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6d8ca5-6da4-4b9c-85a2-14e993bcfe39 None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:43:31.320644 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6d8ca5-6da4-4b9c-85a2-14e993bcfe39 None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:43:31.325973 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a59dbf-be02-416f-aa11-24f032a35a32 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29d30b574eec4ad3990d77d235c8b424', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:43:31.326601 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a59dbf-be02-416f-aa11-24f032a35a32 service nova] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:43:31.326882 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a59dbf-be02-416f-aa11-24f032a35a32 service nova] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:43:31.327158 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a59dbf-be02-416f-aa11-24f032a35a32 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:43:31.334979 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a59dbf-be02-416f-aa11-24f032a35a32 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:43:31.336526 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a59dbf-be02-416f-aa11-24f032a35a32 service nova] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:43:31.346183 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 672/1362] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Oct 12 16:43:31 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:43:32.794333 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881dddf2-33c3-4182-afaf-bfad72d62870 None None] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:43:32.794891 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881dddf2-33c3-4182-afaf-bfad72d62870 None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:43:32.794891 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881dddf2-33c3-4182-afaf-bfad72d62870 None None] PATH_INFO: `/` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:43:32.796687 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 691/1363] 10.222.0.58 () {54 vars in 911 bytes} [Tue Oct 12 16:43:32 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:43:32.802283 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801b41e2-85c9-4772-9c9c-d501e728c9d7 None None] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:43:32.803015 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801b41e2-85c9-4772-9c9c-d501e728c9d7 None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:43:32.803015 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801b41e2-85c9-4772-9c9c-d501e728c9d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:43:32.822985 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.auth.core [None req-801b41e2-85c9-4772-9c9c-d501e728c9d7 None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:43:32.824192 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-801b41e2-85c9-4772-9c9c-d501e728c9d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:43:32.832127 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 673/1364] 10.222.0.58 () {58 vars in 1008 bytes} [Tue Oct 12 16:43:32 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:43:32.988493 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881dddf2-33c3-4182-afaf-bfad72d62870 None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:43:33.002505 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881dddf2-33c3-4182-afaf-bfad72d62870 None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:43:33.007762 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eba3cae-a72b-4a2f-a299-b4948749eaf2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29d30b574eec4ad3990d77d235c8b424', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:43:33.008386 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eba3cae-a72b-4a2f-a299-b4948749eaf2 service nova] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:43:33.008667 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eba3cae-a72b-4a2f-a299-b4948749eaf2 service nova] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:43:33.008937 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eba3cae-a72b-4a2f-a299-b4948749eaf2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:43:33.016938 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eba3cae-a72b-4a2f-a299-b4948749eaf2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:43:33.018536 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eba3cae-a72b-4a2f-a299-b4948749eaf2 service nova] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:43:33.028260 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 692/1365] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Oct 12 16:43:32 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:43:34.453606 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993a0fc2-d41d-4afc-b798-22b80108951c None None] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:43:34.454206 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993a0fc2-d41d-4afc-b798-22b80108951c None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:43:34.454206 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993a0fc2-d41d-4afc-b798-22b80108951c None None] PATH_INFO: `/` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:43:34.455983 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 674/1366] 10.222.0.58 () {54 vars in 911 bytes} [Tue Oct 12 16:43:34 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:43:34.461353 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060c57aa-e1a5-4b14-9565-ad3694b560d7 None None] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:43:34.461820 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060c57aa-e1a5-4b14-9565-ad3694b560d7 None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:43:34.461957 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060c57aa-e1a5-4b14-9565-ad3694b560d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:43:34.479042 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.auth.core [None req-060c57aa-e1a5-4b14-9565-ad3694b560d7 None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:43:34.480206 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-060c57aa-e1a5-4b14-9565-ad3694b560d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:43:34.487755 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 693/1367] 10.222.0.58 () {58 vars in 1008 bytes} [Tue Oct 12 16:43:34 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:43:34.639611 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993a0fc2-d41d-4afc-b798-22b80108951c None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:43:34.653799 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993a0fc2-d41d-4afc-b798-22b80108951c None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:43:34.661514 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03ced93-febf-4679-9dc7-245737afab67 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29d30b574eec4ad3990d77d235c8b424', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:43:34.662193 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03ced93-febf-4679-9dc7-245737afab67 service nova] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:43:34.662473 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03ced93-febf-4679-9dc7-245737afab67 service nova] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:43:34.662744 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03ced93-febf-4679-9dc7-245737afab67 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:43:34.674217 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03ced93-febf-4679-9dc7-245737afab67 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:43:34.675773 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03ced93-febf-4679-9dc7-245737afab67 service nova] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:43:34.685381 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 675/1368] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Oct 12 16:43:34 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:43:36.130359 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a36b8c-fdfa-45cb-bd72-1ed4c5dde710 None None] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:43:36.130884 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a36b8c-fdfa-45cb-bd72-1ed4c5dde710 None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:43:36.130884 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a36b8c-fdfa-45cb-bd72-1ed4c5dde710 None None] PATH_INFO: `/` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:43:36.132693 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 694/1369] 10.222.0.58 () {54 vars in 911 bytes} [Tue Oct 12 16:43:36 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:43:36.138544 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f451431-07a1-463c-af09-b8a34f0c77de None None] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:43:36.138954 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f451431-07a1-463c-af09-b8a34f0c77de None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:43:36.139118 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f451431-07a1-463c-af09-b8a34f0c77de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:43:36.157606 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.auth.core [None req-3f451431-07a1-463c-af09-b8a34f0c77de None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:43:36.158841 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-3f451431-07a1-463c-af09-b8a34f0c77de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:43:36.167443 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 676/1370] 10.222.0.58 () {58 vars in 1008 bytes} [Tue Oct 12 16:43:36 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:43:36.320744 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a36b8c-fdfa-45cb-bd72-1ed4c5dde710 None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:43:36.335750 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a36b8c-fdfa-45cb-bd72-1ed4c5dde710 None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:43:36.341658 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b48e17-a7c0-4048-b55f-024bbd30393d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29d30b574eec4ad3990d77d235c8b424', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:43:36.342400 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b48e17-a7c0-4048-b55f-024bbd30393d service nova] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:43:36.342755 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b48e17-a7c0-4048-b55f-024bbd30393d service nova] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:43:36.343093 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b48e17-a7c0-4048-b55f-024bbd30393d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:43:36.351510 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b48e17-a7c0-4048-b55f-024bbd30393d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:43:36.353104 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b48e17-a7c0-4048-b55f-024bbd30393d service nova] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:43:36.362797 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 695/1371] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Oct 12 16:43:36 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:43:37.730734 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b5af51-7c3b-4ca2-99a0-dd8ffbe631c1 None None] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:43:37.731278 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b5af51-7c3b-4ca2-99a0-dd8ffbe631c1 None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:43:37.731278 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b5af51-7c3b-4ca2-99a0-dd8ffbe631c1 None None] PATH_INFO: `/` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:43:37.733050 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 677/1372] 10.222.0.58 () {54 vars in 911 bytes} [Tue Oct 12 16:43:37 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:43:37.738695 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ea3e2d-5ae0-45b1-a736-bb8ed2e3ff2a None None] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:43:37.739089 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ea3e2d-5ae0-45b1-a736-bb8ed2e3ff2a None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:43:37.739278 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ea3e2d-5ae0-45b1-a736-bb8ed2e3ff2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:43:37.757390 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.auth.core [None req-79ea3e2d-5ae0-45b1-a736-bb8ed2e3ff2a None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:43:37.758598 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-79ea3e2d-5ae0-45b1-a736-bb8ed2e3ff2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:43:37.766385 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 696/1373] 10.222.0.58 () {58 vars in 1008 bytes} [Tue Oct 12 16:43:37 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:43:37.916943 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b5af51-7c3b-4ca2-99a0-dd8ffbe631c1 None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:43:37.931692 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b5af51-7c3b-4ca2-99a0-dd8ffbe631c1 None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:43:37.938517 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a39306-3edf-4dc3-9114-553e4b85589a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29d30b574eec4ad3990d77d235c8b424', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:43:37.939157 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a39306-3edf-4dc3-9114-553e4b85589a service nova] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:43:37.939437 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a39306-3edf-4dc3-9114-553e4b85589a service nova] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:43:37.939711 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a39306-3edf-4dc3-9114-553e4b85589a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:43:37.947946 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a39306-3edf-4dc3-9114-553e4b85589a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:43:37.949518 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a39306-3edf-4dc3-9114-553e4b85589a service nova] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:43:37.958546 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 678/1374] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Oct 12 16:43:37 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:43:39.389790 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeaeb52-3386-47ad-b3cd-d9489ad94427 None None] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:43:39.390379 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeaeb52-3386-47ad-b3cd-d9489ad94427 None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:43:39.390379 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeaeb52-3386-47ad-b3cd-d9489ad94427 None None] PATH_INFO: `/` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:43:39.392137 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 697/1375] 10.222.0.58 () {54 vars in 911 bytes} [Tue Oct 12 16:43:39 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:43:39.397603 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1f37f4-5c5d-452e-af39-d8a56967c322 None None] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:43:39.398287 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1f37f4-5c5d-452e-af39-d8a56967c322 None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:43:39.398491 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1f37f4-5c5d-452e-af39-d8a56967c322 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:43:39.415531 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.auth.core [None req-bf1f37f4-5c5d-452e-af39-d8a56967c322 None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:43:39.416709 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-bf1f37f4-5c5d-452e-af39-d8a56967c322 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:43:39.424871 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 679/1376] 10.222.0.58 () {58 vars in 1008 bytes} [Tue Oct 12 16:43:39 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:43:39.580927 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eeaeb52-3386-47ad-b3cd-d9489ad94427 None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:43:39.595395 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eeaeb52-3386-47ad-b3cd-d9489ad94427 None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:43:39.600833 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb78f5d-ab47-46da-8c78-b299eabec148 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29d30b574eec4ad3990d77d235c8b424', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:43:39.601464 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb78f5d-ab47-46da-8c78-b299eabec148 service nova] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:43:39.601752 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb78f5d-ab47-46da-8c78-b299eabec148 service nova] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:43:39.602068 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb78f5d-ab47-46da-8c78-b299eabec148 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:43:39.610651 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb78f5d-ab47-46da-8c78-b299eabec148 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:43:39.612213 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb78f5d-ab47-46da-8c78-b299eabec148 service nova] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:43:39.621341 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 698/1377] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Oct 12 16:43:39 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:43:40.998664 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8903765f-c4fd-4816-9d89-c702855b91f5 None None] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:43:40.999194 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8903765f-c4fd-4816-9d89-c702855b91f5 None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:43:40.999288 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8903765f-c4fd-4816-9d89-c702855b91f5 None None] PATH_INFO: `/` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:43:41.000986 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 680/1378] 10.222.0.58 () {54 vars in 911 bytes} [Tue Oct 12 16:43:40 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:43:41.006761 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cb73fc-4e37-4950-bc77-c9a303d981a8 None None] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:43:41.007132 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cb73fc-4e37-4950-bc77-c9a303d981a8 None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:43:41.007220 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cb73fc-4e37-4950-bc77-c9a303d981a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:43:41.025254 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.auth.core [None req-75cb73fc-4e37-4950-bc77-c9a303d981a8 None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:43:41.026456 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-75cb73fc-4e37-4950-bc77-c9a303d981a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:43:41.034622 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 699/1379] 10.222.0.58 () {58 vars in 1008 bytes} [Tue Oct 12 16:43:41 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:43:41.185085 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8903765f-c4fd-4816-9d89-c702855b91f5 None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:43:41.198924 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8903765f-c4fd-4816-9d89-c702855b91f5 None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:43:41.204848 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989dd011-3b67-4db3-9594-313ff2ab5027 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29d30b574eec4ad3990d77d235c8b424', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:43:41.205473 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989dd011-3b67-4db3-9594-313ff2ab5027 service nova] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:43:41.205754 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989dd011-3b67-4db3-9594-313ff2ab5027 service nova] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:43:41.206068 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989dd011-3b67-4db3-9594-313ff2ab5027 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:43:41.213858 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989dd011-3b67-4db3-9594-313ff2ab5027 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:43:41.215440 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989dd011-3b67-4db3-9594-313ff2ab5027 service nova] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:43:41.224457 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 681/1380] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Oct 12 16:43:41 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:43:42.608801 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6ad86a-330e-4abc-8882-ab5e6360c66c None None] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:43:42.609367 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6ad86a-330e-4abc-8882-ab5e6360c66c None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:43:42.609367 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6ad86a-330e-4abc-8882-ab5e6360c66c None None] PATH_INFO: `/` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:43:42.611136 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 700/1381] 10.222.0.58 () {54 vars in 911 bytes} [Tue Oct 12 16:43:42 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:43:42.617452 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be27d872-b077-4e9e-ba8e-7fc82c842dd4 None None] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:43:42.617926 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be27d872-b077-4e9e-ba8e-7fc82c842dd4 None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:43:42.618073 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be27d872-b077-4e9e-ba8e-7fc82c842dd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:43:42.635561 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.auth.core [None req-be27d872-b077-4e9e-ba8e-7fc82c842dd4 None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:43:42.636757 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-be27d872-b077-4e9e-ba8e-7fc82c842dd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:43:42.644507 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 682/1382] 10.222.0.58 () {58 vars in 1008 bytes} [Tue Oct 12 16:43:42 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:43:42.800055 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6ad86a-330e-4abc-8882-ab5e6360c66c None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:43:42.814985 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6ad86a-330e-4abc-8882-ab5e6360c66c None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:43:42.820309 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfdcee8-21b5-4332-9f4b-3160fe517d87 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29d30b574eec4ad3990d77d235c8b424', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:43:42.820943 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfdcee8-21b5-4332-9f4b-3160fe517d87 service nova] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:43:42.821226 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfdcee8-21b5-4332-9f4b-3160fe517d87 service nova] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:43:42.821500 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfdcee8-21b5-4332-9f4b-3160fe517d87 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:43:42.830125 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfdcee8-21b5-4332-9f4b-3160fe517d87 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:43:42.831684 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfdcee8-21b5-4332-9f4b-3160fe517d87 service nova] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:43:42.842772 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 701/1383] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Oct 12 16:43:42 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:43:44.993589 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3ca9f9-2faf-4790-ac14-adf89fd43c31 None None] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:43:44.994141 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3ca9f9-2faf-4790-ac14-adf89fd43c31 None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:43:44.994258 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3ca9f9-2faf-4790-ac14-adf89fd43c31 None None] PATH_INFO: `/` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:43:44.995933 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 683/1384] 10.222.0.58 () {54 vars in 926 bytes} [Tue Oct 12 16:43:44 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:43:45.002271 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee82aa58-436e-4560-a425-b6c57931ccc5 None None] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:43:45.002654 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee82aa58-436e-4560-a425-b6c57931ccc5 None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:43:45.002824 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee82aa58-436e-4560-a425-b6c57931ccc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:43:45.020750 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.auth.core [None req-ee82aa58-436e-4560-a425-b6c57931ccc5 None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:43:45.021965 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-ee82aa58-436e-4560-a425-b6c57931ccc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:43:45.029699 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 702/1385] 10.222.0.58 () {58 vars in 1023 bytes} [Tue Oct 12 16:43:45 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:43:45.068792 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3ca9f9-2faf-4790-ac14-adf89fd43c31 None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:43:45.079695 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3ca9f9-2faf-4790-ac14-adf89fd43c31 None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:43:45.083205 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04316e7d-dad2-413b-95c4-2890f64d9057 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e65f6d0598e4c539134292b86fb43d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:43:45.083832 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04316e7d-dad2-413b-95c4-2890f64d9057 service neutron] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:43:45.084115 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04316e7d-dad2-413b-95c4-2890f64d9057 service neutron] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:43:45.084387 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04316e7d-dad2-413b-95c4-2890f64d9057 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:43:45.092897 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04316e7d-dad2-413b-95c4-2890f64d9057 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:43:45.094354 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04316e7d-dad2-413b-95c4-2890f64d9057 service neutron] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:43:45.103319 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 684/1386] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Oct 12 16:43:45 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:43:47.489809 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c31014-23b4-46d5-9655-a1108bd3ce1a None None] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:43:47.490374 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c31014-23b4-46d5-9655-a1108bd3ce1a None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:43:47.490469 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c31014-23b4-46d5-9655-a1108bd3ce1a None None] PATH_INFO: `/` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:43:47.492162 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 703/1387] 10.222.0.58 () {54 vars in 926 bytes} [Tue Oct 12 16:43:47 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:43:47.498111 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894b803f-4aba-46db-bab0-28927cff766f None None] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:43:47.498570 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894b803f-4aba-46db-bab0-28927cff766f None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:43:47.498673 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894b803f-4aba-46db-bab0-28927cff766f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:43:47.516336 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.auth.core [None req-894b803f-4aba-46db-bab0-28927cff766f None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:43:47.517525 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-894b803f-4aba-46db-bab0-28927cff766f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:43:47.525753 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 685/1388] 10.222.0.58 () {58 vars in 1023 bytes} [Tue Oct 12 16:43:47 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:43:47.564927 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c31014-23b4-46d5-9655-a1108bd3ce1a None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:43:47.575718 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c31014-23b4-46d5-9655-a1108bd3ce1a None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:43:47.579205 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90b3326-f77c-48b4-9f7c-b12eca13c857 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e65f6d0598e4c539134292b86fb43d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:43:47.579837 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90b3326-f77c-48b4-9f7c-b12eca13c857 service neutron] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:43:47.580119 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90b3326-f77c-48b4-9f7c-b12eca13c857 service neutron] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:43:47.580394 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90b3326-f77c-48b4-9f7c-b12eca13c857 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:43:47.588919 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90b3326-f77c-48b4-9f7c-b12eca13c857 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:43:47.590979 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90b3326-f77c-48b4-9f7c-b12eca13c857 service neutron] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:43:47.600102 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 704/1389] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Oct 12 16:43:47 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:43:50.193752 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da55320d-d442-4e95-95ab-7360e7e25602 None None] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:43:50.194432 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da55320d-d442-4e95-95ab-7360e7e25602 None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:43:50.194432 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da55320d-d442-4e95-95ab-7360e7e25602 None None] PATH_INFO: `/` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:43:50.196128 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 686/1390] 10.222.0.58 () {54 vars in 926 bytes} [Tue Oct 12 16:43:50 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:43:50.202473 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ce87c3-828b-4153-898c-8b7f4be625fa None None] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:43:50.202879 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ce87c3-828b-4153-898c-8b7f4be625fa None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:43:50.203023 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ce87c3-828b-4153-898c-8b7f4be625fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:43:50.220896 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.auth.core [None req-74ce87c3-828b-4153-898c-8b7f4be625fa None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:43:50.222095 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-74ce87c3-828b-4153-898c-8b7f4be625fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:43:50.229595 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 705/1391] 10.222.0.58 () {58 vars in 1023 bytes} [Tue Oct 12 16:43:50 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:43:50.268713 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da55320d-d442-4e95-95ab-7360e7e25602 None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:43:50.279409 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da55320d-d442-4e95-95ab-7360e7e25602 None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:43:50.283140 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded42e36-dd03-4812-9e74-a5f37dde4a18 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e65f6d0598e4c539134292b86fb43d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:43:50.283777 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded42e36-dd03-4812-9e74-a5f37dde4a18 service neutron] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:43:50.284093 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded42e36-dd03-4812-9e74-a5f37dde4a18 service neutron] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:43:50.284374 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded42e36-dd03-4812-9e74-a5f37dde4a18 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:43:50.293193 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded42e36-dd03-4812-9e74-a5f37dde4a18 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:43:50.294629 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded42e36-dd03-4812-9e74-a5f37dde4a18 service neutron] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:43:50.304187 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 687/1392] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Oct 12 16:43:50 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 12 16:43:52.660003 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ec4a5b-845d-41b9-b62d-04c47ae02e4c None None] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:43:52.660608 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ec4a5b-845d-41b9-b62d-04c47ae02e4c None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:43:52.660608 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ec4a5b-845d-41b9-b62d-04c47ae02e4c None None] PATH_INFO: `/` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:43:52.662341 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 706/1393] 10.222.0.58 () {54 vars in 926 bytes} [Tue Oct 12 16:43:52 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:43:52.668127 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e62a3c5-09fb-4b74-83ff-b9085a1c0c9c None None] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:43:52.668533 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e62a3c5-09fb-4b74-83ff-b9085a1c0c9c None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:43:52.668677 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e62a3c5-09fb-4b74-83ff-b9085a1c0c9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:43:52.687390 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.auth.core [None req-0e62a3c5-09fb-4b74-83ff-b9085a1c0c9c None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:43:52.688584 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-0e62a3c5-09fb-4b74-83ff-b9085a1c0c9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:43:52.696275 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 688/1394] 10.222.0.58 () {58 vars in 1023 bytes} [Tue Oct 12 16:43:52 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:43:52.735846 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ec4a5b-845d-41b9-b62d-04c47ae02e4c None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:43:52.746307 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ec4a5b-845d-41b9-b62d-04c47ae02e4c None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:43:52.750053 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785c7b26-b7d2-413e-bf17-a63dacf4bb82 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e65f6d0598e4c539134292b86fb43d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:43:52.750681 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785c7b26-b7d2-413e-bf17-a63dacf4bb82 service neutron] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:43:52.750961 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785c7b26-b7d2-413e-bf17-a63dacf4bb82 service neutron] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:43:52.751231 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785c7b26-b7d2-413e-bf17-a63dacf4bb82 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:43:52.759846 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785c7b26-b7d2-413e-bf17-a63dacf4bb82 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:43:52.761266 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785c7b26-b7d2-413e-bf17-a63dacf4bb82 service neutron] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:43:52.770901 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 707/1395] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Oct 12 16:43:52 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:43:55.094739 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44d15a2-3b0e-411f-bc80-de00bb3af8f2 None None] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:43:55.095206 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44d15a2-3b0e-411f-bc80-de00bb3af8f2 None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:43:55.095304 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44d15a2-3b0e-411f-bc80-de00bb3af8f2 None None] PATH_INFO: `/` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:43:55.097315 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 689/1396] 10.222.0.58 () {54 vars in 926 bytes} [Tue Oct 12 16:43:55 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:43:55.103409 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6de9865-7293-4028-a02c-03e2eac67852 None None] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:43:55.104004 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6de9865-7293-4028-a02c-03e2eac67852 None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:43:55.104004 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6de9865-7293-4028-a02c-03e2eac67852 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:43:55.122174 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.auth.core [None req-f6de9865-7293-4028-a02c-03e2eac67852 None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:43:55.124007 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-f6de9865-7293-4028-a02c-03e2eac67852 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:43:55.131791 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 708/1397] 10.222.0.58 () {58 vars in 1023 bytes} [Tue Oct 12 16:43:55 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:43:55.171757 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44d15a2-3b0e-411f-bc80-de00bb3af8f2 None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:43:55.173419 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-d44d15a2-3b0e-411f-bc80-de00bb3af8f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:43:55.186498 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44d15a2-3b0e-411f-bc80-de00bb3af8f2 None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:43:55.190019 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cf9d68-f00d-4296-9e13-927b77bad244 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e65f6d0598e4c539134292b86fb43d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:43:55.190650 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cf9d68-f00d-4296-9e13-927b77bad244 service neutron] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:43:55.190935 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cf9d68-f00d-4296-9e13-927b77bad244 service neutron] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:43:55.191213 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cf9d68-f00d-4296-9e13-927b77bad244 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:43:55.200041 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cf9d68-f00d-4296-9e13-927b77bad244 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:43:55.201441 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cf9d68-f00d-4296-9e13-927b77bad244 service neutron] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:43:55.210483 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 690/1398] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Oct 12 16:43:55 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:43:57.590659 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a8be31-d7e0-4ffb-ba02-7d39f72e7edf None None] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:43:57.591203 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a8be31-d7e0-4ffb-ba02-7d39f72e7edf None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:43:57.591203 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a8be31-d7e0-4ffb-ba02-7d39f72e7edf None None] PATH_INFO: `/` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:43:57.593598 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 709/1399] 10.222.0.58 () {54 vars in 926 bytes} [Tue Oct 12 16:43:57 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:43:57.599388 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cc17b1-8413-4fac-baae-0251475bbbb8 None None] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:43:57.599811 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cc17b1-8413-4fac-baae-0251475bbbb8 None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:43:57.599925 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cc17b1-8413-4fac-baae-0251475bbbb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:43:57.617602 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.auth.core [None req-d1cc17b1-8413-4fac-baae-0251475bbbb8 None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:43:57.618851 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-d1cc17b1-8413-4fac-baae-0251475bbbb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:43:57.626750 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 691/1400] 10.222.0.58 () {58 vars in 1023 bytes} [Tue Oct 12 16:43:57 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:43:57.665892 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a8be31-d7e0-4ffb-ba02-7d39f72e7edf None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:43:57.676780 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a8be31-d7e0-4ffb-ba02-7d39f72e7edf None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:43:57.680304 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d356b26-a06d-4591-883e-e16ced3fac30 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e65f6d0598e4c539134292b86fb43d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:43:57.680932 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d356b26-a06d-4591-883e-e16ced3fac30 service neutron] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:43:57.681213 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d356b26-a06d-4591-883e-e16ced3fac30 service neutron] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:43:57.681483 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d356b26-a06d-4591-883e-e16ced3fac30 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:43:57.690150 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d356b26-a06d-4591-883e-e16ced3fac30 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:43:57.691563 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d356b26-a06d-4591-883e-e16ced3fac30 service neutron] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:43:57.700673 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 710/1401] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Oct 12 16:43:57 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 12 16:43:59.993387 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af61e1a-e1e5-4468-b816-285b40fb9cbe None None] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:43:59.993968 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af61e1a-e1e5-4468-b816-285b40fb9cbe None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:43:59.993968 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af61e1a-e1e5-4468-b816-285b40fb9cbe None None] PATH_INFO: `/` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:43:59.995719 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 692/1402] 10.222.0.58 () {54 vars in 926 bytes} [Tue Oct 12 16:43:59 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:44:00.002149 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc89f264-c80f-4263-99d3-994a96d013d8 None None] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:44:00.002569 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc89f264-c80f-4263-99d3-994a96d013d8 None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:44:00.002697 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc89f264-c80f-4263-99d3-994a96d013d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:44:00.020323 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.auth.core [None req-fc89f264-c80f-4263-99d3-994a96d013d8 None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:44:00.021495 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-fc89f264-c80f-4263-99d3-994a96d013d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:44:00.029332 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 711/1403] 10.222.0.58 () {58 vars in 1023 bytes} [Tue Oct 12 16:44:00 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:44:00.067646 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af61e1a-e1e5-4468-b816-285b40fb9cbe None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:44:00.078633 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af61e1a-e1e5-4468-b816-285b40fb9cbe None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:44:00.082089 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a6acdd-6359-4c96-a393-41e2b7e3af54 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e65f6d0598e4c539134292b86fb43d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:44:00.082706 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a6acdd-6359-4c96-a393-41e2b7e3af54 service neutron] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:44:00.082989 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a6acdd-6359-4c96-a393-41e2b7e3af54 service neutron] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:44:00.083258 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a6acdd-6359-4c96-a393-41e2b7e3af54 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:44:00.091818 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a6acdd-6359-4c96-a393-41e2b7e3af54 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:44:00.093213 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a6acdd-6359-4c96-a393-41e2b7e3af54 service neutron] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:44:00.102174 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 693/1404] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Oct 12 16:44:00 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:44:02.367333 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55805f43-be13-44bf-9804-46cb238ebdc4 None None] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:44:02.367878 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55805f43-be13-44bf-9804-46cb238ebdc4 None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:44:02.367878 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55805f43-be13-44bf-9804-46cb238ebdc4 None None] PATH_INFO: `/` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:44:02.369631 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 712/1405] 10.222.0.58 () {54 vars in 926 bytes} [Tue Oct 12 16:44:02 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:44:02.375506 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd4803d-08b4-48bf-980b-5a5a13b1b559 None None] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:44:02.375937 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd4803d-08b4-48bf-980b-5a5a13b1b559 None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:44:02.376048 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd4803d-08b4-48bf-980b-5a5a13b1b559 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:44:02.393146 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.auth.core [None req-bdd4803d-08b4-48bf-980b-5a5a13b1b559 None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:44:02.394361 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-bdd4803d-08b4-48bf-980b-5a5a13b1b559 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:44:02.402622 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 694/1406] 10.222.0.58 () {58 vars in 1023 bytes} [Tue Oct 12 16:44:02 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:44:02.443221 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55805f43-be13-44bf-9804-46cb238ebdc4 None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:44:02.454117 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55805f43-be13-44bf-9804-46cb238ebdc4 None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:44:02.457582 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3560e83b-ec41-4a70-ae57-3bda1ee1ad5b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e65f6d0598e4c539134292b86fb43d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:44:02.458238 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3560e83b-ec41-4a70-ae57-3bda1ee1ad5b service neutron] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:44:02.458524 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3560e83b-ec41-4a70-ae57-3bda1ee1ad5b service neutron] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:44:02.458800 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3560e83b-ec41-4a70-ae57-3bda1ee1ad5b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:44:02.467935 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3560e83b-ec41-4a70-ae57-3bda1ee1ad5b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:44:02.469345 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3560e83b-ec41-4a70-ae57-3bda1ee1ad5b service neutron] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:44:02.478382 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 713/1407] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Oct 12 16:44:02 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:44:04.720702 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf357a73-0046-457b-9726-46726d360aad None None] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:44:04.721298 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf357a73-0046-457b-9726-46726d360aad None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:44:04.721298 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf357a73-0046-457b-9726-46726d360aad None None] PATH_INFO: `/` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:44:04.723060 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 695/1408] 10.222.0.58 () {54 vars in 926 bytes} [Tue Oct 12 16:44:04 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 12 16:44:04.728912 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8453a2-8a68-4b6f-8dce-f9e73f18d8fc None None] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:44:04.729332 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8453a2-8a68-4b6f-8dce-f9e73f18d8fc None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:44:04.729495 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8453a2-8a68-4b6f-8dce-f9e73f18d8fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:44:04.747285 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.auth.core [None req-fe8453a2-8a68-4b6f-8dce-f9e73f18d8fc None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:44:04.749097 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-fe8453a2-8a68-4b6f-8dce-f9e73f18d8fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:44:04.756984 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 714/1409] 10.222.0.58 () {58 vars in 1023 bytes} [Tue Oct 12 16:44:04 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:44:04.795284 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf357a73-0046-457b-9726-46726d360aad None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:44:04.805704 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf357a73-0046-457b-9726-46726d360aad None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:44:04.809253 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f297c4-a324-4543-bc91-0456eb68bfa7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e65f6d0598e4c539134292b86fb43d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:44:04.809907 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f297c4-a324-4543-bc91-0456eb68bfa7 service neutron] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:44:04.810194 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f297c4-a324-4543-bc91-0456eb68bfa7 service neutron] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:44:04.810470 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f297c4-a324-4543-bc91-0456eb68bfa7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:44:04.819348 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f297c4-a324-4543-bc91-0456eb68bfa7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:44:04.820785 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f297c4-a324-4543-bc91-0456eb68bfa7 service neutron] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:44:04.830387 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 696/1410] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Oct 12 16:44:04 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:44:07.087502 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad1e991-6033-4622-8678-301354fba758 None None] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:44:07.088029 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad1e991-6033-4622-8678-301354fba758 None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:44:07.088029 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad1e991-6033-4622-8678-301354fba758 None None] PATH_INFO: `/` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:44:07.089720 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 715/1411] 10.222.0.58 () {54 vars in 926 bytes} [Tue Oct 12 16:44:07 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:44:07.096146 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2970f5-cfd2-4729-b32d-a10c69598d6c None None] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:44:07.096585 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2970f5-cfd2-4729-b32d-a10c69598d6c None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:44:07.096693 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2970f5-cfd2-4729-b32d-a10c69598d6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:44:07.113986 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.auth.core [None req-6f2970f5-cfd2-4729-b32d-a10c69598d6c None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:44:07.115158 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-6f2970f5-cfd2-4729-b32d-a10c69598d6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:44:07.122746 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 697/1412] 10.222.0.58 () {58 vars in 1023 bytes} [Tue Oct 12 16:44:07 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:44:07.160775 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad1e991-6033-4622-8678-301354fba758 None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:44:07.171095 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad1e991-6033-4622-8678-301354fba758 None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:44:07.174661 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089cfb8b-b38b-4114-b17d-77b2df6d51cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e65f6d0598e4c539134292b86fb43d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:44:07.175295 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089cfb8b-b38b-4114-b17d-77b2df6d51cc service neutron] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:44:07.175579 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089cfb8b-b38b-4114-b17d-77b2df6d51cc service neutron] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:44:07.175853 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089cfb8b-b38b-4114-b17d-77b2df6d51cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:44:07.184467 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089cfb8b-b38b-4114-b17d-77b2df6d51cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:44:07.185903 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089cfb8b-b38b-4114-b17d-77b2df6d51cc service neutron] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:44:07.195040 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 716/1413] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Oct 12 16:44:07 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:44:23.932210 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3732724c-fc09-40e7-9a4e-e202eba2f897 None None] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:44:23.932801 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3732724c-fc09-40e7-9a4e-e202eba2f897 None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:44:23.932801 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3732724c-fc09-40e7-9a4e-e202eba2f897 None None] PATH_INFO: `/` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:44:23.934548 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 698/1414] 10.222.0.58 () {54 vars in 926 bytes} [Tue Oct 12 16:44:23 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:44:23.940858 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70863c8-2daa-462b-a4b4-e1bc1098e9e2 None None] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:44:23.941301 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70863c8-2daa-462b-a4b4-e1bc1098e9e2 None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:44:23.941403 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70863c8-2daa-462b-a4b4-e1bc1098e9e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:44:23.959465 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.auth.core [None req-c70863c8-2daa-462b-a4b4-e1bc1098e9e2 None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:44:23.960671 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-c70863c8-2daa-462b-a4b4-e1bc1098e9e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:44:23.968336 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 717/1415] 10.222.0.58 () {58 vars in 1023 bytes} [Tue Oct 12 16:44:23 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:44:24.017824 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d065f72-bea0-4561-9be1-ccc3a83f6e05 None None] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:44:24.018142 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d065f72-bea0-4561-9be1-ccc3a83f6e05 None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:44:24.018420 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d065f72-bea0-4561-9be1-ccc3a83f6e05 None None] PATH_INFO: `/` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:44:24.020174 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 699/1416] 10.222.0.58 () {54 vars in 961 bytes} [Tue Oct 12 16:44:24 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:44:24.025295 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02941407-6cea-4a09-962e-9565aeb562f1 None None] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:44:24.025616 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02941407-6cea-4a09-962e-9565aeb562f1 None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:44:24.025919 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02941407-6cea-4a09-962e-9565aeb562f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:44:24.043764 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.auth.core [None req-02941407-6cea-4a09-962e-9565aeb562f1 None None] MFA Rules not processed for user `8ff84015069041f2bf33e3fd55b92e44`. Rule list: `[]` (Enabled: `True`). {{(pid=85204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:44:24.044927 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-02941407-6cea-4a09-962e-9565aeb562f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:44:24.051341 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 718/1417] 10.222.0.58 () {58 vars in 1058 bytes} [Tue Oct 12 16:44:24 2021] POST /identity/v3/auth/tokens => generated 3263 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:44:24.058720 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d065f72-bea0-4561-9be1-ccc3a83f6e05 None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:44:24.069362 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d065f72-bea0-4561-9be1-ccc3a83f6e05 None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:44:24.072990 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4081cd4f-018f-4324-a482-20c1c2126fbe service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ff84015069041f2bf33e3fd55b92e44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:44:24.073615 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4081cd4f-018f-4324-a482-20c1c2126fbe service glance] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:44:24.073927 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4081cd4f-018f-4324-a482-20c1c2126fbe service glance] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:44:24.074210 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4081cd4f-018f-4324-a482-20c1c2126fbe service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:44:24.083821 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4081cd4f-018f-4324-a482-20c1c2126fbe service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:44:24.085223 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4081cd4f-018f-4324-a482-20c1c2126fbe service glance] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:44:24.094219 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 700/1418] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Oct 12 16:44:24 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:44:26.524278 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a569627-126d-4d25-b9c4-19b386d82240 None None] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:44:26.524855 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a569627-126d-4d25-b9c4-19b386d82240 None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:44:26.524855 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a569627-126d-4d25-b9c4-19b386d82240 None None] PATH_INFO: `/` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:44:26.526657 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 719/1419] 10.222.0.58 () {54 vars in 926 bytes} [Tue Oct 12 16:44:26 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:44:26.533303 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c1670a-d504-46ba-a6cd-4c6e84053c88 None None] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:44:26.533734 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c1670a-d504-46ba-a6cd-4c6e84053c88 None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:44:26.533866 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c1670a-d504-46ba-a6cd-4c6e84053c88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:44:26.551277 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.auth.core [None req-61c1670a-d504-46ba-a6cd-4c6e84053c88 None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:44:26.552501 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-61c1670a-d504-46ba-a6cd-4c6e84053c88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:44:26.560244 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 701/1420] 10.222.0.58 () {58 vars in 1023 bytes} [Tue Oct 12 16:44:26 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:44:26.584324 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a569627-126d-4d25-b9c4-19b386d82240 None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:44:26.596960 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a569627-126d-4d25-b9c4-19b386d82240 None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:44:26.601291 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a459b0-7030-451c-a789-02f6ec41bf1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:44:26.601960 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a459b0-7030-451c-a789-02f6ec41bf1b admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:44:26.602244 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a459b0-7030-451c-a789-02f6ec41bf1b admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:44:26.602515 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a459b0-7030-451c-a789-02f6ec41bf1b admin admin] PATH_INFO: `/v3/projects` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:44:26.603247 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a459b0-7030-451c-a789-02f6ec41bf1b admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:44:26.605044 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a459b0-7030-451c-a789-02f6ec41bf1b admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:44:26.618241 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 720/1421] 10.222.0.58 () {56 vars in 1108 bytes} [Tue Oct 12 16:44:26 2021] GET /identity/v3/projects => generated 2553 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:44:28.885742 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537c878f-c915-4d46-a9e8-59358de47c90 None None] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:44:28.886328 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537c878f-c915-4d46-a9e8-59358de47c90 None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:44:28.886328 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537c878f-c915-4d46-a9e8-59358de47c90 None None] PATH_INFO: `/` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:44:28.888087 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 702/1422] 10.222.0.58 () {54 vars in 926 bytes} [Tue Oct 12 16:44:28 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:44:28.894455 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecda648c-548a-4e1e-9eaa-b3327bad52ea None None] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:44:28.894902 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecda648c-548a-4e1e-9eaa-b3327bad52ea None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:44:28.895001 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecda648c-548a-4e1e-9eaa-b3327bad52ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:44:28.913234 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.auth.core [None req-ecda648c-548a-4e1e-9eaa-b3327bad52ea None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:44:28.914447 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-ecda648c-548a-4e1e-9eaa-b3327bad52ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:44:28.922094 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 721/1423] 10.222.0.58 () {58 vars in 1023 bytes} [Tue Oct 12 16:44:28 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:44:28.965089 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537c878f-c915-4d46-a9e8-59358de47c90 None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:44:28.979511 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537c878f-c915-4d46-a9e8-59358de47c90 None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:44:28.984811 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bbc9b6-16b3-4790-916a-a415d4f2fb48 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29d30b574eec4ad3990d77d235c8b424', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:44:28.985437 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bbc9b6-16b3-4790-916a-a415d4f2fb48 service nova] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:44:28.985721 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bbc9b6-16b3-4790-916a-a415d4f2fb48 service nova] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:44:28.986030 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bbc9b6-16b3-4790-916a-a415d4f2fb48 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:44:28.993796 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bbc9b6-16b3-4790-916a-a415d4f2fb48 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:44:28.995394 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bbc9b6-16b3-4790-916a-a415d4f2fb48 service nova] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:44:29.004415 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 703/1424] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Oct 12 16:44:28 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:44:31.425467 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad23de9-318a-4f30-bc4c-28ec0bb6abcc None None] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:44:31.426060 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad23de9-318a-4f30-bc4c-28ec0bb6abcc None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:44:31.426060 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad23de9-318a-4f30-bc4c-28ec0bb6abcc None None] PATH_INFO: `/` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:44:31.427822 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 722/1425] 10.222.0.58 () {54 vars in 926 bytes} [Tue Oct 12 16:44:31 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:44:31.433706 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c1c2c3-d0c1-4488-96ed-b93dda59aea5 None None] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:44:31.434251 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c1c2c3-d0c1-4488-96ed-b93dda59aea5 None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:44:31.434349 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c1c2c3-d0c1-4488-96ed-b93dda59aea5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:44:31.452428 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.auth.core [None req-87c1c2c3-d0c1-4488-96ed-b93dda59aea5 None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:44:31.453654 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-87c1c2c3-d0c1-4488-96ed-b93dda59aea5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:44:31.462145 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 704/1426] 10.222.0.58 () {58 vars in 1023 bytes} [Tue Oct 12 16:44:31 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:44:31.499298 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad23de9-318a-4f30-bc4c-28ec0bb6abcc None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:44:31.510184 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad23de9-318a-4f30-bc4c-28ec0bb6abcc None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:44:31.513663 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be350d0-f5f1-417b-9663-7c0ea452369f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e65f6d0598e4c539134292b86fb43d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:44:31.514339 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be350d0-f5f1-417b-9663-7c0ea452369f service neutron] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:44:31.514623 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be350d0-f5f1-417b-9663-7c0ea452369f service neutron] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:44:31.514898 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be350d0-f5f1-417b-9663-7c0ea452369f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:44:31.524197 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be350d0-f5f1-417b-9663-7c0ea452369f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:44:31.525616 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be350d0-f5f1-417b-9663-7c0ea452369f service neutron] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:44:31.535028 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 723/1427] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Oct 12 16:44:31 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:44:33.833570 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4fecef-05dd-410f-8acd-593f74cddda3 None None] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:44:33.834068 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4fecef-05dd-410f-8acd-593f74cddda3 None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:44:33.834216 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4fecef-05dd-410f-8acd-593f74cddda3 None None] PATH_INFO: `/` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:44:33.836002 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 705/1428] 10.222.0.58 () {54 vars in 926 bytes} [Tue Oct 12 16:44:33 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:44:33.842031 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a346b6-fc34-4272-b639-83c91363f710 None None] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:44:33.842436 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a346b6-fc34-4272-b639-83c91363f710 None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:44:33.842578 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a346b6-fc34-4272-b639-83c91363f710 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:44:33.860199 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.auth.core [None req-95a346b6-fc34-4272-b639-83c91363f710 None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:44:33.861522 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-95a346b6-fc34-4272-b639-83c91363f710 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:44:33.870738 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 724/1429] 10.222.0.58 () {58 vars in 1023 bytes} [Tue Oct 12 16:44:33 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:44:33.910184 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4fecef-05dd-410f-8acd-593f74cddda3 None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:44:33.920583 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4fecef-05dd-410f-8acd-593f74cddda3 None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:44:33.924746 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d404b841-114b-49a0-983e-b774fb03c3a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e65f6d0598e4c539134292b86fb43d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:44:33.925370 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d404b841-114b-49a0-983e-b774fb03c3a0 service neutron] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:44:33.925650 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d404b841-114b-49a0-983e-b774fb03c3a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:44:33.925952 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d404b841-114b-49a0-983e-b774fb03c3a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:44:33.934538 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d404b841-114b-49a0-983e-b774fb03c3a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:44:33.935934 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d404b841-114b-49a0-983e-b774fb03c3a0 service neutron] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:44:33.945053 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 706/1430] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Oct 12 16:44:33 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:44:36.347511 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa75073f-6d4d-4f97-b757-6fd1cd619e3e None None] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:44:36.348088 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa75073f-6d4d-4f97-b757-6fd1cd619e3e None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:44:36.348088 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa75073f-6d4d-4f97-b757-6fd1cd619e3e None None] PATH_INFO: `/` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:44:36.349907 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 725/1431] 10.222.0.58 () {54 vars in 926 bytes} [Tue Oct 12 16:44:36 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:44:36.355707 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3a0d59-4dc1-442c-8377-8f92ce324573 None None] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:44:36.356097 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3a0d59-4dc1-442c-8377-8f92ce324573 None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:44:36.356258 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3a0d59-4dc1-442c-8377-8f92ce324573 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:44:36.373810 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.auth.core [None req-bf3a0d59-4dc1-442c-8377-8f92ce324573 None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:44:36.375024 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-bf3a0d59-4dc1-442c-8377-8f92ce324573 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:44:36.383259 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 707/1432] 10.222.0.58 () {58 vars in 1023 bytes} [Tue Oct 12 16:44:36 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:44:36.424431 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa75073f-6d4d-4f97-b757-6fd1cd619e3e None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:44:36.435691 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa75073f-6d4d-4f97-b757-6fd1cd619e3e None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:44:36.439879 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a954a4-d154-4ecb-a2f1-1439549bd439 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e65f6d0598e4c539134292b86fb43d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:44:36.440549 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a954a4-d154-4ecb-a2f1-1439549bd439 service neutron] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:44:36.440838 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a954a4-d154-4ecb-a2f1-1439549bd439 service neutron] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:44:36.441113 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a954a4-d154-4ecb-a2f1-1439549bd439 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:44:36.450132 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a954a4-d154-4ecb-a2f1-1439549bd439 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:44:36.451791 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a954a4-d154-4ecb-a2f1-1439549bd439 service neutron] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:44:36.461648 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 726/1433] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Oct 12 16:44:36 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:44:38.910449 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3859f71-153f-4c9e-8ada-1ed3f59d137e None None] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:44:38.910990 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3859f71-153f-4c9e-8ada-1ed3f59d137e None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:44:38.910990 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3859f71-153f-4c9e-8ada-1ed3f59d137e None None] PATH_INFO: `/` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:44:38.912769 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 708/1434] 10.222.0.58 () {54 vars in 926 bytes} [Tue Oct 12 16:44:38 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:44:38.918825 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ddcee3-0ead-4e2c-b204-24ee29edf8fa None None] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:44:38.919224 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ddcee3-0ead-4e2c-b204-24ee29edf8fa None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:44:38.919384 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ddcee3-0ead-4e2c-b204-24ee29edf8fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:44:38.936805 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.auth.core [None req-e7ddcee3-0ead-4e2c-b204-24ee29edf8fa None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:44:38.938032 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-e7ddcee3-0ead-4e2c-b204-24ee29edf8fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:44:38.946171 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 727/1435] 10.222.0.58 () {58 vars in 1023 bytes} [Tue Oct 12 16:44:38 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:44:38.986390 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3859f71-153f-4c9e-8ada-1ed3f59d137e None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:44:38.996606 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3859f71-153f-4c9e-8ada-1ed3f59d137e None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:44:39.000037 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86cbeca-1cd5-4e11-842f-a12e7f27f82e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e65f6d0598e4c539134292b86fb43d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:44:39.000664 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86cbeca-1cd5-4e11-842f-a12e7f27f82e service neutron] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:44:39.000945 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86cbeca-1cd5-4e11-842f-a12e7f27f82e service neutron] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:44:39.001218 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86cbeca-1cd5-4e11-842f-a12e7f27f82e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:44:39.010224 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86cbeca-1cd5-4e11-842f-a12e7f27f82e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:44:39.011625 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86cbeca-1cd5-4e11-842f-a12e7f27f82e service neutron] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:44:39.021050 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 709/1436] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Oct 12 16:44:38 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:45:49.400589 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7dfa9d-bc7c-4adc-822a-039a1cdc63b8 None None] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:45:49.401075 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7dfa9d-bc7c-4adc-822a-039a1cdc63b8 None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:45:49.401200 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7dfa9d-bc7c-4adc-822a-039a1cdc63b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:45:49.419060 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.auth.core [None req-9e7dfa9d-bc7c-4adc-822a-039a1cdc63b8 None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:45:49.420250 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-9e7dfa9d-bc7c-4adc-822a-039a1cdc63b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:45:49.428011 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 728/1437] 10.222.0.58 () {58 vars in 957 bytes} [Tue Oct 12 16:45:49 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:45:49.435845 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e09509-c398-4345-bc29-0e02ab06e2d5 None None] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:45:49.436311 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e09509-c398-4345-bc29-0e02ab06e2d5 None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:45:49.436406 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e09509-c398-4345-bc29-0e02ab06e2d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:45:49.454899 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.auth.core [None req-c7e09509-c398-4345-bc29-0e02ab06e2d5 None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:45:49.456063 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-c7e09509-c398-4345-bc29-0e02ab06e2d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:45:49.463984 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 710/1438] 10.222.0.58 () {58 vars in 957 bytes} [Tue Oct 12 16:45:49 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:45:49.468530 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7dfa9d-bc7c-4adc-822a-039a1cdc63b8 None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:45:49.478142 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7dfa9d-bc7c-4adc-822a-039a1cdc63b8 None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:45:49.482697 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc331d1-c579-4eb6-a788-2fcb94a384ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:45:49.483350 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc331d1-c579-4eb6-a788-2fcb94a384ed admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:45:49.483683 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc331d1-c579-4eb6-a788-2fcb94a384ed admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:45:49.483962 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc331d1-c579-4eb6-a788-2fcb94a384ed admin admin] PATH_INFO: `/v3/domains` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:45:49.484696 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc331d1-c579-4eb6-a788-2fcb94a384ed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:45:49.485008 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc331d1-c579-4eb6-a788-2fcb94a384ed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:45:49.486637 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc331d1-c579-4eb6-a788-2fcb94a384ed admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:45:49.497830 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 729/1439] 10.222.0.58 () {58 vars in 1152 bytes} [Tue Oct 12 16:45:49 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 16:45:49.506319 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e09509-c398-4345-bc29-0e02ab06e2d5 None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:45:49.515759 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e09509-c398-4345-bc29-0e02ab06e2d5 None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:45:49.520425 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624121f4-bc5a-4ee4-936b-17198426cc13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:45:49.521070 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624121f4-bc5a-4ee4-936b-17198426cc13 admin admin] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:45:49.521356 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624121f4-bc5a-4ee4-936b-17198426cc13 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:45:49.521632 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624121f4-bc5a-4ee4-936b-17198426cc13 admin admin] PATH_INFO: `/v3/projects` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:45:49.522379 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624121f4-bc5a-4ee4-936b-17198426cc13 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:45:49.524279 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624121f4-bc5a-4ee4-936b-17198426cc13 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:45:49.558386 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 711/1440] 10.222.0.58 () {60 vars in 1152 bytes} [Tue Oct 12 16:45:49 2021] POST /identity/v3/projects => generated 377 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:45:49.562960 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc331d1-c579-4eb6-a788-2fcb94a384ed admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:45:49.572513 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc331d1-c579-4eb6-a788-2fcb94a384ed admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:45:49.628464 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a23c70-356c-43aa-b00c-467f55935c81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:45:49.629051 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a23c70-356c-43aa-b00c-467f55935c81 admin admin] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:45:49.629333 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a23c70-356c-43aa-b00c-467f55935c81 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:45:49.629607 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a23c70-356c-43aa-b00c-467f55935c81 admin admin] PATH_INFO: `/v3/users` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:45:49.630349 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a23c70-356c-43aa-b00c-467f55935c81 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:45:49.632254 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a23c70-356c-43aa-b00c-467f55935c81 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:45:49.652011 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 730/1441] 10.222.0.58 () {60 vars in 1143 bytes} [Tue Oct 12 16:45:49 2021] POST /identity/v3/users => generated 289 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:45:49.656567 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624121f4-bc5a-4ee4-936b-17198426cc13 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:45:49.666463 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624121f4-bc5a-4ee4-936b-17198426cc13 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:45:49.670951 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cdbcd2-e407-4521-9f29-d5d4f8ca1448 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:45:49.671602 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cdbcd2-e407-4521-9f29-d5d4f8ca1448 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:45:49.671887 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cdbcd2-e407-4521-9f29-d5d4f8ca1448 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:45:49.672164 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cdbcd2-e407-4521-9f29-d5d4f8ca1448 admin admin] PATH_INFO: `/v3/roles` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:45:49.672891 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cdbcd2-e407-4521-9f29-d5d4f8ca1448 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:45:49.674518 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cdbcd2-e407-4521-9f29-d5d4f8ca1448 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:45:49.687591 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 712/1442] 10.222.0.58 () {58 vars in 1121 bytes} [Tue Oct 12 16:45:49 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:45:49.691291 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a23c70-356c-43aa-b00c-467f55935c81 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:45:49.700663 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a23c70-356c-43aa-b00c-467f55935c81 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:45:49.705982 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d634839-6319-41b4-b7ce-213ae55546a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:45:49.706634 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d634839-6319-41b4-b7ce-213ae55546a8 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:45:49.706996 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d634839-6319-41b4-b7ce-213ae55546a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:45:49.707318 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d634839-6319-41b4-b7ce-213ae55546a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:45:49.708219 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d634839-6319-41b4-b7ce-213ae55546a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:45:49.709799 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d634839-6319-41b4-b7ce-213ae55546a8 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:45:49.722807 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 731/1443] 10.222.0.58 () {58 vars in 1121 bytes} [Tue Oct 12 16:45:49 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:45:49.726684 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cdbcd2-e407-4521-9f29-d5d4f8ca1448 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:45:49.736725 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cdbcd2-e407-4521-9f29-d5d4f8ca1448 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:45:49.741249 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca8626b-3e86-40dc-86c9-ab28039ea36e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:45:49.742163 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca8626b-3e86-40dc-86c9-ab28039ea36e admin admin] REQUEST_METHOD: `PUT` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:45:49.742464 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca8626b-3e86-40dc-86c9-ab28039ea36e admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:45:49.742726 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca8626b-3e86-40dc-86c9-ab28039ea36e admin admin] PATH_INFO: `/v3/projects/0db787c9f462472582f0232261df26bd/users/212babfd97224fab96ad2e9aa457d9c5/roles/55ba49fe29884e64b57c3ad13188d554` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:45:49.757272 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca8626b-3e86-40dc-86c9-ab28039ea36e admin admin] RBAC: Authorizing `identity:create_grant(project_id=0db787c9f462472582f0232261df26bd, user_id=212babfd97224fab96ad2e9aa457d9c5, role_id=55ba49fe29884e64b57c3ad13188d554)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:45:49.760093 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca8626b-3e86-40dc-86c9-ab28039ea36e admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:45:49.773696 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 713/1444] 10.222.0.58 () {60 vars in 1482 bytes} [Tue Oct 12 16:45:49 2021] PUT /identity/v3/projects/0db787c9f462472582f0232261df26bd/users/212babfd97224fab96ad2e9aa457d9c5/roles/55ba49fe29884e64b57c3ad13188d554 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 16:45:49.785935 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db52b02-fe88-4f81-b01e-7b1f725ac8ce None None] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:45:49.786233 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db52b02-fe88-4f81-b01e-7b1f725ac8ce None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:45:49.786513 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db52b02-fe88-4f81-b01e-7b1f725ac8ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:45:49.813961 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.auth.core [None req-4db52b02-fe88-4f81-b01e-7b1f725ac8ce None None] MFA Rules not processed for user `212babfd97224fab96ad2e9aa457d9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=85204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:45:49.815162 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-4db52b02-fe88-4f81-b01e-7b1f725ac8ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:45:49.875411 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 732/1445] 10.222.0.58 () {58 vars in 957 bytes} [Tue Oct 12 16:45:49 2021] POST /identity/v3/auth/tokens => generated 3397 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:45:49.886909 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca8626b-3e86-40dc-86c9-ab28039ea36e admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:45:49.952783 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca8626b-3e86-40dc-86c9-ab28039ea36e admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:45:49.958175 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41705b20-130b-48cc-898b-05e37b0c537b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29d30b574eec4ad3990d77d235c8b424', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:45:49.958809 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41705b20-130b-48cc-898b-05e37b0c537b service nova] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:45:49.959092 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41705b20-130b-48cc-898b-05e37b0c537b service nova] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:45:49.959366 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41705b20-130b-48cc-898b-05e37b0c537b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:45:49.966909 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41705b20-130b-48cc-898b-05e37b0c537b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:45:49.968522 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41705b20-130b-48cc-898b-05e37b0c537b service nova] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:45:49.977312 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 714/1446] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Oct 12 16:45:49 2021] GET /identity/v3/auth/tokens => generated 3397 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:45:50.043814 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1744ddb-7c2b-4b0e-9950-a3c7269dd45a None None] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:45:50.044097 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1744ddb-7c2b-4b0e-9950-a3c7269dd45a None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:45:50.044368 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1744ddb-7c2b-4b0e-9950-a3c7269dd45a None None] PATH_INFO: `/` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:45:50.046619 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 733/1447] 10.222.0.58 () {52 vars in 829 bytes} [Tue Oct 12 16:45:50 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:45:50.050119 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41705b20-130b-48cc-898b-05e37b0c537b service nova] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:45:50.109659 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41705b20-130b-48cc-898b-05e37b0c537b service nova] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:45:50.114192 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6a1a2b-59b0-4b39-8265-4b74335a9e1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:45:50.115037 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6a1a2b-59b0-4b39-8265-4b74335a9e1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:45:50.115316 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6a1a2b-59b0-4b39-8265-4b74335a9e1c admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:45:50.115588 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6a1a2b-59b0-4b39-8265-4b74335a9e1c admin admin] PATH_INFO: `/v3/users/212babfd97224fab96ad2e9aa457d9c5` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:45:50.116752 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6a1a2b-59b0-4b39-8265-4b74335a9e1c admin admin] RBAC: Authorizing `identity:delete_user(user_id=212babfd97224fab96ad2e9aa457d9c5)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:45:50.117753 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: WARNING py.warnings [None req-dc6a1a2b-59b0-4b39-8265-4b74335a9e1c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:delete_user failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 12 16:45:50.117753 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: warnings.warn(msg) Oct 12 16:45:50.117753 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: Oct 12 16:45:50.118952 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6a1a2b-59b0-4b39-8265-4b74335a9e1c admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:45:50.181553 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-dc6a1a2b-59b0-4b39-8265-4b74335a9e1c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '212babfd97224fab96ad2e9aa457d9c5'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:45:50.199867 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-dc6a1a2b-59b0-4b39-8265-4b74335a9e1c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '212babfd97224fab96ad2e9aa457d9c5'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:45:50.208395 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-dc6a1a2b-59b0-4b39-8265-4b74335a9e1c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '212babfd97224fab96ad2e9aa457d9c5'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:45:50.220881 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-dc6a1a2b-59b0-4b39-8265-4b74335a9e1c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '212babfd97224fab96ad2e9aa457d9c5'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:45:50.221612 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-dc6a1a2b-59b0-4b39-8265-4b74335a9e1c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '212babfd97224fab96ad2e9aa457d9c5'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:45:50.227552 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 715/1448] 10.222.0.58 () {58 vars in 1223 bytes} [Tue Oct 12 16:45:50 2021] DELETE /identity/v3/users/212babfd97224fab96ad2e9aa457d9c5 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:45:50.231871 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421e8d8b-7b9d-4c15-9758-a4d42e7dd90a None None] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:45:50.232160 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421e8d8b-7b9d-4c15-9758-a4d42e7dd90a None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:45:50.232436 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421e8d8b-7b9d-4c15-9758-a4d42e7dd90a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:45:50.249579 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.auth.core [None req-421e8d8b-7b9d-4c15-9758-a4d42e7dd90a None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:45:50.250789 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-421e8d8b-7b9d-4c15-9758-a4d42e7dd90a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:45:50.305922 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 734/1449] 10.222.0.58 () {58 vars in 957 bytes} [Tue Oct 12 16:45:50 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:45:50.315532 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6a1a2b-59b0-4b39-8265-4b74335a9e1c admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:45:50.317173 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-dc6a1a2b-59b0-4b39-8265-4b74335a9e1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:45:50.372994 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6a1a2b-59b0-4b39-8265-4b74335a9e1c admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:45:50.376538 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e8fa42-215e-4f59-a051-0956fd5fc157 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e65f6d0598e4c539134292b86fb43d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:45:50.377181 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e8fa42-215e-4f59-a051-0956fd5fc157 service neutron] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:45:50.377466 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e8fa42-215e-4f59-a051-0956fd5fc157 service neutron] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:45:50.377741 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e8fa42-215e-4f59-a051-0956fd5fc157 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:45:50.386471 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e8fa42-215e-4f59-a051-0956fd5fc157 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:45:50.387880 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e8fa42-215e-4f59-a051-0956fd5fc157 service neutron] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:45:50.396973 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 716/1450] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Oct 12 16:45:50 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:45:50.748327 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421e8d8b-7b9d-4c15-9758-a4d42e7dd90a None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:45:50.750026 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-421e8d8b-7b9d-4c15-9758-a4d42e7dd90a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:45:50.761552 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421e8d8b-7b9d-4c15-9758-a4d42e7dd90a None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:45:50.766907 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff30897-18ef-497e-903e-a8beef9688ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:45:50.767798 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff30897-18ef-497e-903e-a8beef9688ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:45:50.768087 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff30897-18ef-497e-903e-a8beef9688ea admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:45:50.768365 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff30897-18ef-497e-903e-a8beef9688ea admin admin] PATH_INFO: `/v3/projects/0db787c9f462472582f0232261df26bd` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:45:50.769645 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff30897-18ef-497e-903e-a8beef9688ea admin admin] RBAC: Authorizing `identity:delete_project(project_id=0db787c9f462472582f0232261df26bd)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:45:50.770787 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: WARNING py.warnings [None req-6ff30897-18ef-497e-903e-a8beef9688ea admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:delete_project failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 12 16:45:50.770787 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: warnings.warn(msg) Oct 12 16:45:50.770787 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: Oct 12 16:45:50.771962 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff30897-18ef-497e-903e-a8beef9688ea admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:45:50.848887 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-6ff30897-18ef-497e-903e-a8beef9688ea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0db787c9f462472582f0232261df26bd', 'request_id': 'req-6ff30897-18ef-497e-903e-a8beef9688ea'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:45:50.854554 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-6ff30897-18ef-497e-903e-a8beef9688ea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0db787c9f462472582f0232261df26bd', 'request_id': 'req-6ff30897-18ef-497e-903e-a8beef9688ea'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:45:50.867177 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-6ff30897-18ef-497e-903e-a8beef9688ea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0db787c9f462472582f0232261df26bd', 'request_id': 'req-6ff30897-18ef-497e-903e-a8beef9688ea'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:45:50.881805 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-6ff30897-18ef-497e-903e-a8beef9688ea admin admin] The token cache is being invalidate because project 0db787c9f462472582f0232261df26bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=85204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 16:45:50.882124 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-6ff30897-18ef-497e-903e-a8beef9688ea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:45:50.882840 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-6ff30897-18ef-497e-903e-a8beef9688ea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:45:50.884371 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 735/1451] 10.222.0.58 () {58 vars in 1232 bytes} [Tue Oct 12 16:45:50 2021] DELETE /identity/v3/projects/0db787c9f462472582f0232261df26bd => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:47:22.046558 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103906fd-e984-4ebc-b693-dc42c8968b8e None None] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:47:22.047164 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103906fd-e984-4ebc-b693-dc42c8968b8e None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:47:22.047164 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103906fd-e984-4ebc-b693-dc42c8968b8e None None] PATH_INFO: `/v3` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:47:22.048418 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 717/1452] 10.222.0.43 () {54 vars in 925 bytes} [Tue Oct 12 16:47:22 2021] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:47:22.055547 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d72676b-72e7-4405-a3b2-b9491fd72701 None None] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:47:22.056004 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d72676b-72e7-4405-a3b2-b9491fd72701 None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:47:22.056107 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d72676b-72e7-4405-a3b2-b9491fd72701 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:47:22.074465 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.auth.core [None req-0d72676b-72e7-4405-a3b2-b9491fd72701 None None] MFA Rules not processed for user `4102412c40bc4745bba8c31f1caf9788`. Rule list: `[]` (Enabled: `True`). {{(pid=85204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:47:22.075678 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-0d72676b-72e7-4405-a3b2-b9491fd72701 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:47:22.138051 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 736/1453] 10.222.0.43 () {58 vars in 1015 bytes} [Tue Oct 12 16:47:22 2021] POST /identity/v3/auth/tokens => generated 3451 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:47:22.335205 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b0f1d9-64d6-4e57-9700-783aaca4bc8b None None] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:47:22.335413 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b0f1d9-64d6-4e57-9700-783aaca4bc8b None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:47:22.335684 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b0f1d9-64d6-4e57-9700-783aaca4bc8b None None] PATH_INFO: `/` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:47:22.337472 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 718/1454] 127.0.0.1 () {54 vars in 901 bytes} [Tue Oct 12 16:47:22 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:47:22.342872 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf70d37b-7d16-46bb-8463-b3e6cea91c97 None None] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:47:22.343165 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf70d37b-7d16-46bb-8463-b3e6cea91c97 None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:47:22.343444 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf70d37b-7d16-46bb-8463-b3e6cea91c97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:47:22.361417 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.auth.core [None req-cf70d37b-7d16-46bb-8463-b3e6cea91c97 None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:47:22.362656 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-cf70d37b-7d16-46bb-8463-b3e6cea91c97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:47:22.419253 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 737/1455] 127.0.0.1 () {58 vars in 998 bytes} [Tue Oct 12 16:47:22 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:47:22.572408 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b0f1d9-64d6-4e57-9700-783aaca4bc8b None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:47:22.574111 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-56b0f1d9-64d6-4e57-9700-783aaca4bc8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:47:22.651115 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b0f1d9-64d6-4e57-9700-783aaca4bc8b None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:47:22.656430 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d62cb1-e560-4114-aa2d-2b364a1634f0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29d30b574eec4ad3990d77d235c8b424', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:47:22.657070 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d62cb1-e560-4114-aa2d-2b364a1634f0 service nova] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:47:22.657359 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d62cb1-e560-4114-aa2d-2b364a1634f0 service nova] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:47:22.657640 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d62cb1-e560-4114-aa2d-2b364a1634f0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:47:22.666072 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d62cb1-e560-4114-aa2d-2b364a1634f0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:47:22.667640 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d62cb1-e560-4114-aa2d-2b364a1634f0 service nova] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:47:22.676861 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 719/1456] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Oct 12 16:47:22 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:47:24.079458 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7dcbb7-4bab-4580-8831-f14adfd19012 None None] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:47:24.079974 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7dcbb7-4bab-4580-8831-f14adfd19012 None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:47:24.079974 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7dcbb7-4bab-4580-8831-f14adfd19012 None None] PATH_INFO: `/` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:47:24.081680 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 738/1457] 127.0.0.1 () {54 vars in 901 bytes} [Tue Oct 12 16:47:24 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:47:24.086957 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449ba98e-1052-4030-913d-211083c13da2 None None] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:47:24.087393 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449ba98e-1052-4030-913d-211083c13da2 None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:47:24.087578 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449ba98e-1052-4030-913d-211083c13da2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:47:24.105898 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.auth.core [None req-449ba98e-1052-4030-913d-211083c13da2 None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:47:24.107130 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-449ba98e-1052-4030-913d-211083c13da2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:47:24.115793 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 720/1458] 127.0.0.1 () {58 vars in 998 bytes} [Tue Oct 12 16:47:24 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:47:24.268683 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7dcbb7-4bab-4580-8831-f14adfd19012 None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:47:24.283143 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7dcbb7-4bab-4580-8831-f14adfd19012 None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:47:24.289032 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f004af-83ec-491b-82f0-89d58b699895 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29d30b574eec4ad3990d77d235c8b424', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:47:24.289666 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f004af-83ec-491b-82f0-89d58b699895 service nova] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:47:24.289975 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f004af-83ec-491b-82f0-89d58b699895 service nova] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:47:24.290253 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f004af-83ec-491b-82f0-89d58b699895 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:47:24.298046 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f004af-83ec-491b-82f0-89d58b699895 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:47:24.299620 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f004af-83ec-491b-82f0-89d58b699895 service nova] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:47:24.308702 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 739/1459] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Oct 12 16:47:24 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:47:30.463555 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5183269-7beb-434b-808e-2d85151bf98a None None] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:47:30.464018 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5183269-7beb-434b-808e-2d85151bf98a None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:47:30.464122 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5183269-7beb-434b-808e-2d85151bf98a None None] PATH_INFO: `/` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:47:30.465933 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 721/1460] 10.222.0.58 () {54 vars in 960 bytes} [Tue Oct 12 16:47:30 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:47:30.471190 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4649e639-7d31-4d67-b8b0-f1b743bebc55 None None] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:47:30.471648 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4649e639-7d31-4d67-b8b0-f1b743bebc55 None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:47:30.471761 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4649e639-7d31-4d67-b8b0-f1b743bebc55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:47:30.489847 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.auth.core [None req-4649e639-7d31-4d67-b8b0-f1b743bebc55 None None] MFA Rules not processed for user `4102412c40bc4745bba8c31f1caf9788`. Rule list: `[]` (Enabled: `True`). {{(pid=85204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:47:30.491070 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-4649e639-7d31-4d67-b8b0-f1b743bebc55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:47:30.499630 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 740/1461] 10.222.0.58 () {58 vars in 1057 bytes} [Tue Oct 12 16:47:30 2021] POST /identity/v3/auth/tokens => generated 3451 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:47:30.508164 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5183269-7beb-434b-808e-2d85151bf98a None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:47:30.521111 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5183269-7beb-434b-808e-2d85151bf98a None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:47:30.526026 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a1d74b-7260-45e9-8729-c50d5771b61c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4102412c40bc4745bba8c31f1caf9788', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:47:30.526672 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a1d74b-7260-45e9-8729-c50d5771b61c service placement] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:47:30.526951 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a1d74b-7260-45e9-8729-c50d5771b61c service placement] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:47:30.527224 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a1d74b-7260-45e9-8729-c50d5771b61c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:47:30.535077 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a1d74b-7260-45e9-8729-c50d5771b61c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:47:30.536628 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a1d74b-7260-45e9-8729-c50d5771b61c service placement] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:47:30.545723 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 722/1462] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Oct 12 16:47:30 2021] GET /identity/v3/auth/tokens => generated 3451 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:47:36.113866 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f47d61-f132-4c0d-88be-5c98648fc16c None None] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:47:36.114441 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f47d61-f132-4c0d-88be-5c98648fc16c None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:47:36.114441 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f47d61-f132-4c0d-88be-5c98648fc16c None None] PATH_INFO: `/` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:47:36.116204 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 741/1463] 127.0.0.1 () {54 vars in 901 bytes} [Tue Oct 12 16:47:36 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:47:36.121456 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec1fa58-481b-4fca-890b-0bac84da8ff4 None None] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:47:36.121913 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec1fa58-481b-4fca-890b-0bac84da8ff4 None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:47:36.122030 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec1fa58-481b-4fca-890b-0bac84da8ff4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:47:36.139515 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.auth.core [None req-fec1fa58-481b-4fca-890b-0bac84da8ff4 None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:47:36.140684 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-fec1fa58-481b-4fca-890b-0bac84da8ff4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:47:36.148304 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 723/1464] 127.0.0.1 () {58 vars in 998 bytes} [Tue Oct 12 16:47:36 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:47:36.302420 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f47d61-f132-4c0d-88be-5c98648fc16c None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:47:36.316385 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f47d61-f132-4c0d-88be-5c98648fc16c None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:47:36.321743 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f959751-a493-40c9-ba53-3b8d6efd2e89 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29d30b574eec4ad3990d77d235c8b424', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:47:36.322407 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f959751-a493-40c9-ba53-3b8d6efd2e89 service nova] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:47:36.322693 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f959751-a493-40c9-ba53-3b8d6efd2e89 service nova] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:47:36.322967 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f959751-a493-40c9-ba53-3b8d6efd2e89 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:47:36.331389 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f959751-a493-40c9-ba53-3b8d6efd2e89 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:47:36.332955 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f959751-a493-40c9-ba53-3b8d6efd2e89 service nova] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:47:36.342112 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 742/1465] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Oct 12 16:47:36 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:47:37.742301 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534e3662-127b-4904-a0cd-97b9004bd39f None None] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:47:37.742844 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534e3662-127b-4904-a0cd-97b9004bd39f None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:47:37.742844 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534e3662-127b-4904-a0cd-97b9004bd39f None None] PATH_INFO: `/` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:47:37.744641 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 724/1466] 127.0.0.1 () {54 vars in 901 bytes} [Tue Oct 12 16:47:37 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:47:37.750254 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d685655c-8b0c-4c0e-a324-8daa59f2c256 None None] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:47:37.750687 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d685655c-8b0c-4c0e-a324-8daa59f2c256 None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:47:37.750816 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d685655c-8b0c-4c0e-a324-8daa59f2c256 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:47:37.770697 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.auth.core [None req-d685655c-8b0c-4c0e-a324-8daa59f2c256 None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:47:37.771883 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-d685655c-8b0c-4c0e-a324-8daa59f2c256 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:47:37.779887 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 743/1467] 127.0.0.1 () {58 vars in 998 bytes} [Tue Oct 12 16:47:37 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:47:37.932427 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534e3662-127b-4904-a0cd-97b9004bd39f None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:47:37.946923 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534e3662-127b-4904-a0cd-97b9004bd39f None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:47:37.952201 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9fc744-cb40-431e-8097-3970816a0aa6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29d30b574eec4ad3990d77d235c8b424', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:47:37.952824 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9fc744-cb40-431e-8097-3970816a0aa6 service nova] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:47:37.953104 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9fc744-cb40-431e-8097-3970816a0aa6 service nova] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:47:37.953377 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9fc744-cb40-431e-8097-3970816a0aa6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:47:37.961059 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9fc744-cb40-431e-8097-3970816a0aa6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:47:37.962648 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9fc744-cb40-431e-8097-3970816a0aa6 service nova] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:47:37.971561 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 725/1468] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Oct 12 16:47:37 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:47:42.182361 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11609e3d-b685-4ccc-ae42-bc9c35cbc095 None None] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:47:42.182914 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11609e3d-b685-4ccc-ae42-bc9c35cbc095 None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:47:42.182914 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11609e3d-b685-4ccc-ae42-bc9c35cbc095 None None] PATH_INFO: `/` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:47:42.184668 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 744/1469] 127.0.0.1 () {54 vars in 916 bytes} [Tue Oct 12 16:47:42 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:47:42.190952 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8711c266-0c61-4f8b-a64b-950e143c0bb2 None None] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:47:42.191395 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8711c266-0c61-4f8b-a64b-950e143c0bb2 None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:47:42.191520 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8711c266-0c61-4f8b-a64b-950e143c0bb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:47:42.209643 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.auth.core [None req-8711c266-0c61-4f8b-a64b-950e143c0bb2 None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:47:42.210888 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-8711c266-0c61-4f8b-a64b-950e143c0bb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:47:42.218643 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 726/1470] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Oct 12 16:47:42 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:47:42.258735 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11609e3d-b685-4ccc-ae42-bc9c35cbc095 None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:47:42.260426 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-11609e3d-b685-4ccc-ae42-bc9c35cbc095 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:47:42.313412 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11609e3d-b685-4ccc-ae42-bc9c35cbc095 None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:47:42.317495 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25c9972-76b3-401f-b854-c6773e99a577 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e65f6d0598e4c539134292b86fb43d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:47:42.318230 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25c9972-76b3-401f-b854-c6773e99a577 service neutron] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:47:42.318507 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25c9972-76b3-401f-b854-c6773e99a577 service neutron] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:47:42.318776 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25c9972-76b3-401f-b854-c6773e99a577 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:47:42.327218 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25c9972-76b3-401f-b854-c6773e99a577 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:47:42.328623 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25c9972-76b3-401f-b854-c6773e99a577 service neutron] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:47:42.337535 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 745/1471] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Oct 12 16:47:42 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:47:44.577139 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee09db59-1d63-4a92-979a-0ff20ff5b870 None None] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:47:44.577709 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee09db59-1d63-4a92-979a-0ff20ff5b870 None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:47:44.577709 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee09db59-1d63-4a92-979a-0ff20ff5b870 None None] PATH_INFO: `/` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:47:44.580052 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 727/1472] 127.0.0.1 () {54 vars in 916 bytes} [Tue Oct 12 16:47:44 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:47:44.586084 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afa42ea-5b0d-4e30-a248-72e904a2b283 None None] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:47:44.586520 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afa42ea-5b0d-4e30-a248-72e904a2b283 None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:47:44.586646 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afa42ea-5b0d-4e30-a248-72e904a2b283 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:47:44.604679 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.auth.core [None req-8afa42ea-5b0d-4e30-a248-72e904a2b283 None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:47:44.605866 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-8afa42ea-5b0d-4e30-a248-72e904a2b283 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:47:44.613610 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 746/1473] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Oct 12 16:47:44 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:47:44.650457 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee09db59-1d63-4a92-979a-0ff20ff5b870 None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:47:44.661362 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee09db59-1d63-4a92-979a-0ff20ff5b870 None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:47:44.664986 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b89921e-e42d-4b99-a077-f90b90f14c40 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e65f6d0598e4c539134292b86fb43d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:47:44.665612 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b89921e-e42d-4b99-a077-f90b90f14c40 service neutron] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:47:44.665929 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b89921e-e42d-4b99-a077-f90b90f14c40 service neutron] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:47:44.666211 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b89921e-e42d-4b99-a077-f90b90f14c40 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:47:44.674840 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b89921e-e42d-4b99-a077-f90b90f14c40 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:47:44.676246 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b89921e-e42d-4b99-a077-f90b90f14c40 service neutron] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:47:44.685320 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 728/1474] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Oct 12 16:47:44 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:47:48.513483 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae5ee38-571d-4428-b2a1-c7ea5af09006 None None] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:47:48.514123 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae5ee38-571d-4428-b2a1-c7ea5af09006 None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:47:48.514123 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae5ee38-571d-4428-b2a1-c7ea5af09006 None None] PATH_INFO: `/` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:47:48.516370 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 747/1475] 127.0.0.1 () {54 vars in 916 bytes} [Tue Oct 12 16:47:48 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:47:48.522196 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab19d5d0-9008-4289-ade1-1c7982eb9d62 None None] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:47:48.522621 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab19d5d0-9008-4289-ade1-1c7982eb9d62 None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:47:48.522760 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab19d5d0-9008-4289-ade1-1c7982eb9d62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:47:48.540963 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.auth.core [None req-ab19d5d0-9008-4289-ade1-1c7982eb9d62 None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:47:48.542195 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-ab19d5d0-9008-4289-ade1-1c7982eb9d62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:47:48.549894 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 729/1476] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Oct 12 16:47:48 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:47:48.601554 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae5ee38-571d-4428-b2a1-c7ea5af09006 None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:47:48.603229 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-5ae5ee38-571d-4428-b2a1-c7ea5af09006 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:47:48.658566 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae5ee38-571d-4428-b2a1-c7ea5af09006 None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:47:48.662135 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a33c60-af64-440a-9ef6-760983667e6f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04704222b3d64a33a6c092fc641ccbb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:47:48.662774 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a33c60-af64-440a-9ef6-760983667e6f service cinder] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:47:48.663059 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a33c60-af64-440a-9ef6-760983667e6f service cinder] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:47:48.663333 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a33c60-af64-440a-9ef6-760983667e6f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:47:48.671890 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a33c60-af64-440a-9ef6-760983667e6f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:47:48.673316 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a33c60-af64-440a-9ef6-760983667e6f service cinder] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:47:48.682312 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 748/1477] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Oct 12 16:47:48 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:47:50.918992 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509665dc-3279-4d8f-9257-3061cd0cf3e8 None None] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:47:50.919535 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509665dc-3279-4d8f-9257-3061cd0cf3e8 None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:47:50.919535 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509665dc-3279-4d8f-9257-3061cd0cf3e8 None None] PATH_INFO: `/` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:47:50.921327 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 730/1478] 127.0.0.1 () {54 vars in 916 bytes} [Tue Oct 12 16:47:50 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:47:50.926981 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6b5764-a4dd-4675-9e58-7f9e201d5d75 None None] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:47:50.927393 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6b5764-a4dd-4675-9e58-7f9e201d5d75 None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:47:50.927533 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6b5764-a4dd-4675-9e58-7f9e201d5d75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:47:50.945145 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.auth.core [None req-9c6b5764-a4dd-4675-9e58-7f9e201d5d75 None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:47:50.946357 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-9c6b5764-a4dd-4675-9e58-7f9e201d5d75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:47:50.954527 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 749/1479] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Oct 12 16:47:50 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:47:51.005408 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92019ab6-bd29-4101-b53a-24038bdfc811 None None] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:47:51.005696 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92019ab6-bd29-4101-b53a-24038bdfc811 None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:47:51.006016 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92019ab6-bd29-4101-b53a-24038bdfc811 None None] PATH_INFO: `/` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:47:51.007801 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 731/1480] 10.222.0.58 () {54 vars in 962 bytes} [Tue Oct 12 16:47:51 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:47:51.013069 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f05795-5fd9-4b7c-af37-f02ea84f6f08 None None] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:47:51.013361 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f05795-5fd9-4b7c-af37-f02ea84f6f08 None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:47:51.013639 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f05795-5fd9-4b7c-af37-f02ea84f6f08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:47:51.031849 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.auth.core [None req-e4f05795-5fd9-4b7c-af37-f02ea84f6f08 None None] MFA Rules not processed for user `04704222b3d64a33a6c092fc641ccbb0`. Rule list: `[]` (Enabled: `True`). {{(pid=85204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:47:51.033011 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-e4f05795-5fd9-4b7c-af37-f02ea84f6f08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:47:51.039324 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 750/1481] 10.222.0.58 () {58 vars in 1059 bytes} [Tue Oct 12 16:47:51 2021] POST /identity/v3/auth/tokens => generated 3263 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:47:51.047016 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92019ab6-bd29-4101-b53a-24038bdfc811 None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:47:51.057235 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92019ab6-bd29-4101-b53a-24038bdfc811 None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:47:51.060751 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a356ee-40ec-413a-95d4-42344b3a4746 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04704222b3d64a33a6c092fc641ccbb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:47:51.061412 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a356ee-40ec-413a-95d4-42344b3a4746 service cinder] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:47:51.061650 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a356ee-40ec-413a-95d4-42344b3a4746 service cinder] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:47:51.061961 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a356ee-40ec-413a-95d4-42344b3a4746 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:47:51.071049 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a356ee-40ec-413a-95d4-42344b3a4746 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:47:51.072459 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a356ee-40ec-413a-95d4-42344b3a4746 service cinder] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:47:51.082125 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 732/1482] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Oct 12 16:47:51 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 12 16:49:10.938595 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3769525-44ea-4308-83d7-ea0945905563 None None] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:10.939167 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3769525-44ea-4308-83d7-ea0945905563 None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:10.939167 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3769525-44ea-4308-83d7-ea0945905563 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:10.958833 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.auth.core [None req-a3769525-44ea-4308-83d7-ea0945905563 None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:49:10.960376 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-a3769525-44ea-4308-83d7-ea0945905563 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:49:10.972832 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 751/1483] 10.222.0.58 () {58 vars in 957 bytes} [Tue Oct 12 16:49:10 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:49:10.982147 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcfbc15-a03b-4e4e-a817-e9223a0274bc None None] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:10.982750 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcfbc15-a03b-4e4e-a817-e9223a0274bc None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:10.982750 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcfbc15-a03b-4e4e-a817-e9223a0274bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:11.010828 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.auth.core [None req-1fcfbc15-a03b-4e4e-a817-e9223a0274bc None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:49:11.012055 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-1fcfbc15-a03b-4e4e-a817-e9223a0274bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:49:11.026240 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 733/1484] 10.222.0.58 () {58 vars in 957 bytes} [Tue Oct 12 16:49:10 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:49:11.030970 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3769525-44ea-4308-83d7-ea0945905563 None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:11.045575 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3769525-44ea-4308-83d7-ea0945905563 None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:11.050966 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f3e719-d6fb-4e5b-8a0f-74ecfd847863 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:11.051903 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f3e719-d6fb-4e5b-8a0f-74ecfd847863 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:11.052427 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f3e719-d6fb-4e5b-8a0f-74ecfd847863 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:11.052927 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f3e719-d6fb-4e5b-8a0f-74ecfd847863 admin admin] PATH_INFO: `/v3/domains` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:11.053903 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f3e719-d6fb-4e5b-8a0f-74ecfd847863 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:49:11.054438 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f3e719-d6fb-4e5b-8a0f-74ecfd847863 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:11.056305 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f3e719-d6fb-4e5b-8a0f-74ecfd847863 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:11.074297 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 752/1485] 10.222.0.58 () {58 vars in 1152 bytes} [Tue Oct 12 16:49:11 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:49:11.082873 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcfbc15-a03b-4e4e-a817-e9223a0274bc None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:11.098363 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcfbc15-a03b-4e4e-a817-e9223a0274bc None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:11.104053 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cec9120-ce82-49cf-89eb-cbaf5dff6657 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:11.105104 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cec9120-ce82-49cf-89eb-cbaf5dff6657 admin admin] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:11.105400 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cec9120-ce82-49cf-89eb-cbaf5dff6657 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:11.105680 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cec9120-ce82-49cf-89eb-cbaf5dff6657 admin admin] PATH_INFO: `/v3/projects` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:11.106463 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cec9120-ce82-49cf-89eb-cbaf5dff6657 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:11.108384 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cec9120-ce82-49cf-89eb-cbaf5dff6657 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:11.146009 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 734/1486] 10.222.0.58 () {60 vars in 1152 bytes} [Tue Oct 12 16:49:11 2021] POST /identity/v3/projects => generated 385 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:49:11.150574 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f3e719-d6fb-4e5b-8a0f-74ecfd847863 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:11.163797 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f3e719-d6fb-4e5b-8a0f-74ecfd847863 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:11.205793 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dfd85e-b2ec-43a4-af4e-252b9bc1f669 None None] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:11.206890 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dfd85e-b2ec-43a4-af4e-252b9bc1f669 None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:11.207398 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dfd85e-b2ec-43a4-af4e-252b9bc1f669 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:11.242638 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13654250-f912-4b1c-963c-88c4a906d3f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:11.243367 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13654250-f912-4b1c-963c-88c4a906d3f0 admin admin] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:11.243659 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13654250-f912-4b1c-963c-88c4a906d3f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:11.243937 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13654250-f912-4b1c-963c-88c4a906d3f0 admin admin] PATH_INFO: `/v3/users` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:11.244925 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13654250-f912-4b1c-963c-88c4a906d3f0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:11.247243 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13654250-f912-4b1c-963c-88c4a906d3f0 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:11.249688 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.auth.core [None req-92dfd85e-b2ec-43a4-af4e-252b9bc1f669 None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:49:11.255671 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-92dfd85e-b2ec-43a4-af4e-252b9bc1f669 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:49:11.276517 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 735/1487] 10.222.0.58 () {58 vars in 957 bytes} [Tue Oct 12 16:49:11 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:49:11.283166 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 753/1488] 10.222.0.58 () {60 vars in 1143 bytes} [Tue Oct 12 16:49:11 2021] POST /identity/v3/users => generated 293 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:49:11.286193 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71249b41-ecb1-46ff-9701-c58cf606ada7 None None] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:11.286675 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71249b41-ecb1-46ff-9701-c58cf606ada7 None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:11.287122 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71249b41-ecb1-46ff-9701-c58cf606ada7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:11.293131 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13654250-f912-4b1c-963c-88c4a906d3f0 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:11.313637 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13654250-f912-4b1c-963c-88c4a906d3f0 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:11.319488 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.auth.core [None req-71249b41-ecb1-46ff-9701-c58cf606ada7 None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:49:11.322668 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-71249b41-ecb1-46ff-9701-c58cf606ada7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:49:11.325526 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8b895b-6652-4176-9ee6-41bfbcbd0e40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:11.326576 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8b895b-6652-4176-9ee6-41bfbcbd0e40 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:11.327030 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8b895b-6652-4176-9ee6-41bfbcbd0e40 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:11.327469 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8b895b-6652-4176-9ee6-41bfbcbd0e40 admin admin] PATH_INFO: `/v3/roles` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:11.329331 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8b895b-6652-4176-9ee6-41bfbcbd0e40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:11.332591 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8b895b-6652-4176-9ee6-41bfbcbd0e40 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:11.342573 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 736/1489] 10.222.0.58 () {58 vars in 957 bytes} [Tue Oct 12 16:49:11 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:49:11.344356 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b231e4a1-1c93-4ea6-8954-bd05b3b31363 None None] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:11.344877 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b231e4a1-1c93-4ea6-8954-bd05b3b31363 None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:11.345374 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b231e4a1-1c93-4ea6-8954-bd05b3b31363 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:11.353864 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 754/1490] 10.222.0.58 () {58 vars in 1121 bytes} [Tue Oct 12 16:49:11 2021] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:49:11.359754 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8b895b-6652-4176-9ee6-41bfbcbd0e40 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:11.378922 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.auth.core [None req-b231e4a1-1c93-4ea6-8954-bd05b3b31363 None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:49:11.380123 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-b231e4a1-1c93-4ea6-8954-bd05b3b31363 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:49:11.382411 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8b895b-6652-4176-9ee6-41bfbcbd0e40 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:11.396668 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 737/1491] 10.222.0.58 () {58 vars in 957 bytes} [Tue Oct 12 16:49:11 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:49:11.398248 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b231e4a1-1c93-4ea6-8954-bd05b3b31363 None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:11.406548 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278d5539-e08e-4e65-afad-6e6fc6fbbec0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:11.407506 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278d5539-e08e-4e65-afad-6e6fc6fbbec0 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:11.408041 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278d5539-e08e-4e65-afad-6e6fc6fbbec0 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:11.408521 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278d5539-e08e-4e65-afad-6e6fc6fbbec0 admin admin] PATH_INFO: `/v3/domains` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:11.409454 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278d5539-e08e-4e65-afad-6e6fc6fbbec0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:49:11.409988 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278d5539-e08e-4e65-afad-6e6fc6fbbec0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:11.411825 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278d5539-e08e-4e65-afad-6e6fc6fbbec0 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:11.416472 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b231e4a1-1c93-4ea6-8954-bd05b3b31363 None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:11.433326 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 755/1492] 10.222.0.58 () {58 vars in 1152 bytes} [Tue Oct 12 16:49:11 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:49:11.435103 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefc6d76-4af8-428d-ace4-3cfb0a3889a3 None None] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:11.435606 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefc6d76-4af8-428d-ace4-3cfb0a3889a3 None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:11.436105 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefc6d76-4af8-428d-ace4-3cfb0a3889a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:11.440109 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad009bf-7828-4faa-b63b-c0502d22e31b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:11.440109 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad009bf-7828-4faa-b63b-c0502d22e31b admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:11.440109 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad009bf-7828-4faa-b63b-c0502d22e31b admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:11.440109 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad009bf-7828-4faa-b63b-c0502d22e31b admin admin] PATH_INFO: `/v3/roles` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:11.440497 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad009bf-7828-4faa-b63b-c0502d22e31b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:11.442101 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad009bf-7828-4faa-b63b-c0502d22e31b admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:11.465921 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 738/1493] 10.222.0.58 () {58 vars in 1121 bytes} [Tue Oct 12 16:49:11 2021] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:49:11.465921 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad009bf-7828-4faa-b63b-c0502d22e31b admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:11.468530 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.auth.core [None req-fefc6d76-4af8-428d-ace4-3cfb0a3889a3 None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:49:11.469779 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-fefc6d76-4af8-428d-ace4-3cfb0a3889a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:49:11.486260 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 756/1494] 10.222.0.58 () {58 vars in 957 bytes} [Tue Oct 12 16:49:11 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:49:11.487084 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefc6d76-4af8-428d-ace4-3cfb0a3889a3 None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:11.496361 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad009bf-7828-4faa-b63b-c0502d22e31b admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:11.504585 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefc6d76-4af8-428d-ace4-3cfb0a3889a3 None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:11.515890 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fc914e-eed1-4898-8ea3-520ed3a55b3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:11.517158 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fc914e-eed1-4898-8ea3-520ed3a55b3d admin admin] REQUEST_METHOD: `PUT` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:11.517452 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fc914e-eed1-4898-8ea3-520ed3a55b3d admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:11.517737 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fc914e-eed1-4898-8ea3-520ed3a55b3d admin admin] PATH_INFO: `/v3/projects/587528e2662a4cb89eedea831874bc2e/users/49dd187c457749a28e3d03315af4ee76/roles/55ba49fe29884e64b57c3ad13188d554` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:11.521521 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cabfd39-1dca-468d-afe7-15de491ab997 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:11.522225 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cabfd39-1dca-468d-afe7-15de491ab997 admin admin] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:11.522511 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cabfd39-1dca-468d-afe7-15de491ab997 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:11.522789 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cabfd39-1dca-468d-afe7-15de491ab997 admin admin] PATH_INFO: `/v3/projects` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:11.523502 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cabfd39-1dca-468d-afe7-15de491ab997 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:11.526615 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cabfd39-1dca-468d-afe7-15de491ab997 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:11.546426 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fc914e-eed1-4898-8ea3-520ed3a55b3d admin admin] RBAC: Authorizing `identity:create_grant(project_id=587528e2662a4cb89eedea831874bc2e, user_id=49dd187c457749a28e3d03315af4ee76, role_id=55ba49fe29884e64b57c3ad13188d554)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:11.550049 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fc914e-eed1-4898-8ea3-520ed3a55b3d admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:11.576628 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 757/1495] 10.222.0.58 () {60 vars in 1482 bytes} [Tue Oct 12 16:49:11 2021] PUT /identity/v3/projects/587528e2662a4cb89eedea831874bc2e/users/49dd187c457749a28e3d03315af4ee76/roles/55ba49fe29884e64b57c3ad13188d554 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:49:11.578237 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8df9a9-958c-4afd-804f-01dee12a268b None None] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:11.578546 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8df9a9-958c-4afd-804f-01dee12a268b None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:11.578834 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8df9a9-958c-4afd-804f-01dee12a268b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:11.592265 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 739/1496] 10.222.0.58 () {60 vars in 1152 bytes} [Tue Oct 12 16:49:11 2021] POST /identity/v3/projects => generated 365 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:49:11.593503 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cabfd39-1dca-468d-afe7-15de491ab997 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:11.604706 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.auth.core [None req-5f8df9a9-958c-4afd-804f-01dee12a268b None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:49:11.605934 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-5f8df9a9-958c-4afd-804f-01dee12a268b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:49:11.654848 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cabfd39-1dca-468d-afe7-15de491ab997 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:11.659373 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dc32f6-1069-4e4b-8d1c-c67a1f09573e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:11.660035 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dc32f6-1069-4e4b-8d1c-c67a1f09573e admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:11.660321 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dc32f6-1069-4e4b-8d1c-c67a1f09573e admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:11.660601 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dc32f6-1069-4e4b-8d1c-c67a1f09573e admin admin] PATH_INFO: `/v3/domains` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:11.661338 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03dc32f6-1069-4e4b-8d1c-c67a1f09573e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:49:11.661651 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03dc32f6-1069-4e4b-8d1c-c67a1f09573e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:11.662426 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 758/1497] 10.222.0.58 () {58 vars in 957 bytes} [Tue Oct 12 16:49:11 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:49:11.663299 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03dc32f6-1069-4e4b-8d1c-c67a1f09573e admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:11.663705 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b34dcc-6ca4-49bc-8b06-06a44641f02e None None] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:11.663991 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b34dcc-6ca4-49bc-8b06-06a44641f02e None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:11.664267 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b34dcc-6ca4-49bc-8b06-06a44641f02e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:11.675362 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 740/1498] 10.222.0.58 () {58 vars in 1152 bytes} [Tue Oct 12 16:49:11 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:49:11.676850 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2d89a8-b5d9-47af-8534-24d72c9db521 None None] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:11.676969 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2d89a8-b5d9-47af-8534-24d72c9db521 None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:11.677217 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2d89a8-b5d9-47af-8534-24d72c9db521 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:11.683130 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.auth.core [None req-84b34dcc-6ca4-49bc-8b06-06a44641f02e None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:49:11.684316 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-84b34dcc-6ca4-49bc-8b06-06a44641f02e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:49:11.691977 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 759/1499] 10.222.0.58 () {58 vars in 957 bytes} [Tue Oct 12 16:49:11 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:49:11.693317 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c42e58b-80dd-45e7-9e02-f0bd2e81f38d None None] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:11.693598 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c42e58b-80dd-45e7-9e02-f0bd2e81f38d None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:11.693869 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c42e58b-80dd-45e7-9e02-f0bd2e81f38d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:11.695147 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.auth.core [None req-8e2d89a8-b5d9-47af-8534-24d72c9db521 None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:49:11.696351 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-8e2d89a8-b5d9-47af-8534-24d72c9db521 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:49:11.704344 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 741/1500] 10.222.0.58 () {58 vars in 957 bytes} [Tue Oct 12 16:49:11 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:49:11.705582 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4613be98-414c-407e-b084-9467fcb7a262 None None] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:11.705896 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4613be98-414c-407e-b084-9467fcb7a262 None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:11.706182 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4613be98-414c-407e-b084-9467fcb7a262 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:11.721485 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.auth.core [None req-1c42e58b-80dd-45e7-9e02-f0bd2e81f38d None None] MFA Rules not processed for user `49dd187c457749a28e3d03315af4ee76`. Rule list: `[]` (Enabled: `True`). {{(pid=85204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:49:11.722796 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-1c42e58b-80dd-45e7-9e02-f0bd2e81f38d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:49:11.723673 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.auth.core [None req-4613be98-414c-407e-b084-9467fcb7a262 None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:49:11.724843 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-4613be98-414c-407e-b084-9467fcb7a262 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:49:11.733218 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 742/1501] 10.222.0.58 () {58 vars in 957 bytes} [Tue Oct 12 16:49:11 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:49:11.733996 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4613be98-414c-407e-b084-9467fcb7a262 None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:11.743240 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4613be98-414c-407e-b084-9467fcb7a262 None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:11.748753 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ca970c-a44b-45ea-af09-8653c7907ff9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:11.749412 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ca970c-a44b-45ea-af09-8653c7907ff9 admin admin] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:11.749699 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ca970c-a44b-45ea-af09-8653c7907ff9 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:11.750033 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ca970c-a44b-45ea-af09-8653c7907ff9 admin admin] PATH_INFO: `/v3/users` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:11.750739 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ca970c-a44b-45ea-af09-8653c7907ff9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:11.752633 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ca970c-a44b-45ea-af09-8653c7907ff9 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:11.772518 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 743/1502] 10.222.0.58 () {60 vars in 1143 bytes} [Tue Oct 12 16:49:11 2021] POST /identity/v3/users => generated 283 bytes in 39 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:49:11.773765 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254fb0a8-86f6-4964-949d-7677a75e585c None None] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:11.774109 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254fb0a8-86f6-4964-949d-7677a75e585c None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:11.774393 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254fb0a8-86f6-4964-949d-7677a75e585c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:11.791694 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 760/1503] 10.222.0.58 () {58 vars in 957 bytes} [Tue Oct 12 16:49:11 2021] POST /identity/v3/auth/tokens => generated 3405 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:49:11.792976 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae193c2c-4430-4049-9567-20d05b3d3e75 None None] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:11.793236 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.auth.core [None req-254fb0a8-86f6-4964-949d-7677a75e585c None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:49:11.793330 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae193c2c-4430-4049-9567-20d05b3d3e75 None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:11.793525 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae193c2c-4430-4049-9567-20d05b3d3e75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:11.794864 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-254fb0a8-86f6-4964-949d-7677a75e585c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:49:11.802956 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 744/1504] 10.222.0.58 () {58 vars in 957 bytes} [Tue Oct 12 16:49:11 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:49:11.804039 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254fb0a8-86f6-4964-949d-7677a75e585c None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:11.813632 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254fb0a8-86f6-4964-949d-7677a75e585c None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:11.814767 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.auth.core [None req-ae193c2c-4430-4049-9567-20d05b3d3e75 None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:49:11.816019 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-ae193c2c-4430-4049-9567-20d05b3d3e75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:49:11.819137 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032c945e-e0b3-42c3-ba78-c775416c253d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:11.819799 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032c945e-e0b3-42c3-ba78-c775416c253d admin admin] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:11.820082 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032c945e-e0b3-42c3-ba78-c775416c253d admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:11.820360 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032c945e-e0b3-42c3-ba78-c775416c253d admin admin] PATH_INFO: `/v3/projects` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:11.821062 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032c945e-e0b3-42c3-ba78-c775416c253d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:11.823020 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032c945e-e0b3-42c3-ba78-c775416c253d admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:11.823845 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 761/1505] 10.222.0.58 () {58 vars in 957 bytes} [Tue Oct 12 16:49:11 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:49:11.827574 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4052d2e8-ab77-4732-a972-0baf13307c07 None None] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:11.827806 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4052d2e8-ab77-4732-a972-0baf13307c07 None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:11.828081 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4052d2e8-ab77-4732-a972-0baf13307c07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:11.845788 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.auth.core [None req-4052d2e8-ab77-4732-a972-0baf13307c07 None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:49:11.846979 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-4052d2e8-ab77-4732-a972-0baf13307c07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:49:11.851747 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 745/1506] 10.222.0.58 () {60 vars in 1152 bytes} [Tue Oct 12 16:49:11 2021] POST /identity/v3/projects => generated 379 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:49:11.851747 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761734af-9f00-4683-9249-17baafa9ead0 None None] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:11.851747 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761734af-9f00-4683-9249-17baafa9ead0 None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:11.851747 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761734af-9f00-4683-9249-17baafa9ead0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:11.868866 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.auth.core [None req-761734af-9f00-4683-9249-17baafa9ead0 None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:49:11.870092 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-761734af-9f00-4683-9249-17baafa9ead0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:49:11.904241 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 762/1507] 10.222.0.58 () {58 vars in 957 bytes} [Tue Oct 12 16:49:11 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:49:11.905536 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77e29ba-84f0-4b83-b618-53ce3f363671 None None] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:11.905817 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77e29ba-84f0-4b83-b618-53ce3f363671 None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:11.906119 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77e29ba-84f0-4b83-b618-53ce3f363671 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:11.923921 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.auth.core [None req-f77e29ba-84f0-4b83-b618-53ce3f363671 None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:49:11.925104 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-f77e29ba-84f0-4b83-b618-53ce3f363671 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:49:11.926979 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 746/1508] 10.222.0.58 () {58 vars in 957 bytes} [Tue Oct 12 16:49:11 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:49:11.927656 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761734af-9f00-4683-9249-17baafa9ead0 None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:11.937180 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 763/1509] 10.222.0.58 () {58 vars in 957 bytes} [Tue Oct 12 16:49:11 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:49:11.938444 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade72630-ee9e-402e-96c8-7b3d3ac4804c None None] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:11.938911 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade72630-ee9e-402e-96c8-7b3d3ac4804c None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:11.939458 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade72630-ee9e-402e-96c8-7b3d3ac4804c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:11.939713 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761734af-9f00-4683-9249-17baafa9ead0 None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:11.944558 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1815102e-8180-42b2-9a7b-c1011d9a3ed4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:11.945214 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1815102e-8180-42b2-9a7b-c1011d9a3ed4 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:11.945491 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1815102e-8180-42b2-9a7b-c1011d9a3ed4 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:11.945762 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1815102e-8180-42b2-9a7b-c1011d9a3ed4 admin admin] PATH_INFO: `/v3/roles` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:11.946579 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1815102e-8180-42b2-9a7b-c1011d9a3ed4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:11.948166 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1815102e-8180-42b2-9a7b-c1011d9a3ed4 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:11.956564 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.auth.core [None req-ade72630-ee9e-402e-96c8-7b3d3ac4804c None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:49:11.957748 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-ade72630-ee9e-402e-96c8-7b3d3ac4804c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:49:11.958155 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 747/1510] 10.222.0.58 () {58 vars in 1121 bytes} [Tue Oct 12 16:49:11 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:49:11.960223 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb30cc4-151b-48f5-b05c-44bafa16dd1e None None] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:11.960586 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb30cc4-151b-48f5-b05c-44bafa16dd1e None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:11.960939 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb30cc4-151b-48f5-b05c-44bafa16dd1e None None] PATH_INFO: `/` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:11.963185 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 748/1511] 10.222.0.58 () {54 vars in 960 bytes} [Tue Oct 12 16:49:11 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:49:11.966583 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 764/1512] 10.222.0.58 () {58 vars in 957 bytes} [Tue Oct 12 16:49:11 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:49:11.967402 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade72630-ee9e-402e-96c8-7b3d3ac4804c None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:11.968684 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb30cc4-151b-48f5-b05c-44bafa16dd1e None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:11.976537 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade72630-ee9e-402e-96c8-7b3d3ac4804c None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:11.981581 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcf459a-f6ec-4397-b9d8-260c8c474400 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:11.982247 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcf459a-f6ec-4397-b9d8-260c8c474400 admin admin] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:11.982531 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcf459a-f6ec-4397-b9d8-260c8c474400 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:11.982665 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb30cc4-151b-48f5-b05c-44bafa16dd1e None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:11.983110 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcf459a-f6ec-4397-b9d8-260c8c474400 admin admin] PATH_INFO: `/v3/users` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:11.983484 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcf459a-f6ec-4397-b9d8-260c8c474400 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:11.985379 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcf459a-f6ec-4397-b9d8-260c8c474400 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:11.987515 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184f74d9-679a-4f98-9595-e89353cc4d8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:11.988145 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184f74d9-679a-4f98-9595-e89353cc4d8a admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:11.988429 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184f74d9-679a-4f98-9595-e89353cc4d8a admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:11.988747 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184f74d9-679a-4f98-9595-e89353cc4d8a admin admin] PATH_INFO: `/v3/domains` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:11.989454 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184f74d9-679a-4f98-9595-e89353cc4d8a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:49:11.989797 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184f74d9-679a-4f98-9595-e89353cc4d8a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:11.991665 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184f74d9-679a-4f98-9595-e89353cc4d8a admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:12.004997 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 749/1513] 10.222.0.58 () {58 vars in 1152 bytes} [Tue Oct 12 16:49:11 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:49:12.005806 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184f74d9-679a-4f98-9595-e89353cc4d8a admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:12.005954 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 765/1514] 10.222.0.58 () {60 vars in 1143 bytes} [Tue Oct 12 16:49:11 2021] POST /identity/v3/users => generated 290 bytes in 39 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:49:12.006672 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcf459a-f6ec-4397-b9d8-260c8c474400 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:12.016827 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcf459a-f6ec-4397-b9d8-260c8c474400 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:12.017524 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184f74d9-679a-4f98-9595-e89353cc4d8a admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:12.023214 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d6f608-7fc9-4451-85cd-26abe3ca4984 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:12.023374 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f2dedc-c836-4c2e-9639-206e9844e936 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:12.023866 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d6f608-7fc9-4451-85cd-26abe3ca4984 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:12.023976 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f2dedc-c836-4c2e-9639-206e9844e936 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:12.024150 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d6f608-7fc9-4451-85cd-26abe3ca4984 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:12.024244 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f2dedc-c836-4c2e-9639-206e9844e936 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:12.024425 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d6f608-7fc9-4451-85cd-26abe3ca4984 admin admin] PATH_INFO: `/v3/domains` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:12.025066 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f2dedc-c836-4c2e-9639-206e9844e936 admin admin] PATH_INFO: `/v3/domains` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:12.025717 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d6f608-7fc9-4451-85cd-26abe3ca4984 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:49:12.026061 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d6f608-7fc9-4451-85cd-26abe3ca4984 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:12.026159 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f2dedc-c836-4c2e-9639-206e9844e936 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:49:12.026402 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f2dedc-c836-4c2e-9639-206e9844e936 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:12.027654 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d6f608-7fc9-4451-85cd-26abe3ca4984 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:12.027971 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f2dedc-c836-4c2e-9639-206e9844e936 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:12.039406 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 766/1515] 10.222.0.58 () {58 vars in 1152 bytes} [Tue Oct 12 16:49:12 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:49:12.040290 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 750/1516] 10.222.0.58 () {58 vars in 1152 bytes} [Tue Oct 12 16:49:12 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:49:12.041790 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f2dedc-c836-4c2e-9639-206e9844e936 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:12.042692 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d6f608-7fc9-4451-85cd-26abe3ca4984 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:12.052646 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f2dedc-c836-4c2e-9639-206e9844e936 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:12.055386 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d6f608-7fc9-4451-85cd-26abe3ca4984 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:12.057361 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ef3b93-f6b5-4e95-b6bb-0b3c97f2d456 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:12.058084 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ef3b93-f6b5-4e95-b6bb-0b3c97f2d456 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:12.058367 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ef3b93-f6b5-4e95-b6bb-0b3c97f2d456 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:12.058637 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ef3b93-f6b5-4e95-b6bb-0b3c97f2d456 admin admin] PATH_INFO: `/v3/roles` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:12.059362 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ef3b93-f6b5-4e95-b6bb-0b3c97f2d456 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:12.059983 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f1b337-4336-468f-8872-84b495022bc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:12.060693 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f1b337-4336-468f-8872-84b495022bc8 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:12.060926 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ef3b93-f6b5-4e95-b6bb-0b3c97f2d456 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:12.061030 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f1b337-4336-468f-8872-84b495022bc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:12.061241 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f1b337-4336-468f-8872-84b495022bc8 admin admin] PATH_INFO: `/v3/domains` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:12.062029 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f1b337-4336-468f-8872-84b495022bc8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:49:12.062334 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f1b337-4336-468f-8872-84b495022bc8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:12.063885 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f1b337-4336-468f-8872-84b495022bc8 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:12.071718 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 751/1517] 10.222.0.58 () {58 vars in 1121 bytes} [Tue Oct 12 16:49:12 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:49:12.072491 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ef3b93-f6b5-4e95-b6bb-0b3c97f2d456 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:12.075588 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 767/1518] 10.222.0.58 () {58 vars in 1152 bytes} [Tue Oct 12 16:49:12 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:49:12.076834 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd76d3ba-d07c-4f14-a982-333cc7c4ce18 None None] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:12.077131 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd76d3ba-d07c-4f14-a982-333cc7c4ce18 None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:12.077417 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd76d3ba-d07c-4f14-a982-333cc7c4ce18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:12.083536 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ef3b93-f6b5-4e95-b6bb-0b3c97f2d456 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:12.088546 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a83cc10-add5-459c-82c3-7de87843c75d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:12.089177 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a83cc10-add5-459c-82c3-7de87843c75d admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:12.089460 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a83cc10-add5-459c-82c3-7de87843c75d admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:12.089730 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a83cc10-add5-459c-82c3-7de87843c75d admin admin] PATH_INFO: `/v3/domains` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:12.090523 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a83cc10-add5-459c-82c3-7de87843c75d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:49:12.090826 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a83cc10-add5-459c-82c3-7de87843c75d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:12.092395 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a83cc10-add5-459c-82c3-7de87843c75d admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:12.099254 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.auth.core [None req-fd76d3ba-d07c-4f14-a982-333cc7c4ce18 None None] MFA Rules not processed for user `29d30b574eec4ad3990d77d235c8b424`. Rule list: `[]` (Enabled: `True`). {{(pid=85204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:49:12.100443 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-fd76d3ba-d07c-4f14-a982-333cc7c4ce18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:49:12.103874 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 752/1519] 10.222.0.58 () {58 vars in 1152 bytes} [Tue Oct 12 16:49:12 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:49:12.104691 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a83cc10-add5-459c-82c3-7de87843c75d admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:12.113959 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a83cc10-add5-459c-82c3-7de87843c75d admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:12.118752 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ef4145-0a52-4d52-91a8-ab519dca2d81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:12.119394 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ef4145-0a52-4d52-91a8-ab519dca2d81 admin admin] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:12.119679 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ef4145-0a52-4d52-91a8-ab519dca2d81 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:12.119949 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ef4145-0a52-4d52-91a8-ab519dca2d81 admin admin] PATH_INFO: `/v3/projects` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:12.120628 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ef4145-0a52-4d52-91a8-ab519dca2d81 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:12.122492 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ef4145-0a52-4d52-91a8-ab519dca2d81 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:12.148727 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 753/1520] 10.222.0.58 () {60 vars in 1152 bytes} [Tue Oct 12 16:49:12 2021] POST /identity/v3/projects => generated 387 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:49:12.150258 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ef4145-0a52-4d52-91a8-ab519dca2d81 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:12.167273 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 768/1521] 10.222.0.58 () {58 vars in 1057 bytes} [Tue Oct 12 16:49:12 2021] POST /identity/v3/auth/tokens => generated 3515 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:49:12.168081 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd76d3ba-d07c-4f14-a982-333cc7c4ce18 None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:12.177399 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd76d3ba-d07c-4f14-a982-333cc7c4ce18 None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:12.208006 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ef4145-0a52-4d52-91a8-ab519dca2d81 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:12.213096 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4495709f-ff17-4ed0-b0cc-645d6dd0312d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:12.213756 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4495709f-ff17-4ed0-b0cc-645d6dd0312d admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:12.214067 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4495709f-ff17-4ed0-b0cc-645d6dd0312d admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:12.214337 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4495709f-ff17-4ed0-b0cc-645d6dd0312d admin admin] PATH_INFO: `/v3/roles` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:12.215065 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4495709f-ff17-4ed0-b0cc-645d6dd0312d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:12.216635 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4495709f-ff17-4ed0-b0cc-645d6dd0312d admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:12.226221 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 754/1522] 10.222.0.58 () {58 vars in 1121 bytes} [Tue Oct 12 16:49:12 2021] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:49:12.227137 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4495709f-ff17-4ed0-b0cc-645d6dd0312d admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:12.230936 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002d9bb8-ff38-474b-9b60-e7c3f0ee9370 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:12.231591 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002d9bb8-ff38-474b-9b60-e7c3f0ee9370 admin admin] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:12.231877 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002d9bb8-ff38-474b-9b60-e7c3f0ee9370 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:12.232155 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002d9bb8-ff38-474b-9b60-e7c3f0ee9370 admin admin] PATH_INFO: `/v3/projects` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:12.232859 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002d9bb8-ff38-474b-9b60-e7c3f0ee9370 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:12.234762 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002d9bb8-ff38-474b-9b60-e7c3f0ee9370 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:12.236324 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4495709f-ff17-4ed0-b0cc-645d6dd0312d admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:12.240824 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685cf2fb-edeb-4c99-ac47-f7a89d5c9dd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:12.241699 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685cf2fb-edeb-4c99-ac47-f7a89d5c9dd9 admin admin] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:12.242014 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685cf2fb-edeb-4c99-ac47-f7a89d5c9dd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:12.242289 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685cf2fb-edeb-4c99-ac47-f7a89d5c9dd9 admin admin] PATH_INFO: `/v3/projects` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:12.242967 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685cf2fb-edeb-4c99-ac47-f7a89d5c9dd9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:12.244918 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685cf2fb-edeb-4c99-ac47-f7a89d5c9dd9 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:12.260008 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 769/1523] 10.222.0.58 () {60 vars in 1152 bytes} [Tue Oct 12 16:49:12 2021] POST /identity/v3/projects => generated 371 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:49:12.260874 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002d9bb8-ff38-474b-9b60-e7c3f0ee9370 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:12.272869 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 755/1524] 10.222.0.58 () {60 vars in 1152 bytes} [Tue Oct 12 16:49:12 2021] POST /identity/v3/projects => generated 373 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:49:12.277735 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685cf2fb-edeb-4c99-ac47-f7a89d5c9dd9 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:12.318719 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002d9bb8-ff38-474b-9b60-e7c3f0ee9370 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:12.334823 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685cf2fb-edeb-4c99-ac47-f7a89d5c9dd9 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:12.340044 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12b7d12-823f-4aa7-bc1e-b2a4e649a3a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:12.340703 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12b7d12-823f-4aa7-bc1e-b2a4e649a3a1 admin admin] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:12.340984 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12b7d12-823f-4aa7-bc1e-b2a4e649a3a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:12.341258 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12b7d12-823f-4aa7-bc1e-b2a4e649a3a1 admin admin] PATH_INFO: `/v3/projects` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:12.342012 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12b7d12-823f-4aa7-bc1e-b2a4e649a3a1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:12.343883 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12b7d12-823f-4aa7-bc1e-b2a4e649a3a1 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:12.368979 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 756/1525] 10.222.0.58 () {60 vars in 1152 bytes} [Tue Oct 12 16:49:12 2021] POST /identity/v3/projects => generated 391 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:49:12.369755 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12b7d12-823f-4aa7-bc1e-b2a4e649a3a1 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:12.374316 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd725c7-d80a-4817-ae8f-f471213f7415 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:12.375206 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd725c7-d80a-4817-ae8f-f471213f7415 admin admin] REQUEST_METHOD: `PUT` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:12.375489 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd725c7-d80a-4817-ae8f-f471213f7415 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:12.375760 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd725c7-d80a-4817-ae8f-f471213f7415 admin admin] PATH_INFO: `/v3/projects/967de0d1fc57499591a7ebbfdaf1857e/users/0a47cb1dbcdd4d53bb5acd4f29848bfe/roles/55ba49fe29884e64b57c3ad13188d554` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:12.390918 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd725c7-d80a-4817-ae8f-f471213f7415 admin admin] RBAC: Authorizing `identity:create_grant(project_id=967de0d1fc57499591a7ebbfdaf1857e, user_id=0a47cb1dbcdd4d53bb5acd4f29848bfe, role_id=55ba49fe29884e64b57c3ad13188d554)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:12.393534 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd725c7-d80a-4817-ae8f-f471213f7415 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:12.406807 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 770/1526] 10.222.0.58 () {60 vars in 1482 bytes} [Tue Oct 12 16:49:12 2021] PUT /identity/v3/projects/967de0d1fc57499591a7ebbfdaf1857e/users/0a47cb1dbcdd4d53bb5acd4f29848bfe/roles/55ba49fe29884e64b57c3ad13188d554 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:49:12.407571 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd725c7-d80a-4817-ae8f-f471213f7415 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:12.429513 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12b7d12-823f-4aa7-bc1e-b2a4e649a3a1 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:12.467985 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd725c7-d80a-4817-ae8f-f471213f7415 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:12.476213 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea0d6fc-69fe-495c-bcf8-9971ace77e7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:12.476876 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea0d6fc-69fe-495c-bcf8-9971ace77e7d admin admin] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:12.477159 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea0d6fc-69fe-495c-bcf8-9971ace77e7d admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:12.477445 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea0d6fc-69fe-495c-bcf8-9971ace77e7d admin admin] PATH_INFO: `/v3/users` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:12.478441 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea0d6fc-69fe-495c-bcf8-9971ace77e7d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:12.480895 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea0d6fc-69fe-495c-bcf8-9971ace77e7d admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:12.493028 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d9f72f-0375-41e3-988e-ec64756a943c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:12.494306 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d9f72f-0375-41e3-988e-ec64756a943c admin admin] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:12.494717 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d9f72f-0375-41e3-988e-ec64756a943c admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:12.497256 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d9f72f-0375-41e3-988e-ec64756a943c admin admin] PATH_INFO: `/v3/projects` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:12.498114 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d9f72f-0375-41e3-988e-ec64756a943c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:12.500237 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d9f72f-0375-41e3-988e-ec64756a943c admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:12.505831 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 771/1527] 10.222.0.58 () {60 vars in 1143 bytes} [Tue Oct 12 16:49:12 2021] POST /identity/v3/users => generated 294 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:49:12.506684 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea0d6fc-69fe-495c-bcf8-9971ace77e7d admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:12.536351 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 757/1528] 10.222.0.58 () {60 vars in 1152 bytes} [Tue Oct 12 16:49:12 2021] POST /identity/v3/projects => generated 377 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:49:12.537265 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d9f72f-0375-41e3-988e-ec64756a943c admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:12.581033 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea0d6fc-69fe-495c-bcf8-9971ace77e7d admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:12.597241 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d9f72f-0375-41e3-988e-ec64756a943c admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:12.602034 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a757402-4f90-42e4-9481-081452d2756f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:12.602731 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a757402-4f90-42e4-9481-081452d2756f admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:12.603061 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a757402-4f90-42e4-9481-081452d2756f admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:12.603321 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a757402-4f90-42e4-9481-081452d2756f admin admin] PATH_INFO: `/v3/roles` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:12.604059 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a757402-4f90-42e4-9481-081452d2756f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:12.605655 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a757402-4f90-42e4-9481-081452d2756f admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:12.615421 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 758/1529] 10.222.0.58 () {58 vars in 1121 bytes} [Tue Oct 12 16:49:12 2021] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:49:12.619125 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a757402-4f90-42e4-9481-081452d2756f admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:12.628279 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a757402-4f90-42e4-9481-081452d2756f admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:12.632867 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ace703-8ef8-4d90-820b-1f7bb24cd5b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:12.633486 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ace703-8ef8-4d90-820b-1f7bb24cd5b5 admin admin] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:12.633776 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ace703-8ef8-4d90-820b-1f7bb24cd5b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:12.634626 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ace703-8ef8-4d90-820b-1f7bb24cd5b5 admin admin] PATH_INFO: `/v3/users` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:12.635310 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ace703-8ef8-4d90-820b-1f7bb24cd5b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:12.637173 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ace703-8ef8-4d90-820b-1f7bb24cd5b5 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:12.642341 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6a6e03-d90c-4f71-a40b-29d43a7cdd1d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29d30b574eec4ad3990d77d235c8b424', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:12.643116 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6a6e03-d90c-4f71-a40b-29d43a7cdd1d service nova] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:12.643408 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6a6e03-d90c-4f71-a40b-29d43a7cdd1d service nova] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:12.643745 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6a6e03-d90c-4f71-a40b-29d43a7cdd1d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:12.657233 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 759/1530] 10.222.0.58 () {60 vars in 1143 bytes} [Tue Oct 12 16:49:12 2021] POST /identity/v3/users => generated 286 bytes in 39 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:49:12.658229 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ace703-8ef8-4d90-820b-1f7bb24cd5b5 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:12.667554 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ace703-8ef8-4d90-820b-1f7bb24cd5b5 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:12.672492 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1ef7f3-bdb1-4c86-9204-857a616c9ec3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:12.673123 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1ef7f3-bdb1-4c86-9204-857a616c9ec3 admin admin] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:12.673409 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1ef7f3-bdb1-4c86-9204-857a616c9ec3 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:12.673687 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1ef7f3-bdb1-4c86-9204-857a616c9ec3 admin admin] PATH_INFO: `/v3/users` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:12.674415 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1ef7f3-bdb1-4c86-9204-857a616c9ec3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:12.676307 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1ef7f3-bdb1-4c86-9204-857a616c9ec3 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:12.696425 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 760/1531] 10.222.0.58 () {60 vars in 1143 bytes} [Tue Oct 12 16:49:12 2021] POST /identity/v3/users => generated 287 bytes in 39 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:49:12.698100 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1ef7f3-bdb1-4c86-9204-857a616c9ec3 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:12.700019 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6a6e03-d90c-4f71-a40b-29d43a7cdd1d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:12.701626 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6a6e03-d90c-4f71-a40b-29d43a7cdd1d service nova] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:12.707021 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1ef7f3-bdb1-4c86-9204-857a616c9ec3 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:12.710309 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 772/1532] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Oct 12 16:49:12 2021] GET /identity/v3/auth/tokens => generated 3405 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:49:12.711561 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9b4083-28b0-40b1-b589-815c8503a02b None None] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:12.711724 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a15d7ce-58d9-44e7-b3f3-532ca83bca8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:12.711844 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9b4083-28b0-40b1-b589-815c8503a02b None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:12.712186 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9b4083-28b0-40b1-b589-815c8503a02b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:12.712400 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a15d7ce-58d9-44e7-b3f3-532ca83bca8d admin admin] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:12.712689 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a15d7ce-58d9-44e7-b3f3-532ca83bca8d admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:12.712968 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a15d7ce-58d9-44e7-b3f3-532ca83bca8d admin admin] PATH_INFO: `/v3/users` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:12.713661 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a15d7ce-58d9-44e7-b3f3-532ca83bca8d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:12.715579 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a15d7ce-58d9-44e7-b3f3-532ca83bca8d admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:12.736434 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 761/1533] 10.222.0.58 () {60 vars in 1143 bytes} [Tue Oct 12 16:49:12 2021] POST /identity/v3/users => generated 296 bytes in 39 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:49:12.737922 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a15d7ce-58d9-44e7-b3f3-532ca83bca8d admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:12.738513 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.auth.core [None req-4e9b4083-28b0-40b1-b589-815c8503a02b None None] MFA Rules not processed for user `0a47cb1dbcdd4d53bb5acd4f29848bfe`. Rule list: `[]` (Enabled: `True`). {{(pid=85204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:49:12.739686 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-4e9b4083-28b0-40b1-b589-815c8503a02b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:49:12.750664 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a15d7ce-58d9-44e7-b3f3-532ca83bca8d admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:12.755853 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957032ef-16fb-472d-b24d-0fee89ed23bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:12.756591 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957032ef-16fb-472d-b24d-0fee89ed23bb admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:12.756951 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957032ef-16fb-472d-b24d-0fee89ed23bb admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:12.757331 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957032ef-16fb-472d-b24d-0fee89ed23bb admin admin] PATH_INFO: `/v3/roles` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:12.758180 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957032ef-16fb-472d-b24d-0fee89ed23bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:12.760385 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957032ef-16fb-472d-b24d-0fee89ed23bb admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:12.770097 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 762/1534] 10.222.0.58 () {58 vars in 1121 bytes} [Tue Oct 12 16:49:12 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:49:12.770982 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957032ef-16fb-472d-b24d-0fee89ed23bb admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:12.780455 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957032ef-16fb-472d-b24d-0fee89ed23bb admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:12.785730 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a55901-da30-4303-ad04-28bc663cedf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:12.786384 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a55901-da30-4303-ad04-28bc663cedf9 admin admin] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:12.786673 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a55901-da30-4303-ad04-28bc663cedf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:12.786953 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a55901-da30-4303-ad04-28bc663cedf9 admin admin] PATH_INFO: `/v3/users` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:12.787744 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a55901-da30-4303-ad04-28bc663cedf9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:12.789850 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a55901-da30-4303-ad04-28bc663cedf9 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:12.809090 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 773/1535] 10.222.0.58 () {58 vars in 957 bytes} [Tue Oct 12 16:49:12 2021] POST /identity/v3/auth/tokens => generated 3385 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:49:12.809090 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9b4083-28b0-40b1-b589-815c8503a02b None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:12.819395 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 763/1536] 10.222.0.58 () {60 vars in 1143 bytes} [Tue Oct 12 16:49:12 2021] POST /identity/v3/users => generated 289 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:49:12.819832 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9b4083-28b0-40b1-b589-815c8503a02b None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:12.820342 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a55901-da30-4303-ad04-28bc663cedf9 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:12.827376 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859dfd99-5c56-4695-8618-d885926cea2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:12.828285 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859dfd99-5c56-4695-8618-d885926cea2a admin admin] REQUEST_METHOD: `PUT` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:12.828561 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859dfd99-5c56-4695-8618-d885926cea2a admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:12.828867 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859dfd99-5c56-4695-8618-d885926cea2a admin admin] PATH_INFO: `/v3/projects/87933a36279c4f6ab6dcb9851bbe8c65/users/6ae30926375e4c75a3939a7694db6561/roles/55ba49fe29884e64b57c3ad13188d554` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:12.831261 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a55901-da30-4303-ad04-28bc663cedf9 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:12.836092 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959509ed-ef57-4b8d-9ede-04d9e4c9c96d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:12.836745 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959509ed-ef57-4b8d-9ede-04d9e4c9c96d admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:12.837061 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959509ed-ef57-4b8d-9ede-04d9e4c9c96d admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:12.837538 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959509ed-ef57-4b8d-9ede-04d9e4c9c96d admin admin] PATH_INFO: `/v3/roles` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:12.838302 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959509ed-ef57-4b8d-9ede-04d9e4c9c96d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:12.839878 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959509ed-ef57-4b8d-9ede-04d9e4c9c96d admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:12.843808 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859dfd99-5c56-4695-8618-d885926cea2a admin admin] RBAC: Authorizing `identity:create_grant(project_id=87933a36279c4f6ab6dcb9851bbe8c65, user_id=6ae30926375e4c75a3939a7694db6561, role_id=55ba49fe29884e64b57c3ad13188d554)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:12.846811 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859dfd99-5c56-4695-8618-d885926cea2a admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:12.850868 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 764/1537] 10.222.0.58 () {58 vars in 1121 bytes} [Tue Oct 12 16:49:12 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:49:12.855158 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959509ed-ef57-4b8d-9ede-04d9e4c9c96d admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:12.861669 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 774/1538] 10.222.0.58 () {60 vars in 1482 bytes} [Tue Oct 12 16:49:12 2021] PUT /identity/v3/projects/87933a36279c4f6ab6dcb9851bbe8c65/users/6ae30926375e4c75a3939a7694db6561/roles/55ba49fe29884e64b57c3ad13188d554 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:49:12.862379 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859dfd99-5c56-4695-8618-d885926cea2a admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:12.869714 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959509ed-ef57-4b8d-9ede-04d9e4c9c96d admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:12.924617 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5abec2-410d-4201-8081-9d698fe5dfc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:12.925528 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859dfd99-5c56-4695-8618-d885926cea2a admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:12.925627 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5abec2-410d-4201-8081-9d698fe5dfc7 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:12.925715 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5abec2-410d-4201-8081-9d698fe5dfc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:12.926014 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5abec2-410d-4201-8081-9d698fe5dfc7 admin admin] PATH_INFO: `/v3/roles` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:12.926694 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5abec2-410d-4201-8081-9d698fe5dfc7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:12.928260 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5abec2-410d-4201-8081-9d698fe5dfc7 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:12.930394 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e83c9f6-58e6-4765-9539-0aa65b7a5848 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:12.931562 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e83c9f6-58e6-4765-9539-0aa65b7a5848 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:12.931856 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e83c9f6-58e6-4765-9539-0aa65b7a5848 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:12.932136 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e83c9f6-58e6-4765-9539-0aa65b7a5848 admin admin] PATH_INFO: `/v3/roles` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:12.932883 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e83c9f6-58e6-4765-9539-0aa65b7a5848 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:12.934502 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e83c9f6-58e6-4765-9539-0aa65b7a5848 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:12.938751 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 765/1539] 10.222.0.58 () {58 vars in 1121 bytes} [Tue Oct 12 16:49:12 2021] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:49:12.939416 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5abec2-410d-4201-8081-9d698fe5dfc7 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:12.947900 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 775/1540] 10.222.0.58 () {58 vars in 1121 bytes} [Tue Oct 12 16:49:12 2021] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:49:12.947900 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e83c9f6-58e6-4765-9539-0aa65b7a5848 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:12.952630 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5abec2-410d-4201-8081-9d698fe5dfc7 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:12.958463 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34047360-97cb-40d6-aa07-543836ba22c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:12.959121 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34047360-97cb-40d6-aa07-543836ba22c8 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:12.959402 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34047360-97cb-40d6-aa07-543836ba22c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:12.959675 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34047360-97cb-40d6-aa07-543836ba22c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:12.960400 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34047360-97cb-40d6-aa07-543836ba22c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:12.962066 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34047360-97cb-40d6-aa07-543836ba22c8 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:12.971835 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 766/1541] 10.222.0.58 () {58 vars in 1121 bytes} [Tue Oct 12 16:49:12 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:49:12.972608 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34047360-97cb-40d6-aa07-543836ba22c8 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:12.982250 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34047360-97cb-40d6-aa07-543836ba22c8 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:12.986844 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3831d96-e2df-4589-ab69-2de34d32da50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:12.987476 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3831d96-e2df-4589-ab69-2de34d32da50 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:12.987738 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3831d96-e2df-4589-ab69-2de34d32da50 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:12.988012 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3831d96-e2df-4589-ab69-2de34d32da50 admin admin] PATH_INFO: `/v3/roles` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:12.988723 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3831d96-e2df-4589-ab69-2de34d32da50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:12.990311 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3831d96-e2df-4589-ab69-2de34d32da50 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:13.001209 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 767/1542] 10.222.0.58 () {58 vars in 1121 bytes} [Tue Oct 12 16:49:12 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:49:13.001823 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3831d96-e2df-4589-ab69-2de34d32da50 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:13.007168 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e83c9f6-58e6-4765-9539-0aa65b7a5848 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:13.010877 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f7aa28-2c07-4b8c-b571-2c4f7d0f7e3a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04704222b3d64a33a6c092fc641ccbb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:13.011525 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3831d96-e2df-4589-ab69-2de34d32da50 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:13.011631 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f7aa28-2c07-4b8c-b571-2c4f7d0f7e3a service cinder] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:13.011809 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f7aa28-2c07-4b8c-b571-2c4f7d0f7e3a service cinder] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:13.012124 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f7aa28-2c07-4b8c-b571-2c4f7d0f7e3a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:13.016284 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708c88bb-21f9-4284-8dad-5bb20445af4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:13.016922 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708c88bb-21f9-4284-8dad-5bb20445af4f admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:13.017254 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708c88bb-21f9-4284-8dad-5bb20445af4f admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:13.017537 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708c88bb-21f9-4284-8dad-5bb20445af4f admin admin] PATH_INFO: `/v3/roles` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:13.018337 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708c88bb-21f9-4284-8dad-5bb20445af4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:13.019891 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708c88bb-21f9-4284-8dad-5bb20445af4f admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:13.029540 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 768/1543] 10.222.0.58 () {58 vars in 1121 bytes} [Tue Oct 12 16:49:13 2021] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:49:13.030840 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5aedb22-83db-44b8-8a07-cc20a424047d None None] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:13.031132 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5aedb22-83db-44b8-8a07-cc20a424047d None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:13.031411 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5aedb22-83db-44b8-8a07-cc20a424047d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:13.049698 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.auth.core [None req-d5aedb22-83db-44b8-8a07-cc20a424047d None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:49:13.050963 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-d5aedb22-83db-44b8-8a07-cc20a424047d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:49:13.059410 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 769/1544] 10.222.0.58 () {58 vars in 957 bytes} [Tue Oct 12 16:49:13 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:49:13.060354 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5aedb22-83db-44b8-8a07-cc20a424047d None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:13.069136 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f7aa28-2c07-4b8c-b571-2c4f7d0f7e3a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:13.069632 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5aedb22-83db-44b8-8a07-cc20a424047d None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:13.070663 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f7aa28-2c07-4b8c-b571-2c4f7d0f7e3a service cinder] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:13.074023 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bece7ef3-2f6c-41d6-8c00-34752db3f4b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:13.074692 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bece7ef3-2f6c-41d6-8c00-34752db3f4b8 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:13.074977 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bece7ef3-2f6c-41d6-8c00-34752db3f4b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:13.075255 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bece7ef3-2f6c-41d6-8c00-34752db3f4b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:13.075983 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bece7ef3-2f6c-41d6-8c00-34752db3f4b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:13.077540 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bece7ef3-2f6c-41d6-8c00-34752db3f4b8 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:13.080008 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 776/1545] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Oct 12 16:49:12 2021] GET /identity/v3/auth/tokens => generated 3385 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:49:13.080873 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f7aa28-2c07-4b8c-b571-2c4f7d0f7e3a service cinder] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:13.091311 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 770/1546] 10.222.0.58 () {58 vars in 1121 bytes} [Tue Oct 12 16:49:13 2021] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:49:13.091311 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383bef87-0f06-4680-9bd8-c996cd7a196e None None] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:13.091311 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383bef87-0f06-4680-9bd8-c996cd7a196e None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:13.091311 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383bef87-0f06-4680-9bd8-c996cd7a196e None None] PATH_INFO: `/` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:13.091658 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 771/1547] 10.222.0.58 () {54 vars in 912 bytes} [Tue Oct 12 16:49:13 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:49:13.092911 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f7aa28-2c07-4b8c-b571-2c4f7d0f7e3a service cinder] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:13.096573 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383bef87-0f06-4680-9bd8-c996cd7a196e None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:13.098023 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f78a1a3-0871-4ced-8cf8-683bfed4f35a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:13.098694 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f78a1a3-0871-4ced-8cf8-683bfed4f35a admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:13.098987 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f78a1a3-0871-4ced-8cf8-683bfed4f35a admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:13.099268 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f78a1a3-0871-4ced-8cf8-683bfed4f35a admin admin] PATH_INFO: `/v3/roles` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:13.100013 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f78a1a3-0871-4ced-8cf8-683bfed4f35a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:13.101905 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f78a1a3-0871-4ced-8cf8-683bfed4f35a admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:13.109504 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383bef87-0f06-4680-9bd8-c996cd7a196e None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:13.116983 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 777/1548] 10.222.0.58 () {58 vars in 1121 bytes} [Tue Oct 12 16:49:13 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:49:13.117115 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34af6c53-37f5-4ec2-941a-9706e2611098 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:13.117240 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f78a1a3-0871-4ced-8cf8-683bfed4f35a admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:13.117328 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34af6c53-37f5-4ec2-941a-9706e2611098 admin admin] REQUEST_METHOD: `PUT` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:13.117328 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34af6c53-37f5-4ec2-941a-9706e2611098 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:13.117328 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34af6c53-37f5-4ec2-941a-9706e2611098 admin admin] PATH_INFO: `/v3/projects/5f15f4248cdd4fc39f8061dc5ebe854d/users/69c3a35689e540b09d83fd072d5011b7/roles/55ba49fe29884e64b57c3ad13188d554` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:13.128583 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f78a1a3-0871-4ced-8cf8-683bfed4f35a admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:13.130959 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34af6c53-37f5-4ec2-941a-9706e2611098 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f15f4248cdd4fc39f8061dc5ebe854d, user_id=69c3a35689e540b09d83fd072d5011b7, role_id=55ba49fe29884e64b57c3ad13188d554)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:13.133608 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3091e292-2fd1-4c0e-b7bf-04ae9034f62d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:13.133846 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34af6c53-37f5-4ec2-941a-9706e2611098 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:13.134482 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3091e292-2fd1-4c0e-b7bf-04ae9034f62d admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:13.134839 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3091e292-2fd1-4c0e-b7bf-04ae9034f62d admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:13.135193 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3091e292-2fd1-4c0e-b7bf-04ae9034f62d admin admin] PATH_INFO: `/v3/roles` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:13.136002 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3091e292-2fd1-4c0e-b7bf-04ae9034f62d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:13.138395 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3091e292-2fd1-4c0e-b7bf-04ae9034f62d admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:13.152245 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 772/1549] 10.222.0.58 () {60 vars in 1482 bytes} [Tue Oct 12 16:49:13 2021] PUT /identity/v3/projects/5f15f4248cdd4fc39f8061dc5ebe854d/users/69c3a35689e540b09d83fd072d5011b7/roles/55ba49fe29884e64b57c3ad13188d554 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:49:13.152245 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34af6c53-37f5-4ec2-941a-9706e2611098 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:13.152466 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 778/1550] 10.222.0.58 () {58 vars in 1121 bytes} [Tue Oct 12 16:49:13 2021] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:49:13.154241 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3091e292-2fd1-4c0e-b7bf-04ae9034f62d admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:13.208504 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3091e292-2fd1-4c0e-b7bf-04ae9034f62d admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:13.213542 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34af6c53-37f5-4ec2-941a-9706e2611098 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:13.218639 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790704c4-d29f-4ce3-b506-f3a049fc60e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:13.219583 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790704c4-d29f-4ce3-b506-f3a049fc60e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:13.219872 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790704c4-d29f-4ce3-b506-f3a049fc60e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:13.220149 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790704c4-d29f-4ce3-b506-f3a049fc60e4 admin admin] PATH_INFO: `/v3/projects/cff5614277984837ac9781297f09f94c/users/10c9e64e87414e3a89af6d8a121112f5/roles/55ba49fe29884e64b57c3ad13188d554` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:13.234688 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790704c4-d29f-4ce3-b506-f3a049fc60e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cff5614277984837ac9781297f09f94c, user_id=10c9e64e87414e3a89af6d8a121112f5, role_id=55ba49fe29884e64b57c3ad13188d554)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:13.237333 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790704c4-d29f-4ce3-b506-f3a049fc60e4 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:13.252261 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 773/1551] 10.222.0.58 () {60 vars in 1482 bytes} [Tue Oct 12 16:49:13 2021] PUT /identity/v3/projects/cff5614277984837ac9781297f09f94c/users/10c9e64e87414e3a89af6d8a121112f5/roles/55ba49fe29884e64b57c3ad13188d554 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:49:13.262021 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790704c4-d29f-4ce3-b506-f3a049fc60e4 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:13.263829 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8409e5-c04b-4bad-b8c8-6be5ebadfbaa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e65f6d0598e4c539134292b86fb43d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:13.264637 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8409e5-c04b-4bad-b8c8-6be5ebadfbaa service neutron] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:13.264926 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8409e5-c04b-4bad-b8c8-6be5ebadfbaa service neutron] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:13.265372 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8409e5-c04b-4bad-b8c8-6be5ebadfbaa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:13.275458 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8409e5-c04b-4bad-b8c8-6be5ebadfbaa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:13.276904 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8409e5-c04b-4bad-b8c8-6be5ebadfbaa service neutron] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:13.287703 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 779/1552] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Oct 12 16:49:13 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:49:13.298867 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8ce317-24e5-471b-9ef6-6ef05f5ae2e5 None None] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:13.299165 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8ce317-24e5-471b-9ef6-6ef05f5ae2e5 None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:13.299449 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8ce317-24e5-471b-9ef6-6ef05f5ae2e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:13.319572 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.auth.core [None req-2a8ce317-24e5-471b-9ef6-6ef05f5ae2e5 None None] MFA Rules not processed for user `29d30b574eec4ad3990d77d235c8b424`. Rule list: `[]` (Enabled: `True`). {{(pid=85204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:49:13.320981 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-2a8ce317-24e5-471b-9ef6-6ef05f5ae2e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:49:13.333313 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790704c4-d29f-4ce3-b506-f3a049fc60e4 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:13.339530 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff50c8a-c4c6-4c36-a3a5-30a031c647f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:13.340561 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff50c8a-c4c6-4c36-a3a5-30a031c647f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:13.340982 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff50c8a-c4c6-4c36-a3a5-30a031c647f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:13.341265 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff50c8a-c4c6-4c36-a3a5-30a031c647f0 admin admin] PATH_INFO: `/v3/projects/5e8ef31aa09644f49a416c24940584f0/users/bb1c2e1b9701480ab06cfed01f98615e/roles/55ba49fe29884e64b57c3ad13188d554` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:13.359190 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff50c8a-c4c6-4c36-a3a5-30a031c647f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e8ef31aa09644f49a416c24940584f0, user_id=bb1c2e1b9701480ab06cfed01f98615e, role_id=55ba49fe29884e64b57c3ad13188d554)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:13.362284 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff50c8a-c4c6-4c36-a3a5-30a031c647f0 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:13.379088 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 774/1553] 10.222.0.58 () {60 vars in 1482 bytes} [Tue Oct 12 16:49:13 2021] PUT /identity/v3/projects/5e8ef31aa09644f49a416c24940584f0/users/bb1c2e1b9701480ab06cfed01f98615e/roles/55ba49fe29884e64b57c3ad13188d554 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:49:13.389963 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff50c8a-c4c6-4c36-a3a5-30a031c647f0 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:13.409698 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 780/1554] 10.222.0.58 () {58 vars in 1009 bytes} [Tue Oct 12 16:49:13 2021] POST /identity/v3/auth/tokens => generated 3515 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:49:13.411309 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd692cb4-1a85-450d-bd49-f84cbb67752b None None] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:13.412222 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd692cb4-1a85-450d-bd49-f84cbb67752b None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:13.412660 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd692cb4-1a85-450d-bd49-f84cbb67752b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:13.437910 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.auth.core [None req-cd692cb4-1a85-450d-bd49-f84cbb67752b None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:49:13.439760 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-cd692cb4-1a85-450d-bd49-f84cbb67752b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:49:13.467346 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff50c8a-c4c6-4c36-a3a5-30a031c647f0 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:13.474295 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c8c37f-63fa-4a67-930a-4d64778b3e39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:13.475465 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c8c37f-63fa-4a67-930a-4d64778b3e39 admin admin] REQUEST_METHOD: `PUT` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:13.475753 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c8c37f-63fa-4a67-930a-4d64778b3e39 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:13.476213 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c8c37f-63fa-4a67-930a-4d64778b3e39 admin admin] PATH_INFO: `/v3/projects/949f49aec9be41038c1b0d4443109b7d/users/c5d7300383ce48df8ec1fe078e1fa789/roles/55ba49fe29884e64b57c3ad13188d554` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:13.498529 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c8c37f-63fa-4a67-930a-4d64778b3e39 admin admin] RBAC: Authorizing `identity:create_grant(project_id=949f49aec9be41038c1b0d4443109b7d, user_id=c5d7300383ce48df8ec1fe078e1fa789, role_id=55ba49fe29884e64b57c3ad13188d554)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:13.502419 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c8c37f-63fa-4a67-930a-4d64778b3e39 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:13.514540 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 781/1555] 10.222.0.58 () {58 vars in 957 bytes} [Tue Oct 12 16:49:13 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:49:13.515383 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd692cb4-1a85-450d-bd49-f84cbb67752b None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:13.526449 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd692cb4-1a85-450d-bd49-f84cbb67752b None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:13.533310 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 775/1556] 10.222.0.58 () {60 vars in 1482 bytes} [Tue Oct 12 16:49:13 2021] PUT /identity/v3/projects/949f49aec9be41038c1b0d4443109b7d/users/c5d7300383ce48df8ec1fe078e1fa789/roles/55ba49fe29884e64b57c3ad13188d554 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:49:13.535154 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aff4ce3-ff74-4aba-8101-f5d3549c7eea None None] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:13.535696 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aff4ce3-ff74-4aba-8101-f5d3549c7eea None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:13.536083 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aff4ce3-ff74-4aba-8101-f5d3549c7eea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:13.588863 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.auth.core [None req-9aff4ce3-ff74-4aba-8101-f5d3549c7eea None None] MFA Rules not processed for user `10c9e64e87414e3a89af6d8a121112f5`. Rule list: `[]` (Enabled: `True`). {{(pid=85205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:49:13.590591 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-9aff4ce3-ff74-4aba-8101-f5d3549c7eea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:49:13.624333 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc541f40-e20f-474c-8754-6b0738ef5cbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:13.626888 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc541f40-e20f-474c-8754-6b0738ef5cbd admin admin] REQUEST_METHOD: `PUT` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:13.627255 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc541f40-e20f-474c-8754-6b0738ef5cbd admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:13.627612 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc541f40-e20f-474c-8754-6b0738ef5cbd admin admin] PATH_INFO: `/v3/projects/2e0c9fd106594f5796ff041037814e2b/users/aef11be7bb50427fb18d1ff2d29e9fac/roles/55ba49fe29884e64b57c3ad13188d554` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:13.654672 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc541f40-e20f-474c-8754-6b0738ef5cbd admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e0c9fd106594f5796ff041037814e2b, user_id=aef11be7bb50427fb18d1ff2d29e9fac, role_id=55ba49fe29884e64b57c3ad13188d554)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:13.658674 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc541f40-e20f-474c-8754-6b0738ef5cbd admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:13.681533 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 782/1557] 10.222.0.58 () {60 vars in 1482 bytes} [Tue Oct 12 16:49:13 2021] PUT /identity/v3/projects/2e0c9fd106594f5796ff041037814e2b/users/aef11be7bb50427fb18d1ff2d29e9fac/roles/55ba49fe29884e64b57c3ad13188d554 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:49:13.682999 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 776/1558] 10.222.0.58 () {58 vars in 957 bytes} [Tue Oct 12 16:49:13 2021] POST /identity/v3/auth/tokens => generated 3391 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:49:13.683894 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aff4ce3-ff74-4aba-8101-f5d3549c7eea None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:13.684973 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000cc9a7-f67b-4373-b040-49437300305f None None] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:13.685804 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000cc9a7-f67b-4373-b040-49437300305f None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:13.686302 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000cc9a7-f67b-4373-b040-49437300305f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:13.719906 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.auth.core [None req-000cc9a7-f67b-4373-b040-49437300305f None None] MFA Rules not processed for user `bb1c2e1b9701480ab06cfed01f98615e`. Rule list: `[]` (Enabled: `True`). {{(pid=85204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:49:13.722369 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-000cc9a7-f67b-4373-b040-49437300305f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:49:13.756228 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aff4ce3-ff74-4aba-8101-f5d3549c7eea None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:13.832207 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0687466a-2646-4d86-b97d-59940c7629db service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04704222b3d64a33a6c092fc641ccbb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:13.832984 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0687466a-2646-4d86-b97d-59940c7629db service cinder] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:13.833357 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0687466a-2646-4d86-b97d-59940c7629db service cinder] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:13.833820 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0687466a-2646-4d86-b97d-59940c7629db service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:13.843292 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 783/1559] 10.222.0.58 () {58 vars in 957 bytes} [Tue Oct 12 16:49:13 2021] POST /identity/v3/auth/tokens => generated 3393 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:49:13.844142 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000cc9a7-f67b-4373-b040-49437300305f None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:13.851907 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-000cc9a7-f67b-4373-b040-49437300305f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:49:13.919232 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0687466a-2646-4d86-b97d-59940c7629db service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:13.920737 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0687466a-2646-4d86-b97d-59940c7629db service cinder] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:13.927092 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000cc9a7-f67b-4373-b040-49437300305f None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:13.930775 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d551f3f0-4a58-4679-8605-6b81c0e85d03 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e65f6d0598e4c539134292b86fb43d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:13.931421 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d551f3f0-4a58-4679-8605-6b81c0e85d03 service neutron] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:13.931701 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d551f3f0-4a58-4679-8605-6b81c0e85d03 service neutron] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:13.931971 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d551f3f0-4a58-4679-8605-6b81c0e85d03 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:13.933670 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 777/1560] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Oct 12 16:49:13 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:49:13.935189 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56be1787-8468-4549-9ff4-c53188583d41 None None] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:13.935581 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56be1787-8468-4549-9ff4-c53188583d41 None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:13.935933 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56be1787-8468-4549-9ff4-c53188583d41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:13.955477 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.auth.core [None req-56be1787-8468-4549-9ff4-c53188583d41 None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:49:13.956713 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-56be1787-8468-4549-9ff4-c53188583d41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:49:14.019019 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d551f3f0-4a58-4679-8605-6b81c0e85d03 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:14.021123 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d551f3f0-4a58-4679-8605-6b81c0e85d03 service neutron] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:14.034043 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 784/1561] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Oct 12 16:49:13 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:49:14.035977 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d25213-da87-4481-9903-272c1a2207dc None None] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:14.036182 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d25213-da87-4481-9903-272c1a2207dc None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:14.036465 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d25213-da87-4481-9903-272c1a2207dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:14.040366 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 778/1562] 10.222.0.58 () {58 vars in 957 bytes} [Tue Oct 12 16:49:13 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:49:14.041503 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc14a68f-558d-476e-a5fd-0662aef3cb6f None None] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:14.041800 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc14a68f-558d-476e-a5fd-0662aef3cb6f None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:14.042107 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc14a68f-558d-476e-a5fd-0662aef3cb6f None None] PATH_INFO: `/` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:14.044600 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 779/1563] 10.222.0.58 () {54 vars in 960 bytes} [Tue Oct 12 16:49:14 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:49:14.045314 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc14a68f-558d-476e-a5fd-0662aef3cb6f None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:14.069847 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.auth.core [None req-f2d25213-da87-4481-9903-272c1a2207dc None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:49:14.071097 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-f2d25213-da87-4481-9903-272c1a2207dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:49:14.077296 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc14a68f-558d-476e-a5fd-0662aef3cb6f None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:14.085488 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f064112c-ea28-47c9-87f5-7a2d36c014ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:14.086184 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f064112c-ea28-47c9-87f5-7a2d36c014ef admin admin] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:14.086667 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f064112c-ea28-47c9-87f5-7a2d36c014ef admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:14.086986 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f064112c-ea28-47c9-87f5-7a2d36c014ef admin admin] PATH_INFO: `/v3/projects` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:14.088209 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f064112c-ea28-47c9-87f5-7a2d36c014ef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:14.091217 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f064112c-ea28-47c9-87f5-7a2d36c014ef admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:14.097063 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 785/1564] 10.222.0.58 () {58 vars in 957 bytes} [Tue Oct 12 16:49:14 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:49:14.097063 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25748a1-7610-41d0-831f-ed86de588737 None None] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:14.097063 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25748a1-7610-41d0-831f-ed86de588737 None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:14.097063 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25748a1-7610-41d0-831f-ed86de588737 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:14.129634 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.auth.core [None req-d25748a1-7610-41d0-831f-ed86de588737 None None] MFA Rules not processed for user `29d30b574eec4ad3990d77d235c8b424`. Rule list: `[]` (Enabled: `True`). {{(pid=85204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:49:14.136111 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-d25748a1-7610-41d0-831f-ed86de588737 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:49:14.143247 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 780/1565] 10.222.0.58 () {60 vars in 1152 bytes} [Tue Oct 12 16:49:14 2021] POST /identity/v3/projects => generated 371 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:49:14.144122 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f064112c-ea28-47c9-87f5-7a2d36c014ef admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:14.162137 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 786/1566] 10.222.0.58 () {58 vars in 1057 bytes} [Tue Oct 12 16:49:14 2021] POST /identity/v3/auth/tokens => generated 3515 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:49:14.163031 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25748a1-7610-41d0-831f-ed86de588737 None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:14.192513 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25748a1-7610-41d0-831f-ed86de588737 None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:14.234099 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f064112c-ea28-47c9-87f5-7a2d36c014ef admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:14.240037 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85188bbd-27ef-49b9-84c1-94e2f2cdc851 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e65f6d0598e4c539134292b86fb43d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:14.240923 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85188bbd-27ef-49b9-84c1-94e2f2cdc851 service neutron] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:14.241617 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85188bbd-27ef-49b9-84c1-94e2f2cdc851 service neutron] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:14.242073 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85188bbd-27ef-49b9-84c1-94e2f2cdc851 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:14.268824 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b7fbd9-f6d4-4b8c-86a7-6ab0cdec63e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e65f6d0598e4c539134292b86fb43d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:14.270759 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b7fbd9-f6d4-4b8c-86a7-6ab0cdec63e6 service neutron] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:14.271087 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b7fbd9-f6d4-4b8c-86a7-6ab0cdec63e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:14.271578 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b7fbd9-f6d4-4b8c-86a7-6ab0cdec63e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:14.360608 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85188bbd-27ef-49b9-84c1-94e2f2cdc851 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:14.362990 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85188bbd-27ef-49b9-84c1-94e2f2cdc851 service neutron] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:14.372549 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b7fbd9-f6d4-4b8c-86a7-6ab0cdec63e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:14.374523 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b7fbd9-f6d4-4b8c-86a7-6ab0cdec63e6 service neutron] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:14.377586 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 781/1567] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Oct 12 16:49:14 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:49:14.378953 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85188bbd-27ef-49b9-84c1-94e2f2cdc851 service neutron] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:14.386820 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 787/1568] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Oct 12 16:49:14 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:49:14.387794 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b7fbd9-f6d4-4b8c-86a7-6ab0cdec63e6 service neutron] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:14.411331 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85188bbd-27ef-49b9-84c1-94e2f2cdc851 service neutron] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:14.417905 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9560dcca-b776-4994-af9b-9dc08d2de671 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:14.418660 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9560dcca-b776-4994-af9b-9dc08d2de671 admin admin] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:14.419138 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9560dcca-b776-4994-af9b-9dc08d2de671 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:14.419431 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9560dcca-b776-4994-af9b-9dc08d2de671 admin admin] PATH_INFO: `/v3/users` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:14.420657 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9560dcca-b776-4994-af9b-9dc08d2de671 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:14.422998 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9560dcca-b776-4994-af9b-9dc08d2de671 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:14.453652 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 782/1569] 10.222.0.58 () {60 vars in 1143 bytes} [Tue Oct 12 16:49:14 2021] POST /identity/v3/users => generated 292 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:49:14.455227 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82b7ac0-ba54-4e40-aad5-7ed43a5640a6 None None] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:14.455526 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82b7ac0-ba54-4e40-aad5-7ed43a5640a6 None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:14.455811 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82b7ac0-ba54-4e40-aad5-7ed43a5640a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:14.489912 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.auth.core [None req-a82b7ac0-ba54-4e40-aad5-7ed43a5640a6 None None] MFA Rules not processed for user `6ae30926375e4c75a3939a7694db6561`. Rule list: `[]` (Enabled: `True`). {{(pid=85205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:49:14.491835 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-a82b7ac0-ba54-4e40-aad5-7ed43a5640a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:49:14.569690 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b7fbd9-f6d4-4b8c-86a7-6ab0cdec63e6 service neutron] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:14.579427 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62672fcc-86a7-4a3d-9d65-9bcf5ad6b9dd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29d30b574eec4ad3990d77d235c8b424', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:14.580510 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62672fcc-86a7-4a3d-9d65-9bcf5ad6b9dd service nova] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:14.581151 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62672fcc-86a7-4a3d-9d65-9bcf5ad6b9dd service nova] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:14.581346 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62672fcc-86a7-4a3d-9d65-9bcf5ad6b9dd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:14.599792 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 783/1570] 10.222.0.58 () {58 vars in 957 bytes} [Tue Oct 12 16:49:14 2021] POST /identity/v3/auth/tokens => generated 3399 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:49:14.600936 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82b7ac0-ba54-4e40-aad5-7ed43a5640a6 None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:14.620032 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82b7ac0-ba54-4e40-aad5-7ed43a5640a6 None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:14.629126 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c39dacf-26e7-4d77-9335-adf13c7a93c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:14.630761 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c39dacf-26e7-4d77-9335-adf13c7a93c0 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:14.631230 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c39dacf-26e7-4d77-9335-adf13c7a93c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:14.631630 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c39dacf-26e7-4d77-9335-adf13c7a93c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:14.632604 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c39dacf-26e7-4d77-9335-adf13c7a93c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:14.634384 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c39dacf-26e7-4d77-9335-adf13c7a93c0 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:14.671259 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62672fcc-86a7-4a3d-9d65-9bcf5ad6b9dd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:14.673193 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62672fcc-86a7-4a3d-9d65-9bcf5ad6b9dd service nova] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:14.692338 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 788/1571] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Oct 12 16:49:14 2021] GET /identity/v3/auth/tokens => generated 3391 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:49:14.694095 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afbea18-744f-428e-8fd3-b294d50f6252 None None] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:14.694326 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afbea18-744f-428e-8fd3-b294d50f6252 None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:14.694653 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afbea18-744f-428e-8fd3-b294d50f6252 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:14.696029 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 784/1572] 10.222.0.58 () {58 vars in 1121 bytes} [Tue Oct 12 16:49:14 2021] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:49:14.702626 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c39dacf-26e7-4d77-9335-adf13c7a93c0 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:14.720261 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.auth.core [None req-9afbea18-744f-428e-8fd3-b294d50f6252 None None] MFA Rules not processed for user `6ae30926375e4c75a3939a7694db6561`. Rule list: `[]` (Enabled: `True`). {{(pid=85204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:49:14.721688 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-9afbea18-744f-428e-8fd3-b294d50f6252 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:49:14.732346 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 789/1573] 10.222.0.58 () {58 vars in 957 bytes} [Tue Oct 12 16:49:14 2021] POST /identity/v3/auth/tokens => generated 3399 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:49:14.738719 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c39dacf-26e7-4d77-9335-adf13c7a93c0 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:14.753068 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c141205-c570-482f-b867-a0054e897409 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:14.754176 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c141205-c570-482f-b867-a0054e897409 admin admin] REQUEST_METHOD: `PUT` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:14.754624 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c141205-c570-482f-b867-a0054e897409 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:14.754983 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c141205-c570-482f-b867-a0054e897409 admin admin] PATH_INFO: `/v3/projects/cc26b104e90f424e99077574c63d13b6/users/d10cacfc3ea14098b22839fdc52e309f/roles/610824e4f50f4fb8954610e98c1de784` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:14.777181 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afbea18-744f-428e-8fd3-b294d50f6252 None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:14.782548 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c141205-c570-482f-b867-a0054e897409 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc26b104e90f424e99077574c63d13b6, user_id=d10cacfc3ea14098b22839fdc52e309f, role_id=610824e4f50f4fb8954610e98c1de784)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:14.791902 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c141205-c570-482f-b867-a0054e897409 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:14.804232 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afbea18-744f-428e-8fd3-b294d50f6252 None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:14.824772 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 785/1574] 10.222.0.58 () {60 vars in 1482 bytes} [Tue Oct 12 16:49:14 2021] PUT /identity/v3/projects/cc26b104e90f424e99077574c63d13b6/users/d10cacfc3ea14098b22839fdc52e309f/roles/610824e4f50f4fb8954610e98c1de784 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:49:14.828157 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fda639-79f4-4631-b8c1-ceb7c4b58fa9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29d30b574eec4ad3990d77d235c8b424', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:14.828470 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c141205-c570-482f-b867-a0054e897409 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:14.829560 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fda639-79f4-4631-b8c1-ceb7c4b58fa9 service nova] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:14.830455 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fda639-79f4-4631-b8c1-ceb7c4b58fa9 service nova] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:14.831153 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fda639-79f4-4631-b8c1-ceb7c4b58fa9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:14.848506 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fda639-79f4-4631-b8c1-ceb7c4b58fa9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:14.852196 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fda639-79f4-4631-b8c1-ceb7c4b58fa9 service nova] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:14.878387 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 790/1575] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Oct 12 16:49:14 2021] GET /identity/v3/auth/tokens => generated 3399 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:49:14.930803 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c141205-c570-482f-b867-a0054e897409 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:14.937042 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37aadb6a-c5c2-4122-b40e-80186038e4fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:14.938010 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37aadb6a-c5c2-4122-b40e-80186038e4fc admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:14.938311 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37aadb6a-c5c2-4122-b40e-80186038e4fc admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:14.938670 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37aadb6a-c5c2-4122-b40e-80186038e4fc admin admin] PATH_INFO: `/v3/roles` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:14.940506 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37aadb6a-c5c2-4122-b40e-80186038e4fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:14.942453 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37aadb6a-c5c2-4122-b40e-80186038e4fc admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:14.957961 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 786/1576] 10.222.0.58 () {58 vars in 1121 bytes} [Tue Oct 12 16:49:14 2021] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 16:49:14.959993 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fda639-79f4-4631-b8c1-ceb7c4b58fa9 service nova] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:14.995913 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fda639-79f4-4631-b8c1-ceb7c4b58fa9 service nova] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:15.000924 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506a2896-d715-48ec-a9b6-0a0c4dc1d280 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:15.001971 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506a2896-d715-48ec-a9b6-0a0c4dc1d280 admin admin] REQUEST_METHOD: `PUT` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:15.002166 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506a2896-d715-48ec-a9b6-0a0c4dc1d280 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:15.002400 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506a2896-d715-48ec-a9b6-0a0c4dc1d280 admin admin] PATH_INFO: `/v3/projects/cc26b104e90f424e99077574c63d13b6/users/d10cacfc3ea14098b22839fdc52e309f/roles/610824e4f50f4fb8954610e98c1de784` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:15.006617 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506a2896-d715-48ec-a9b6-0a0c4dc1d280 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc26b104e90f424e99077574c63d13b6, user_id=d10cacfc3ea14098b22839fdc52e309f, role_id=610824e4f50f4fb8954610e98c1de784)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:15.009289 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506a2896-d715-48ec-a9b6-0a0c4dc1d280 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:15.022086 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 791/1577] 10.222.0.58 () {60 vars in 1482 bytes} [Tue Oct 12 16:49:14 2021] PUT /identity/v3/projects/cc26b104e90f424e99077574c63d13b6/users/d10cacfc3ea14098b22839fdc52e309f/roles/610824e4f50f4fb8954610e98c1de784 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:49:15.035851 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb691d1-e51d-432d-9521-c4a3d1ccd97c None None] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:15.036143 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb691d1-e51d-432d-9521-c4a3d1ccd97c None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:15.036428 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb691d1-e51d-432d-9521-c4a3d1ccd97c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:15.111945 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.auth.core [None req-4eb691d1-e51d-432d-9521-c4a3d1ccd97c None None] MFA Rules not processed for user `d10cacfc3ea14098b22839fdc52e309f`. Rule list: `[]` (Enabled: `True`). {{(pid=85205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:49:15.114379 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-4eb691d1-e51d-432d-9521-c4a3d1ccd97c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:49:15.225010 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e80ed4-bdbd-4eef-962e-ad7e75dd6b7a None None] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:15.225403 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e80ed4-bdbd-4eef-962e-ad7e75dd6b7a None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:15.225775 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e80ed4-bdbd-4eef-962e-ad7e75dd6b7a None None] PATH_INFO: `/` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:15.228380 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 787/1578] 10.222.0.58 () {58 vars in 957 bytes} [Tue Oct 12 16:49:15 2021] POST /identity/v3/auth/tokens => generated 3458 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:49:15.230147 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 792/1579] 10.222.0.58 () {54 vars in 912 bytes} [Tue Oct 12 16:49:15 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:49:15.240152 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e80ed4-bdbd-4eef-962e-ad7e75dd6b7a None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:15.251649 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4fb4d9-8088-4470-9899-08fefff5c3e9 None None] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:15.252139 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4fb4d9-8088-4470-9899-08fefff5c3e9 None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:15.252422 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4fb4d9-8088-4470-9899-08fefff5c3e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:15.285618 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.auth.core [None req-4f4fb4d9-8088-4470-9899-08fefff5c3e9 None None] MFA Rules not processed for user `29d30b574eec4ad3990d77d235c8b424`. Rule list: `[]` (Enabled: `True`). {{(pid=85205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:49:15.288956 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-4f4fb4d9-8088-4470-9899-08fefff5c3e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:49:15.332243 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e80ed4-bdbd-4eef-962e-ad7e75dd6b7a None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:15.338148 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cf10b1-d166-4728-a9b3-d5a51b702a50 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04704222b3d64a33a6c092fc641ccbb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:15.338706 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cf10b1-d166-4728-a9b3-d5a51b702a50 service cinder] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:15.339125 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cf10b1-d166-4728-a9b3-d5a51b702a50 service cinder] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:15.339409 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cf10b1-d166-4728-a9b3-d5a51b702a50 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:15.349829 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cf10b1-d166-4728-a9b3-d5a51b702a50 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:15.351617 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cf10b1-d166-4728-a9b3-d5a51b702a50 service cinder] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:15.373306 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 793/1580] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Oct 12 16:49:15 2021] GET /identity/v3/auth/tokens => generated 3458 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:49:15.418038 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 788/1581] 10.222.0.58 () {58 vars in 1009 bytes} [Tue Oct 12 16:49:15 2021] POST /identity/v3/auth/tokens => generated 3515 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:49:15.428203 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cf10b1-d166-4728-a9b3-d5a51b702a50 service cinder] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:15.439040 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cf10b1-d166-4728-a9b3-d5a51b702a50 service cinder] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:15.451052 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c00496-53b1-4a8e-9105-57fa755a2a84 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04704222b3d64a33a6c092fc641ccbb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:15.451504 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c00496-53b1-4a8e-9105-57fa755a2a84 service cinder] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:15.451789 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c00496-53b1-4a8e-9105-57fa755a2a84 service cinder] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:15.452074 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c00496-53b1-4a8e-9105-57fa755a2a84 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:15.464493 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c00496-53b1-4a8e-9105-57fa755a2a84 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:15.466271 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c00496-53b1-4a8e-9105-57fa755a2a84 service cinder] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:15.480545 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 794/1582] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Oct 12 16:49:15 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:49:15.480894 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c4ee46-0410-486d-96fd-402a0fc083a7 None None] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:15.481186 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c4ee46-0410-486d-96fd-402a0fc083a7 None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:15.481461 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c4ee46-0410-486d-96fd-402a0fc083a7 None None] PATH_INFO: `/` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:15.483752 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 789/1583] 10.222.0.58 () {54 vars in 912 bytes} [Tue Oct 12 16:49:15 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 12 16:49:15.496334 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de367d1-9120-4111-b3d9-ab4deeca4ea7 None None] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:15.496334 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de367d1-9120-4111-b3d9-ab4deeca4ea7 None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:15.496334 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de367d1-9120-4111-b3d9-ab4deeca4ea7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:15.546165 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.auth.core [None req-8de367d1-9120-4111-b3d9-ab4deeca4ea7 None None] MFA Rules not processed for user `6e65f6d0598e4c539134292b86fb43d2`. Rule list: `[]` (Enabled: `True`). {{(pid=85204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:49:15.547583 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-8de367d1-9120-4111-b3d9-ab4deeca4ea7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:49:15.638528 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 795/1584] 10.222.0.58 () {58 vars in 1009 bytes} [Tue Oct 12 16:49:15 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:49:15.655544 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c4ee46-0410-486d-96fd-402a0fc083a7 None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:15.673443 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c4ee46-0410-486d-96fd-402a0fc083a7 None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:15.681510 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3f8611-0267-42c8-8812-302e322619f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e65f6d0598e4c539134292b86fb43d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:15.685131 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3f8611-0267-42c8-8812-302e322619f4 service neutron] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:15.685668 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3f8611-0267-42c8-8812-302e322619f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:15.688365 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3f8611-0267-42c8-8812-302e322619f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:15.708763 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3f8611-0267-42c8-8812-302e322619f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:15.710601 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3f8611-0267-42c8-8812-302e322619f4 service neutron] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:15.730828 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 790/1585] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Oct 12 16:49:15 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:49:15.860210 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de367d1-9120-4111-b3d9-ab4deeca4ea7 None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:15.990295 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de367d1-9120-4111-b3d9-ab4deeca4ea7 None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:15.992156 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402c73f8-3a3d-4f95-ac56-9a1e7cd10e89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:15.994069 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402c73f8-3a3d-4f95-ac56-9a1e7cd10e89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:15.994462 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402c73f8-3a3d-4f95-ac56-9a1e7cd10e89 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:15.994833 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402c73f8-3a3d-4f95-ac56-9a1e7cd10e89 admin admin] PATH_INFO: `/v3/users/bb1c2e1b9701480ab06cfed01f98615e` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:15.996200 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402c73f8-3a3d-4f95-ac56-9a1e7cd10e89 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb1c2e1b9701480ab06cfed01f98615e)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:15.997408 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: WARNING py.warnings [None req-402c73f8-3a3d-4f95-ac56-9a1e7cd10e89 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:delete_user failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 12 16:49:15.997408 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: warnings.warn(msg) Oct 12 16:49:15.997408 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: Oct 12 16:49:16.000178 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402c73f8-3a3d-4f95-ac56-9a1e7cd10e89 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:16.146963 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-402c73f8-3a3d-4f95-ac56-9a1e7cd10e89 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb1c2e1b9701480ab06cfed01f98615e'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:16.196636 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-402c73f8-3a3d-4f95-ac56-9a1e7cd10e89 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb1c2e1b9701480ab06cfed01f98615e'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:16.236392 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-402c73f8-3a3d-4f95-ac56-9a1e7cd10e89 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb1c2e1b9701480ab06cfed01f98615e'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:16.264512 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-402c73f8-3a3d-4f95-ac56-9a1e7cd10e89 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb1c2e1b9701480ab06cfed01f98615e'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:16.265868 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-402c73f8-3a3d-4f95-ac56-9a1e7cd10e89 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb1c2e1b9701480ab06cfed01f98615e'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:16.287389 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 796/1586] 10.222.0.58 () {58 vars in 1223 bytes} [Tue Oct 12 16:49:15 2021] DELETE /identity/v3/users/bb1c2e1b9701480ab06cfed01f98615e => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:49:16.294267 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18339bd4-99b6-4165-a07a-949d0d54897f None None] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:16.294733 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18339bd4-99b6-4165-a07a-949d0d54897f None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:16.294933 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18339bd4-99b6-4165-a07a-949d0d54897f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:16.339661 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.auth.core [None req-18339bd4-99b6-4165-a07a-949d0d54897f None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:49:16.341238 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-18339bd4-99b6-4165-a07a-949d0d54897f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:49:16.558533 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 791/1587] 10.222.0.58 () {58 vars in 957 bytes} [Tue Oct 12 16:49:16 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:49:16.601281 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402c73f8-3a3d-4f95-ac56-9a1e7cd10e89 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:16.603092 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-402c73f8-3a3d-4f95-ac56-9a1e7cd10e89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:49:16.741723 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402c73f8-3a3d-4f95-ac56-9a1e7cd10e89 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:16.747427 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b640df-3e4e-4266-80e6-3bc9584228e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e65f6d0598e4c539134292b86fb43d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:16.748576 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b640df-3e4e-4266-80e6-3bc9584228e7 service neutron] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:16.749107 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b640df-3e4e-4266-80e6-3bc9584228e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:16.749633 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b640df-3e4e-4266-80e6-3bc9584228e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:16.761131 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b640df-3e4e-4266-80e6-3bc9584228e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:16.763354 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b640df-3e4e-4266-80e6-3bc9584228e7 service neutron] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:16.801742 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 797/1588] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Oct 12 16:49:16 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:49:17.041752 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18339bd4-99b6-4165-a07a-949d0d54897f None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:17.042945 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-18339bd4-99b6-4165-a07a-949d0d54897f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:49:17.164391 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18339bd4-99b6-4165-a07a-949d0d54897f None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:17.171675 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3402a716-e7a9-4887-a63b-79adfcb48503 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4102412c40bc4745bba8c31f1caf9788', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:17.172861 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3402a716-e7a9-4887-a63b-79adfcb48503 service placement] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:17.172861 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3402a716-e7a9-4887-a63b-79adfcb48503 service placement] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:17.173203 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3402a716-e7a9-4887-a63b-79adfcb48503 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:17.176391 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-3402a716-e7a9-4887-a63b-79adfcb48503 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:49:17.194796 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3402a716-e7a9-4887-a63b-79adfcb48503 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:17.197590 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3402a716-e7a9-4887-a63b-79adfcb48503 service placement] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:17.217917 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 792/1589] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Oct 12 16:49:17 2021] GET /identity/v3/auth/tokens => generated 3451 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:49:18.425708 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b640df-3e4e-4266-80e6-3bc9584228e7 service neutron] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:18.427792 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-42b640df-3e4e-4266-80e6-3bc9584228e7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:49:18.454140 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b640df-3e4e-4266-80e6-3bc9584228e7 service neutron] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:18.467584 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5b9b6f-20e0-42e6-ae8a-9b1222c0d64f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:18.468602 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5b9b6f-20e0-42e6-ae8a-9b1222c0d64f admin admin] REQUEST_METHOD: `DELETE` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:18.470413 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5b9b6f-20e0-42e6-ae8a-9b1222c0d64f admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:18.470952 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5b9b6f-20e0-42e6-ae8a-9b1222c0d64f admin admin] PATH_INFO: `/v3/projects/5e8ef31aa09644f49a416c24940584f0` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:18.474393 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5b9b6f-20e0-42e6-ae8a-9b1222c0d64f admin admin] RBAC: Authorizing `identity:delete_project(project_id=5e8ef31aa09644f49a416c24940584f0)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:18.482142 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5b9b6f-20e0-42e6-ae8a-9b1222c0d64f admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:18.609693 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-4b5b9b6f-20e0-42e6-ae8a-9b1222c0d64f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5e8ef31aa09644f49a416c24940584f0', 'request_id': 'req-4b5b9b6f-20e0-42e6-ae8a-9b1222c0d64f'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:18.615631 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-4b5b9b6f-20e0-42e6-ae8a-9b1222c0d64f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5e8ef31aa09644f49a416c24940584f0', 'request_id': 'req-4b5b9b6f-20e0-42e6-ae8a-9b1222c0d64f'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:18.623165 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-4b5b9b6f-20e0-42e6-ae8a-9b1222c0d64f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5e8ef31aa09644f49a416c24940584f0', 'request_id': 'req-4b5b9b6f-20e0-42e6-ae8a-9b1222c0d64f'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:18.638715 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-4b5b9b6f-20e0-42e6-ae8a-9b1222c0d64f admin admin] The token cache is being invalidate because project 5e8ef31aa09644f49a416c24940584f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=85204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 16:49:18.639108 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-4b5b9b6f-20e0-42e6-ae8a-9b1222c0d64f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:18.639850 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-4b5b9b6f-20e0-42e6-ae8a-9b1222c0d64f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:18.641498 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 798/1590] 10.222.0.58 () {58 vars in 1232 bytes} [Tue Oct 12 16:49:18 2021] DELETE /identity/v3/projects/5e8ef31aa09644f49a416c24940584f0 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:49:18.646172 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3402a716-e7a9-4887-a63b-79adfcb48503 service placement] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:18.661312 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3402a716-e7a9-4887-a63b-79adfcb48503 service placement] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:18.744915 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7326151-8fbd-401a-8bc2-00915ad38865 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:18.746119 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7326151-8fbd-401a-8bc2-00915ad38865 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:18.746559 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7326151-8fbd-401a-8bc2-00915ad38865 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:18.746986 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7326151-8fbd-401a-8bc2-00915ad38865 admin admin] PATH_INFO: `/v3/users/d10cacfc3ea14098b22839fdc52e309f` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:18.748411 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7326151-8fbd-401a-8bc2-00915ad38865 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d10cacfc3ea14098b22839fdc52e309f)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:18.750598 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7326151-8fbd-401a-8bc2-00915ad38865 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:18.843050 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-d7326151-8fbd-401a-8bc2-00915ad38865 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd10cacfc3ea14098b22839fdc52e309f'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:18.880694 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-d7326151-8fbd-401a-8bc2-00915ad38865 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd10cacfc3ea14098b22839fdc52e309f'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:18.891355 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-d7326151-8fbd-401a-8bc2-00915ad38865 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd10cacfc3ea14098b22839fdc52e309f'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:18.901468 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-d7326151-8fbd-401a-8bc2-00915ad38865 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd10cacfc3ea14098b22839fdc52e309f'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:18.902926 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-d7326151-8fbd-401a-8bc2-00915ad38865 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd10cacfc3ea14098b22839fdc52e309f'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:18.910645 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 793/1591] 10.222.0.58 () {58 vars in 1223 bytes} [Tue Oct 12 16:49:18 2021] DELETE /identity/v3/users/d10cacfc3ea14098b22839fdc52e309f => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:49:20.417733 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5b9b6f-20e0-42e6-ae8a-9b1222c0d64f admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:20.419359 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-4b5b9b6f-20e0-42e6-ae8a-9b1222c0d64f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:49:20.451912 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5b9b6f-20e0-42e6-ae8a-9b1222c0d64f admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:20.569634 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1c62be-7c2c-4c1f-82f2-e3ba5df70d00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:20.571730 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1c62be-7c2c-4c1f-82f2-e3ba5df70d00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:20.571730 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1c62be-7c2c-4c1f-82f2-e3ba5df70d00 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:20.572098 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1c62be-7c2c-4c1f-82f2-e3ba5df70d00 admin admin] PATH_INFO: `/v3/projects/cc26b104e90f424e99077574c63d13b6` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:20.574748 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1c62be-7c2c-4c1f-82f2-e3ba5df70d00 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cc26b104e90f424e99077574c63d13b6)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:20.606394 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1c62be-7c2c-4c1f-82f2-e3ba5df70d00 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:20.700487 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-3a1c62be-7c2c-4c1f-82f2-e3ba5df70d00 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cc26b104e90f424e99077574c63d13b6', 'request_id': 'req-3a1c62be-7c2c-4c1f-82f2-e3ba5df70d00'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:20.715074 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-3a1c62be-7c2c-4c1f-82f2-e3ba5df70d00 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cc26b104e90f424e99077574c63d13b6', 'request_id': 'req-3a1c62be-7c2c-4c1f-82f2-e3ba5df70d00'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:20.728697 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-3a1c62be-7c2c-4c1f-82f2-e3ba5df70d00 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cc26b104e90f424e99077574c63d13b6', 'request_id': 'req-3a1c62be-7c2c-4c1f-82f2-e3ba5df70d00'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:20.752651 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-3a1c62be-7c2c-4c1f-82f2-e3ba5df70d00 admin admin] The token cache is being invalidate because project cc26b104e90f424e99077574c63d13b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=85204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 16:49:20.752925 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-3a1c62be-7c2c-4c1f-82f2-e3ba5df70d00 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:20.762386 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-3a1c62be-7c2c-4c1f-82f2-e3ba5df70d00 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:20.764684 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 799/1592] 10.222.0.58 () {58 vars in 1232 bytes} [Tue Oct 12 16:49:20 2021] DELETE /identity/v3/projects/cc26b104e90f424e99077574c63d13b6 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:49:20.772122 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6989938-7e93-4835-826c-5e79460bdcf8 None None] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:20.773089 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6989938-7e93-4835-826c-5e79460bdcf8 None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:20.773365 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6989938-7e93-4835-826c-5e79460bdcf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:20.800297 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.auth.core [None req-b6989938-7e93-4835-826c-5e79460bdcf8 None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:49:20.803039 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-b6989938-7e93-4835-826c-5e79460bdcf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:49:20.954361 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 794/1593] 10.222.0.58 () {58 vars in 957 bytes} [Tue Oct 12 16:49:20 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:49:20.955390 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bf8f81-f85c-44d5-83b4-6fd2dd6761de None None] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:20.955684 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bf8f81-f85c-44d5-83b4-6fd2dd6761de None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:20.955967 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bf8f81-f85c-44d5-83b4-6fd2dd6761de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:20.994234 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.auth.core [None req-13bf8f81-f85c-44d5-83b4-6fd2dd6761de None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:49:20.995500 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-13bf8f81-f85c-44d5-83b4-6fd2dd6761de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:49:21.019009 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 800/1594] 10.222.0.58 () {58 vars in 957 bytes} [Tue Oct 12 16:49:20 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:49:21.028215 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6989938-7e93-4835-826c-5e79460bdcf8 None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:21.051064 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6989938-7e93-4835-826c-5e79460bdcf8 None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:21.076046 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0714f135-aa40-41e9-83b0-e8a74e9c94e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:21.077670 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0714f135-aa40-41e9-83b0-e8a74e9c94e5 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:21.078110 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0714f135-aa40-41e9-83b0-e8a74e9c94e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:21.078233 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bf8f81-f85c-44d5-83b4-6fd2dd6761de None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:21.079391 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0714f135-aa40-41e9-83b0-e8a74e9c94e5 admin admin] PATH_INFO: `/v3/domains` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:21.079557 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-13bf8f81-f85c-44d5-83b4-6fd2dd6761de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:49:21.080469 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0714f135-aa40-41e9-83b0-e8a74e9c94e5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:49:21.083524 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0714f135-aa40-41e9-83b0-e8a74e9c94e5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:21.088321 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0714f135-aa40-41e9-83b0-e8a74e9c94e5 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:21.099320 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bf8f81-f85c-44d5-83b4-6fd2dd6761de None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:21.113370 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53d35cc-a62f-4e68-8a95-6e6540be82fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:21.114379 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53d35cc-a62f-4e68-8a95-6e6540be82fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:21.114665 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53d35cc-a62f-4e68-8a95-6e6540be82fd admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:21.114942 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53d35cc-a62f-4e68-8a95-6e6540be82fd admin admin] PATH_INFO: `/v3/users/10c9e64e87414e3a89af6d8a121112f5` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:21.118668 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53d35cc-a62f-4e68-8a95-6e6540be82fd admin admin] RBAC: Authorizing `identity:delete_user(user_id=10c9e64e87414e3a89af6d8a121112f5)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:21.120607 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53d35cc-a62f-4e68-8a95-6e6540be82fd admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:21.125347 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 795/1595] 10.222.0.58 () {58 vars in 1152 bytes} [Tue Oct 12 16:49:21 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:49:21.127108 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0714f135-aa40-41e9-83b0-e8a74e9c94e5 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:21.142115 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0714f135-aa40-41e9-83b0-e8a74e9c94e5 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:21.162988 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d66185-0b90-42e4-86a1-825e8828b928 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:21.163912 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d66185-0b90-42e4-86a1-825e8828b928 admin admin] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:21.164424 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d66185-0b90-42e4-86a1-825e8828b928 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:21.166211 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d66185-0b90-42e4-86a1-825e8828b928 admin admin] PATH_INFO: `/v3/projects` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:21.168086 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d66185-0b90-42e4-86a1-825e8828b928 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:21.170745 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d66185-0b90-42e4-86a1-825e8828b928 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:21.242174 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-a53d35cc-a62f-4e68-8a95-6e6540be82fd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '10c9e64e87414e3a89af6d8a121112f5'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:21.275829 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 796/1596] 10.222.0.58 () {60 vars in 1152 bytes} [Tue Oct 12 16:49:21 2021] POST /identity/v3/projects => generated 383 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:49:21.277663 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d66185-0b90-42e4-86a1-825e8828b928 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:21.286963 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-a53d35cc-a62f-4e68-8a95-6e6540be82fd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '10c9e64e87414e3a89af6d8a121112f5'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:21.308314 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-a53d35cc-a62f-4e68-8a95-6e6540be82fd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '10c9e64e87414e3a89af6d8a121112f5'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:21.334379 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-a53d35cc-a62f-4e68-8a95-6e6540be82fd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '10c9e64e87414e3a89af6d8a121112f5'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:21.340203 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-a53d35cc-a62f-4e68-8a95-6e6540be82fd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '10c9e64e87414e3a89af6d8a121112f5'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:21.362698 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 801/1597] 10.222.0.58 () {58 vars in 1223 bytes} [Tue Oct 12 16:49:21 2021] DELETE /identity/v3/users/10c9e64e87414e3a89af6d8a121112f5 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:49:21.368864 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56b25a1-3b2f-4b94-98b9-f105457da8a7 None None] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:21.371624 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56b25a1-3b2f-4b94-98b9-f105457da8a7 None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:21.371956 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56b25a1-3b2f-4b94-98b9-f105457da8a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:21.445013 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d66185-0b90-42e4-86a1-825e8828b928 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:21.459446 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.auth.core [None req-b56b25a1-3b2f-4b94-98b9-f105457da8a7 None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:49:21.471007 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-b56b25a1-3b2f-4b94-98b9-f105457da8a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:49:21.583855 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53db1ea-76bc-4c63-a189-47369e2736fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:21.584548 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53db1ea-76bc-4c63-a189-47369e2736fb admin admin] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:21.584834 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53db1ea-76bc-4c63-a189-47369e2736fb admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:21.585110 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53db1ea-76bc-4c63-a189-47369e2736fb admin admin] PATH_INFO: `/v3/users` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:21.585824 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53db1ea-76bc-4c63-a189-47369e2736fb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:21.588473 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53db1ea-76bc-4c63-a189-47369e2736fb admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:21.630671 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 797/1598] 10.222.0.58 () {60 vars in 1143 bytes} [Tue Oct 12 16:49:21 2021] POST /identity/v3/users => generated 292 bytes in 354 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:49:21.635174 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53db1ea-76bc-4c63-a189-47369e2736fb admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:21.638047 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-e53db1ea-76bc-4c63-a189-47369e2736fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:49:21.667312 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53db1ea-76bc-4c63-a189-47369e2736fb admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:21.682814 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257f4871-d994-4520-9225-22006858f0c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:21.683499 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257f4871-d994-4520-9225-22006858f0c9 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:21.683786 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257f4871-d994-4520-9225-22006858f0c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:21.684066 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257f4871-d994-4520-9225-22006858f0c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:21.685477 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257f4871-d994-4520-9225-22006858f0c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:21.688203 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257f4871-d994-4520-9225-22006858f0c9 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:21.715979 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 798/1599] 10.222.0.58 () {58 vars in 1121 bytes} [Tue Oct 12 16:49:21 2021] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:49:21.721904 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257f4871-d994-4520-9225-22006858f0c9 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:21.722979 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 802/1600] 10.222.0.58 () {58 vars in 957 bytes} [Tue Oct 12 16:49:21 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 356 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:49:21.743526 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56b25a1-3b2f-4b94-98b9-f105457da8a7 None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:21.745538 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-b56b25a1-3b2f-4b94-98b9-f105457da8a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:49:21.755895 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257f4871-d994-4520-9225-22006858f0c9 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:21.778943 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71103753-ba72-4027-9e0e-b9de2c61d504 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:21.780300 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71103753-ba72-4027-9e0e-b9de2c61d504 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:21.780587 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71103753-ba72-4027-9e0e-b9de2c61d504 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:21.780865 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71103753-ba72-4027-9e0e-b9de2c61d504 admin admin] PATH_INFO: `/v3/roles` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:21.784075 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71103753-ba72-4027-9e0e-b9de2c61d504 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:21.792743 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71103753-ba72-4027-9e0e-b9de2c61d504 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:21.830965 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 799/1601] 10.222.0.58 () {58 vars in 1121 bytes} [Tue Oct 12 16:49:21 2021] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:49:21.836082 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71103753-ba72-4027-9e0e-b9de2c61d504 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:21.869454 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71103753-ba72-4027-9e0e-b9de2c61d504 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:21.882100 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1165bc58-e232-4a73-a966-90c520ae1750 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:21.883008 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1165bc58-e232-4a73-a966-90c520ae1750 admin admin] REQUEST_METHOD: `PUT` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:21.883829 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1165bc58-e232-4a73-a966-90c520ae1750 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:21.884174 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1165bc58-e232-4a73-a966-90c520ae1750 admin admin] PATH_INFO: `/v3/projects/358fc36e15df4b6a979eda55c9f13063/users/90e4846346144405b339aca50d858d14/roles/55ba49fe29884e64b57c3ad13188d554` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:21.906214 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56b25a1-3b2f-4b94-98b9-f105457da8a7 None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:21.910867 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1165bc58-e232-4a73-a966-90c520ae1750 admin admin] RBAC: Authorizing `identity:create_grant(project_id=358fc36e15df4b6a979eda55c9f13063, user_id=90e4846346144405b339aca50d858d14, role_id=55ba49fe29884e64b57c3ad13188d554)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:21.912379 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373c7f59-e875-4922-bac8-6b6d8bf6d9b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e65f6d0598e4c539134292b86fb43d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:21.913049 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373c7f59-e875-4922-bac8-6b6d8bf6d9b1 service neutron] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:21.913339 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373c7f59-e875-4922-bac8-6b6d8bf6d9b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:21.913466 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1165bc58-e232-4a73-a966-90c520ae1750 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:21.913611 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373c7f59-e875-4922-bac8-6b6d8bf6d9b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:21.940064 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373c7f59-e875-4922-bac8-6b6d8bf6d9b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:21.940599 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 800/1602] 10.222.0.58 () {60 vars in 1482 bytes} [Tue Oct 12 16:49:21 2021] PUT /identity/v3/projects/358fc36e15df4b6a979eda55c9f13063/users/90e4846346144405b339aca50d858d14/roles/55ba49fe29884e64b57c3ad13188d554 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:49:21.960523 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373c7f59-e875-4922-bac8-6b6d8bf6d9b1 service neutron] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:21.987750 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 803/1603] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Oct 12 16:49:21 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 12 16:49:21.999811 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80c5264-3723-4bd2-96a4-f6d9e18bb5fe None None] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:22.000106 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80c5264-3723-4bd2-96a4-f6d9e18bb5fe None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:22.000997 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80c5264-3723-4bd2-96a4-f6d9e18bb5fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:22.055020 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.auth.core [None req-a80c5264-3723-4bd2-96a4-f6d9e18bb5fe None None] MFA Rules not processed for user `90e4846346144405b339aca50d858d14`. Rule list: `[]` (Enabled: `True`). {{(pid=85205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:49:22.056281 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-a80c5264-3723-4bd2-96a4-f6d9e18bb5fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:49:22.186717 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ee7e50-2447-449d-9a27-57ccabd9d38e None None] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:22.187083 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ee7e50-2447-449d-9a27-57ccabd9d38e None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:22.187438 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ee7e50-2447-449d-9a27-57ccabd9d38e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:22.213833 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 801/1604] 10.222.0.58 () {58 vars in 957 bytes} [Tue Oct 12 16:49:21 2021] POST /identity/v3/auth/tokens => generated 3403 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:49:22.216343 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80c5264-3723-4bd2-96a4-f6d9e18bb5fe None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:22.228188 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.auth.core [None req-c4ee7e50-2447-449d-9a27-57ccabd9d38e None None] MFA Rules not processed for user `387a65d2bfb142499c9b3b0ac946f48b`. Rule list: `[]` (Enabled: `True`). {{(pid=85204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:49:22.229980 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-c4ee7e50-2447-449d-9a27-57ccabd9d38e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:49:22.370171 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 804/1605] 10.222.0.58 () {58 vars in 1009 bytes} [Tue Oct 12 16:49:22 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:49:22.405534 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80c5264-3723-4bd2-96a4-f6d9e18bb5fe None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:22.429893 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dac7e0-d95f-4a24-bfb6-224d30309595 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:22.429893 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dac7e0-d95f-4a24-bfb6-224d30309595 admin admin] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:22.429893 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dac7e0-d95f-4a24-bfb6-224d30309595 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:22.429893 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dac7e0-d95f-4a24-bfb6-224d30309595 admin admin] PATH_INFO: `/v3/projects` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:22.431692 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60dac7e0-d95f-4a24-bfb6-224d30309595 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:22.446914 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60dac7e0-d95f-4a24-bfb6-224d30309595 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:22.550796 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ee7e50-2447-449d-9a27-57ccabd9d38e None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:22.560035 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 802/1606] 10.222.0.58 () {60 vars in 1152 bytes} [Tue Oct 12 16:49:22 2021] POST /identity/v3/projects => generated 381 bytes in 339 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:49:22.571502 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ee7e50-2447-449d-9a27-57ccabd9d38e None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:22.671697 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dac7e0-d95f-4a24-bfb6-224d30309595 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:22.673849 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-60dac7e0-d95f-4a24-bfb6-224d30309595 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:49:22.733521 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d2b5f7-d0e2-4f4d-b0a8-0c45ecb3f3d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:22.735916 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d2b5f7-d0e2-4f4d-b0a8-0c45ecb3f3d3 admin admin] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:22.737533 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d2b5f7-d0e2-4f4d-b0a8-0c45ecb3f3d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:22.738018 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d2b5f7-d0e2-4f4d-b0a8-0c45ecb3f3d3 admin admin] PATH_INFO: `/v3/users` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:22.742537 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d2b5f7-d0e2-4f4d-b0a8-0c45ecb3f3d3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:22.767823 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d2b5f7-d0e2-4f4d-b0a8-0c45ecb3f3d3 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:22.819512 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 805/1607] 10.222.0.58 () {60 vars in 1143 bytes} [Tue Oct 12 16:49:22 2021] POST /identity/v3/users => generated 297 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:49:22.823467 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d2b5f7-d0e2-4f4d-b0a8-0c45ecb3f3d3 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:22.827762 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dac7e0-d95f-4a24-bfb6-224d30309595 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:22.842529 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4fc055-141a-4354-882c-5d8e04914683 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdeb0a451344c9987b4134b957ffa22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:22.843602 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4fc055-141a-4354-882c-5d8e04914683 service swift] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:22.845291 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4fc055-141a-4354-882c-5d8e04914683 service swift] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:22.845814 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4fc055-141a-4354-882c-5d8e04914683 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:22.861355 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d2b5f7-d0e2-4f4d-b0a8-0c45ecb3f3d3 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:22.872543 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea950d0a-1900-4553-850a-4bd37cc4c52e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:22.873819 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea950d0a-1900-4553-850a-4bd37cc4c52e admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:22.874425 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea950d0a-1900-4553-850a-4bd37cc4c52e admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:22.874901 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea950d0a-1900-4553-850a-4bd37cc4c52e admin admin] PATH_INFO: `/v3/roles` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:22.877305 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea950d0a-1900-4553-850a-4bd37cc4c52e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:22.879203 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea950d0a-1900-4553-850a-4bd37cc4c52e admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:22.904751 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 806/1608] 10.222.0.58 () {58 vars in 1121 bytes} [Tue Oct 12 16:49:22 2021] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:49:22.905989 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea950d0a-1900-4553-850a-4bd37cc4c52e admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:22.928434 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea950d0a-1900-4553-850a-4bd37cc4c52e admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:22.944474 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcba1663-8877-4621-970b-83ed43b90f24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:22.946030 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcba1663-8877-4621-970b-83ed43b90f24 admin admin] REQUEST_METHOD: `PUT` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:22.946553 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcba1663-8877-4621-970b-83ed43b90f24 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:22.947156 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcba1663-8877-4621-970b-83ed43b90f24 admin admin] PATH_INFO: `/v3/projects/b4fc2cceaf6b4386b10efb36b8ac4c43/users/0106b010632e4ad59af3f2921725012b/roles/610824e4f50f4fb8954610e98c1de784` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:22.985987 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcba1663-8877-4621-970b-83ed43b90f24 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4fc2cceaf6b4386b10efb36b8ac4c43, user_id=0106b010632e4ad59af3f2921725012b, role_id=610824e4f50f4fb8954610e98c1de784)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:22.986267 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4fc055-141a-4354-882c-5d8e04914683 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:22.987596 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4fc055-141a-4354-882c-5d8e04914683 service swift] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:22.989404 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcba1663-8877-4621-970b-83ed43b90f24 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:22.998626 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 803/1609] 10.222.0.58 () {60 vars in 1384 bytes} [Tue Oct 12 16:49:22 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 12 16:49:23.026113 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 807/1610] 10.222.0.58 () {60 vars in 1482 bytes} [Tue Oct 12 16:49:22 2021] PUT /identity/v3/projects/b4fc2cceaf6b4386b10efb36b8ac4c43/users/0106b010632e4ad59af3f2921725012b/roles/610824e4f50f4fb8954610e98c1de784 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:49:23.030834 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4fc055-141a-4354-882c-5d8e04914683 service swift] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:23.091471 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4fc055-141a-4354-882c-5d8e04914683 service swift] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:23.203117 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932a9027-ad67-4356-bb0e-085b14ffe67c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:23.203922 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932a9027-ad67-4356-bb0e-085b14ffe67c admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:23.204234 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932a9027-ad67-4356-bb0e-085b14ffe67c admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:23.204944 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932a9027-ad67-4356-bb0e-085b14ffe67c admin admin] PATH_INFO: `/v3/roles` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:23.206095 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932a9027-ad67-4356-bb0e-085b14ffe67c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:23.209672 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932a9027-ad67-4356-bb0e-085b14ffe67c admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:23.226827 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 804/1611] 10.222.0.58 () {58 vars in 1121 bytes} [Tue Oct 12 16:49:23 2021] GET /identity/v3/roles => generated 1420 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:49:23.232469 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcba1663-8877-4621-970b-83ed43b90f24 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:23.251015 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcba1663-8877-4621-970b-83ed43b90f24 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:23.260319 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70eb36f7-2a28-4633-8efc-14f563ce5e30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:23.261731 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70eb36f7-2a28-4633-8efc-14f563ce5e30 admin admin] REQUEST_METHOD: `PUT` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:23.262065 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70eb36f7-2a28-4633-8efc-14f563ce5e30 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:23.262348 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70eb36f7-2a28-4633-8efc-14f563ce5e30 admin admin] PATH_INFO: `/v3/projects/b4fc2cceaf6b4386b10efb36b8ac4c43/users/0106b010632e4ad59af3f2921725012b/roles/610824e4f50f4fb8954610e98c1de784` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:23.265775 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70eb36f7-2a28-4633-8efc-14f563ce5e30 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4fc2cceaf6b4386b10efb36b8ac4c43, user_id=0106b010632e4ad59af3f2921725012b, role_id=610824e4f50f4fb8954610e98c1de784)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:23.269428 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70eb36f7-2a28-4633-8efc-14f563ce5e30 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:23.295902 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 808/1612] 10.222.0.58 () {60 vars in 1482 bytes} [Tue Oct 12 16:49:23 2021] PUT /identity/v3/projects/b4fc2cceaf6b4386b10efb36b8ac4c43/users/0106b010632e4ad59af3f2921725012b/roles/610824e4f50f4fb8954610e98c1de784 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:49:23.305980 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc193ae-b1cf-4720-9b24-35beb59edc52 None None] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:23.306591 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc193ae-b1cf-4720-9b24-35beb59edc52 None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:23.307057 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc193ae-b1cf-4720-9b24-35beb59edc52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:23.359440 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.auth.core [None req-adc193ae-b1cf-4720-9b24-35beb59edc52 None None] MFA Rules not processed for user `0106b010632e4ad59af3f2921725012b`. Rule list: `[]` (Enabled: `True`). {{(pid=85205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:49:23.361020 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-adc193ae-b1cf-4720-9b24-35beb59edc52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:49:23.568143 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 805/1613] 10.222.0.58 () {58 vars in 957 bytes} [Tue Oct 12 16:49:23 2021] POST /identity/v3/auth/tokens => generated 3468 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:49:23.579954 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70eb36f7-2a28-4633-8efc-14f563ce5e30 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:23.582639 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-70eb36f7-2a28-4633-8efc-14f563ce5e30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:49:23.841802 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70eb36f7-2a28-4633-8efc-14f563ce5e30 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:23.865350 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2998f05b-c86b-49a7-8ec1-83c128cea699 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04704222b3d64a33a6c092fc641ccbb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:23.866310 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2998f05b-c86b-49a7-8ec1-83c128cea699 service cinder] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:23.866597 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2998f05b-c86b-49a7-8ec1-83c128cea699 service cinder] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:23.871151 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2998f05b-c86b-49a7-8ec1-83c128cea699 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:23.906610 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2998f05b-c86b-49a7-8ec1-83c128cea699 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:23.908092 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2998f05b-c86b-49a7-8ec1-83c128cea699 service cinder] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:23.968686 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 809/1614] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Oct 12 16:49:23 2021] GET /identity/v3/auth/tokens => generated 3468 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:49:24.138756 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc193ae-b1cf-4720-9b24-35beb59edc52 None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:24.141132 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-adc193ae-b1cf-4720-9b24-35beb59edc52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:49:24.191493 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2998f05b-c86b-49a7-8ec1-83c128cea699 service cinder] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:24.192906 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-2998f05b-c86b-49a7-8ec1-83c128cea699 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:49:24.362752 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc193ae-b1cf-4720-9b24-35beb59edc52 None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:24.373892 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03862a41-53fe-4104-9464-08a3669f2221 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:24.375951 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03862a41-53fe-4104-9464-08a3669f2221 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:24.377015 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03862a41-53fe-4104-9464-08a3669f2221 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:24.378448 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03862a41-53fe-4104-9464-08a3669f2221 admin admin] PATH_INFO: `/v3/projects/cff5614277984837ac9781297f09f94c` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:24.380120 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03862a41-53fe-4104-9464-08a3669f2221 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cff5614277984837ac9781297f09f94c)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:24.387064 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: WARNING py.warnings [None req-03862a41-53fe-4104-9464-08a3669f2221 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:delete_project failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 12 16:49:24.387064 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: warnings.warn(msg) Oct 12 16:49:24.387064 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: Oct 12 16:49:24.389609 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03862a41-53fe-4104-9464-08a3669f2221 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:24.392434 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2998f05b-c86b-49a7-8ec1-83c128cea699 service cinder] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:24.416324 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cde9047-03b2-418a-8126-ec7f22661569 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:24.417475 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cde9047-03b2-418a-8126-ec7f22661569 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:24.417864 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cde9047-03b2-418a-8126-ec7f22661569 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:24.418269 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cde9047-03b2-418a-8126-ec7f22661569 admin admin] PATH_INFO: `/v3/users/49dd187c457749a28e3d03315af4ee76` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:24.429389 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cde9047-03b2-418a-8126-ec7f22661569 admin admin] RBAC: Authorizing `identity:delete_user(user_id=49dd187c457749a28e3d03315af4ee76)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:24.432344 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cde9047-03b2-418a-8126-ec7f22661569 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:24.545868 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-03862a41-53fe-4104-9464-08a3669f2221 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cff5614277984837ac9781297f09f94c', 'request_id': 'req-03862a41-53fe-4104-9464-08a3669f2221'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:24.560594 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-1cde9047-03b2-418a-8126-ec7f22661569 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '49dd187c457749a28e3d03315af4ee76'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:24.563407 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-03862a41-53fe-4104-9464-08a3669f2221 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cff5614277984837ac9781297f09f94c', 'request_id': 'req-03862a41-53fe-4104-9464-08a3669f2221'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:24.594900 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-03862a41-53fe-4104-9464-08a3669f2221 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cff5614277984837ac9781297f09f94c', 'request_id': 'req-03862a41-53fe-4104-9464-08a3669f2221'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:24.605331 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-1cde9047-03b2-418a-8126-ec7f22661569 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '49dd187c457749a28e3d03315af4ee76'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:24.632745 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-1cde9047-03b2-418a-8126-ec7f22661569 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '49dd187c457749a28e3d03315af4ee76'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:24.636149 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-03862a41-53fe-4104-9464-08a3669f2221 admin admin] The token cache is being invalidate because project cff5614277984837ac9781297f09f94c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=85205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 16:49:24.637011 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-03862a41-53fe-4104-9464-08a3669f2221 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:24.637931 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-03862a41-53fe-4104-9464-08a3669f2221 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:24.648436 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 806/1615] 10.222.0.58 () {58 vars in 1232 bytes} [Tue Oct 12 16:49:24 2021] DELETE /identity/v3/projects/cff5614277984837ac9781297f09f94c => generated 0 bytes in 506 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:49:24.656152 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03862a41-53fe-4104-9464-08a3669f2221 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:24.657636 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-1cde9047-03b2-418a-8126-ec7f22661569 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '49dd187c457749a28e3d03315af4ee76'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:24.659606 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-03862a41-53fe-4104-9464-08a3669f2221 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:49:24.660115 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-1cde9047-03b2-418a-8126-ec7f22661569 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '49dd187c457749a28e3d03315af4ee76'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:24.679548 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 810/1616] 10.222.0.58 () {58 vars in 1223 bytes} [Tue Oct 12 16:49:24 2021] DELETE /identity/v3/users/49dd187c457749a28e3d03315af4ee76 => generated 0 bytes in 488 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 16:49:24.682573 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7784977c-3420-464c-8541-7daf098cccb2 None None] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:24.683376 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7784977c-3420-464c-8541-7daf098cccb2 None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:24.684349 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7784977c-3420-464c-8541-7daf098cccb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:24.825737 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.auth.core [None req-7784977c-3420-464c-8541-7daf098cccb2 None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:49:24.827007 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-7784977c-3420-464c-8541-7daf098cccb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:49:25.022017 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03862a41-53fe-4104-9464-08a3669f2221 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:25.170784 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 811/1617] 10.222.0.58 () {58 vars in 957 bytes} [Tue Oct 12 16:49:24 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 490 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:49:25.172321 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e585b55-5ad1-4e30-b7ce-c5e40fa7da98 None None] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:25.172611 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e585b55-5ad1-4e30-b7ce-c5e40fa7da98 None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:25.172884 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e585b55-5ad1-4e30-b7ce-c5e40fa7da98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:25.203564 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5774554f-67c5-4f17-b883-cc848a7512b2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04704222b3d64a33a6c092fc641ccbb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:25.205471 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5774554f-67c5-4f17-b883-cc848a7512b2 service cinder] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:25.205862 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5774554f-67c5-4f17-b883-cc848a7512b2 service cinder] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:25.206252 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5774554f-67c5-4f17-b883-cc848a7512b2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:25.210979 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-5774554f-67c5-4f17-b883-cc848a7512b2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:49:25.255433 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.auth.core [None req-7e585b55-5ad1-4e30-b7ce-c5e40fa7da98 None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:49:25.256682 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-7e585b55-5ad1-4e30-b7ce-c5e40fa7da98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:49:25.301017 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 812/1618] 10.222.0.58 () {58 vars in 957 bytes} [Tue Oct 12 16:49:25 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:49:25.301017 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bccf0e0-5b78-464b-b3d0-2002175defd9 None None] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:25.301017 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bccf0e0-5b78-464b-b3d0-2002175defd9 None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:25.301017 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bccf0e0-5b78-464b-b3d0-2002175defd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:25.310956 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5774554f-67c5-4f17-b883-cc848a7512b2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:25.314306 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5774554f-67c5-4f17-b883-cc848a7512b2 service cinder] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:25.328286 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 807/1619] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Oct 12 16:49:24 2021] GET /identity/v3/auth/tokens => generated 3403 bytes in 679 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:49:25.348868 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.auth.core [None req-5bccf0e0-5b78-464b-b3d0-2002175defd9 None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:49:25.350983 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-5bccf0e0-5b78-464b-b3d0-2002175defd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:49:25.356829 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5774554f-67c5-4f17-b883-cc848a7512b2 service cinder] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:25.358775 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-5774554f-67c5-4f17-b883-cc848a7512b2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:49:25.388689 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 813/1620] 10.222.0.58 () {58 vars in 957 bytes} [Tue Oct 12 16:49:25 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:49:25.391913 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bccf0e0-5b78-464b-b3d0-2002175defd9 None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:25.421361 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bccf0e0-5b78-464b-b3d0-2002175defd9 None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:25.434491 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e8d332-9f73-4234-994e-c3aa908e15c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:25.438966 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e8d332-9f73-4234-994e-c3aa908e15c8 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:25.439446 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e8d332-9f73-4234-994e-c3aa908e15c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:25.440449 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e8d332-9f73-4234-994e-c3aa908e15c8 admin admin] PATH_INFO: `/v3/domains` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:25.442399 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e8d332-9f73-4234-994e-c3aa908e15c8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:49:25.444069 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e8d332-9f73-4234-994e-c3aa908e15c8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:25.449267 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e8d332-9f73-4234-994e-c3aa908e15c8 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:25.501427 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 814/1621] 10.222.0.58 () {58 vars in 1152 bytes} [Tue Oct 12 16:49:25 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:49:25.502963 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e8d332-9f73-4234-994e-c3aa908e15c8 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:25.516783 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e8d332-9f73-4234-994e-c3aa908e15c8 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:25.524950 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac2c77f-0490-4d30-a18a-d0dbac51c2f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:25.525915 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac2c77f-0490-4d30-a18a-d0dbac51c2f3 admin admin] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:25.526425 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac2c77f-0490-4d30-a18a-d0dbac51c2f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:25.526881 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac2c77f-0490-4d30-a18a-d0dbac51c2f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:25.527828 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac2c77f-0490-4d30-a18a-d0dbac51c2f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:25.529919 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac2c77f-0490-4d30-a18a-d0dbac51c2f3 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:25.548514 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5774554f-67c5-4f17-b883-cc848a7512b2 service cinder] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:25.552513 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93a01e0-d46b-49fd-bf69-514e2b2c4cb9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e65f6d0598e4c539134292b86fb43d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:25.553453 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93a01e0-d46b-49fd-bf69-514e2b2c4cb9 service neutron] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:25.553453 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93a01e0-d46b-49fd-bf69-514e2b2c4cb9 service neutron] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:25.553682 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93a01e0-d46b-49fd-bf69-514e2b2c4cb9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:25.565804 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93a01e0-d46b-49fd-bf69-514e2b2c4cb9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:25.567543 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93a01e0-d46b-49fd-bf69-514e2b2c4cb9 service neutron] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:25.583407 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 808/1622] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Oct 12 16:49:25 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 12 16:49:25.607990 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3deac394-6c5a-4db1-a4ba-b92e814ba14e None None] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:25.608422 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3deac394-6c5a-4db1-a4ba-b92e814ba14e None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:25.608956 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3deac394-6c5a-4db1-a4ba-b92e814ba14e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:25.632269 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 815/1623] 10.222.0.58 () {60 vars in 1152 bytes} [Tue Oct 12 16:49:25 2021] POST /identity/v3/projects => generated 379 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:49:25.634641 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac2c77f-0490-4d30-a18a-d0dbac51c2f3 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:25.687283 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.auth.core [None req-3deac394-6c5a-4db1-a4ba-b92e814ba14e None None] MFA Rules not processed for user `c5d7300383ce48df8ec1fe078e1fa789`. Rule list: `[]` (Enabled: `True`). {{(pid=85205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:49:25.689300 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-3deac394-6c5a-4db1-a4ba-b92e814ba14e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:49:25.826072 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac2c77f-0490-4d30-a18a-d0dbac51c2f3 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:25.851464 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67587748-3537-4f86-8257-0ffd721cfe3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:25.853891 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 809/1624] 10.222.0.58 () {58 vars in 957 bytes} [Tue Oct 12 16:49:25 2021] POST /identity/v3/auth/tokens => generated 3411 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:49:25.858898 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67587748-3537-4f86-8257-0ffd721cfe3c admin admin] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:25.859245 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67587748-3537-4f86-8257-0ffd721cfe3c admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:25.859533 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67587748-3537-4f86-8257-0ffd721cfe3c admin admin] PATH_INFO: `/v3/users` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:25.860307 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67587748-3537-4f86-8257-0ffd721cfe3c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:25.864459 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996b966d-ee48-4dca-97ea-c84e6db3fb8b None None] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:25.865226 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996b966d-ee48-4dca-97ea-c84e6db3fb8b None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:25.865637 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996b966d-ee48-4dca-97ea-c84e6db3fb8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:25.866772 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67587748-3537-4f86-8257-0ffd721cfe3c admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:25.902802 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.auth.core [None req-996b966d-ee48-4dca-97ea-c84e6db3fb8b None None] MFA Rules not processed for user `c5d7300383ce48df8ec1fe078e1fa789`. Rule list: `[]` (Enabled: `True`). {{(pid=85205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:49:25.904867 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-996b966d-ee48-4dca-97ea-c84e6db3fb8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:49:25.924469 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 810/1625] 10.222.0.58 () {58 vars in 957 bytes} [Tue Oct 12 16:49:25 2021] POST /identity/v3/auth/tokens => generated 3411 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:49:25.936441 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996b966d-ee48-4dca-97ea-c84e6db3fb8b None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:25.938423 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-996b966d-ee48-4dca-97ea-c84e6db3fb8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:49:25.959012 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 816/1626] 10.222.0.58 () {60 vars in 1143 bytes} [Tue Oct 12 16:49:25 2021] POST /identity/v3/users => generated 290 bytes in 325 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:49:25.964826 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67587748-3537-4f86-8257-0ffd721cfe3c admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:26.001576 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67587748-3537-4f86-8257-0ffd721cfe3c admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:26.029520 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e62b30e-ae71-46af-85e4-7b958d1d516b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:26.030279 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e62b30e-ae71-46af-85e4-7b958d1d516b admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:26.030562 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e62b30e-ae71-46af-85e4-7b958d1d516b admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:26.030833 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e62b30e-ae71-46af-85e4-7b958d1d516b admin admin] PATH_INFO: `/v3/roles` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:26.031596 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e62b30e-ae71-46af-85e4-7b958d1d516b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:26.037273 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e62b30e-ae71-46af-85e4-7b958d1d516b admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:26.105006 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 817/1627] 10.222.0.58 () {58 vars in 1121 bytes} [Tue Oct 12 16:49:25 2021] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:49:26.107751 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e62b30e-ae71-46af-85e4-7b958d1d516b admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:26.126343 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e62b30e-ae71-46af-85e4-7b958d1d516b admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:26.133456 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1185f318-4806-44ce-9aaa-c45fe032f46d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:26.134308 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1185f318-4806-44ce-9aaa-c45fe032f46d admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:26.134600 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1185f318-4806-44ce-9aaa-c45fe032f46d admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:26.134883 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1185f318-4806-44ce-9aaa-c45fe032f46d admin admin] PATH_INFO: `/v3/roles` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:26.135763 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1185f318-4806-44ce-9aaa-c45fe032f46d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:26.137497 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1185f318-4806-44ce-9aaa-c45fe032f46d admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:26.143068 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996b966d-ee48-4dca-97ea-c84e6db3fb8b None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:26.154087 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 818/1628] 10.222.0.58 () {58 vars in 1121 bytes} [Tue Oct 12 16:49:26 2021] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:49:26.157206 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1185f318-4806-44ce-9aaa-c45fe032f46d admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:26.167748 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e09985-e9b4-417f-9105-da72184d607d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29d30b574eec4ad3990d77d235c8b424', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:26.172506 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e09985-e9b4-417f-9105-da72184d607d service nova] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:26.173081 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e09985-e9b4-417f-9105-da72184d607d service nova] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:26.173573 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e09985-e9b4-417f-9105-da72184d607d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:26.174999 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1185f318-4806-44ce-9aaa-c45fe032f46d admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:26.182672 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd08847f-09da-4d34-a6c6-221b94fb9099 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:26.183734 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd08847f-09da-4d34-a6c6-221b94fb9099 admin admin] REQUEST_METHOD: `PUT` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:26.184021 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd08847f-09da-4d34-a6c6-221b94fb9099 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:26.184460 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd08847f-09da-4d34-a6c6-221b94fb9099 admin admin] PATH_INFO: `/v3/projects/2d4ea1df29fb479e83de3b725e52e3f1/users/6d5f9d9fa1004930a74b5e2fecea89d1/roles/55ba49fe29884e64b57c3ad13188d554` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:26.205941 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e09985-e9b4-417f-9105-da72184d607d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:26.208024 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd08847f-09da-4d34-a6c6-221b94fb9099 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d4ea1df29fb479e83de3b725e52e3f1, user_id=6d5f9d9fa1004930a74b5e2fecea89d1, role_id=55ba49fe29884e64b57c3ad13188d554)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:26.210285 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e09985-e9b4-417f-9105-da72184d607d service nova] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:26.213748 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd08847f-09da-4d34-a6c6-221b94fb9099 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:26.253014 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 819/1629] 10.222.0.58 () {60 vars in 1482 bytes} [Tue Oct 12 16:49:26 2021] PUT /identity/v3/projects/2d4ea1df29fb479e83de3b725e52e3f1/users/6d5f9d9fa1004930a74b5e2fecea89d1/roles/55ba49fe29884e64b57c3ad13188d554 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:49:26.261910 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 811/1630] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Oct 12 16:49:25 2021] GET /identity/v3/auth/tokens => generated 3411 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:49:26.264295 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34bcd4a-c0d6-4d1f-b811-0bd936c564ec None None] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:26.264548 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34bcd4a-c0d6-4d1f-b811-0bd936c564ec None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:26.264861 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34bcd4a-c0d6-4d1f-b811-0bd936c564ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:26.329179 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.auth.core [None req-e34bcd4a-c0d6-4d1f-b811-0bd936c564ec None None] MFA Rules not processed for user `6d5f9d9fa1004930a74b5e2fecea89d1`. Rule list: `[]` (Enabled: `True`). {{(pid=85204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:49:26.333139 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-e34bcd4a-c0d6-4d1f-b811-0bd936c564ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:49:26.529446 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 820/1631] 10.222.0.58 () {58 vars in 957 bytes} [Tue Oct 12 16:49:26 2021] POST /identity/v3/auth/tokens => generated 3399 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:49:26.533728 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e09985-e9b4-417f-9105-da72184d607d service nova] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:26.549825 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e09985-e9b4-417f-9105-da72184d607d service nova] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:26.661120 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c605614-ae23-4e06-89a1-ba4066aff408 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:26.664026 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c605614-ae23-4e06-89a1-ba4066aff408 admin admin] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:26.664576 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c605614-ae23-4e06-89a1-ba4066aff408 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:26.665356 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c605614-ae23-4e06-89a1-ba4066aff408 admin admin] PATH_INFO: `/v3/projects` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:26.669522 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c605614-ae23-4e06-89a1-ba4066aff408 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:26.678940 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c605614-ae23-4e06-89a1-ba4066aff408 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:26.784518 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 812/1632] 10.222.0.58 () {60 vars in 1152 bytes} [Tue Oct 12 16:49:26 2021] POST /identity/v3/projects => generated 381 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:49:26.788832 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34bcd4a-c0d6-4d1f-b811-0bd936c564ec None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:26.815104 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34bcd4a-c0d6-4d1f-b811-0bd936c564ec None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:26.992341 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c43ac9-582a-413a-84b7-fc37b771e1ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:26.994812 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c43ac9-582a-413a-84b7-fc37b771e1ea admin admin] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:26.995327 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c43ac9-582a-413a-84b7-fc37b771e1ea admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:26.997665 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c43ac9-582a-413a-84b7-fc37b771e1ea admin admin] PATH_INFO: `/v3/users` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:26.998920 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c43ac9-582a-413a-84b7-fc37b771e1ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:27.002655 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c43ac9-582a-413a-84b7-fc37b771e1ea admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:27.038253 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 821/1633] 10.222.0.58 () {60 vars in 1143 bytes} [Tue Oct 12 16:49:26 2021] POST /identity/v3/users => generated 297 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:49:27.038823 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c605614-ae23-4e06-89a1-ba4066aff408 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:27.057792 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c605614-ae23-4e06-89a1-ba4066aff408 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:27.088493 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d4ad37-954f-49c9-93c6-a121744655dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:27.089414 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d4ad37-954f-49c9-93c6-a121744655dc admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:27.089602 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d4ad37-954f-49c9-93c6-a121744655dc admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:27.095319 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d4ad37-954f-49c9-93c6-a121744655dc admin admin] PATH_INFO: `/v3/roles` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:27.095319 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d4ad37-954f-49c9-93c6-a121744655dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:27.096960 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d4ad37-954f-49c9-93c6-a121744655dc admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:27.137801 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 813/1634] 10.222.0.58 () {58 vars in 1121 bytes} [Tue Oct 12 16:49:27 2021] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:49:27.140730 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c43ac9-582a-413a-84b7-fc37b771e1ea admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:27.165527 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c43ac9-582a-413a-84b7-fc37b771e1ea admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:27.183409 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26106e24-277f-4413-b025-b0e4f26d9ad0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:27.186058 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26106e24-277f-4413-b025-b0e4f26d9ad0 admin admin] REQUEST_METHOD: `PUT` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:27.186367 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26106e24-277f-4413-b025-b0e4f26d9ad0 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:27.188968 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26106e24-277f-4413-b025-b0e4f26d9ad0 admin admin] PATH_INFO: `/v3/projects/7338765b647543fe8e7234c241741a40/users/ca4f8af7550648c9975a43f936a6ea5b/roles/610824e4f50f4fb8954610e98c1de784` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:27.263165 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9e40b8-a5f3-4d64-aa75-0b375badd73b None None] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:27.263759 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9e40b8-a5f3-4d64-aa75-0b375badd73b None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:27.263850 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26106e24-277f-4413-b025-b0e4f26d9ad0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7338765b647543fe8e7234c241741a40, user_id=ca4f8af7550648c9975a43f936a6ea5b, role_id=610824e4f50f4fb8954610e98c1de784)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:27.263950 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9e40b8-a5f3-4d64-aa75-0b375badd73b None None] PATH_INFO: `/` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:27.266016 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 814/1635] 10.222.0.58 () {54 vars in 912 bytes} [Tue Oct 12 16:49:27 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:49:27.275845 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26106e24-277f-4413-b025-b0e4f26d9ad0 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:27.276798 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319048e0-0ab1-43b8-bd55-4da06856f9e7 None None] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:27.277093 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319048e0-0ab1-43b8-bd55-4da06856f9e7 None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:27.277382 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319048e0-0ab1-43b8-bd55-4da06856f9e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:27.321679 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 822/1636] 10.222.0.58 () {60 vars in 1482 bytes} [Tue Oct 12 16:49:27 2021] PUT /identity/v3/projects/7338765b647543fe8e7234c241741a40/users/ca4f8af7550648c9975a43f936a6ea5b/roles/610824e4f50f4fb8954610e98c1de784 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:49:27.341110 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.auth.core [None req-319048e0-0ab1-43b8-bd55-4da06856f9e7 None None] MFA Rules not processed for user `6e65f6d0598e4c539134292b86fb43d2`. Rule list: `[]` (Enabled: `True`). {{(pid=85205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:49:27.343842 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26106e24-277f-4413-b025-b0e4f26d9ad0 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:27.347778 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-319048e0-0ab1-43b8-bd55-4da06856f9e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:49:27.602073 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 815/1637] 10.222.0.58 () {58 vars in 1009 bytes} [Tue Oct 12 16:49:27 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 326 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:49:27.698465 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26106e24-277f-4413-b025-b0e4f26d9ad0 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:27.714837 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc22086-ba38-43e4-aa7f-83fc9f59fda8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:27.715541 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc22086-ba38-43e4-aa7f-83fc9f59fda8 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:27.715829 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc22086-ba38-43e4-aa7f-83fc9f59fda8 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:27.716109 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc22086-ba38-43e4-aa7f-83fc9f59fda8 admin admin] PATH_INFO: `/v3/roles` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:27.716865 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc22086-ba38-43e4-aa7f-83fc9f59fda8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:27.718543 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc22086-ba38-43e4-aa7f-83fc9f59fda8 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:27.747408 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319048e0-0ab1-43b8-bd55-4da06856f9e7 None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:27.749171 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-319048e0-0ab1-43b8-bd55-4da06856f9e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:49:27.769262 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319048e0-0ab1-43b8-bd55-4da06856f9e7 None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:27.785946 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 823/1638] 10.222.0.58 () {58 vars in 1121 bytes} [Tue Oct 12 16:49:27 2021] GET /identity/v3/roles => generated 1420 bytes in 439 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:49:27.788856 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc22086-ba38-43e4-aa7f-83fc9f59fda8 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:27.809678 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36ae9a7-2e61-4a14-b0b0-ead46de27591 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e65f6d0598e4c539134292b86fb43d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:27.815130 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36ae9a7-2e61-4a14-b0b0-ead46de27591 service neutron] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:27.816932 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36ae9a7-2e61-4a14-b0b0-ead46de27591 service neutron] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:27.818236 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36ae9a7-2e61-4a14-b0b0-ead46de27591 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:27.845065 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc22086-ba38-43e4-aa7f-83fc9f59fda8 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:27.863588 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36ae9a7-2e61-4a14-b0b0-ead46de27591 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:27.870848 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36ae9a7-2e61-4a14-b0b0-ead46de27591 service neutron] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:27.881017 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7782cbb3-e955-4eb9-be2a-7b7731eb3611 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:27.881981 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7782cbb3-e955-4eb9-be2a-7b7731eb3611 admin admin] REQUEST_METHOD: `PUT` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:27.882273 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7782cbb3-e955-4eb9-be2a-7b7731eb3611 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:27.882550 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7782cbb3-e955-4eb9-be2a-7b7731eb3611 admin admin] PATH_INFO: `/v3/projects/7338765b647543fe8e7234c241741a40/users/ca4f8af7550648c9975a43f936a6ea5b/roles/610824e4f50f4fb8954610e98c1de784` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:27.892598 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7782cbb3-e955-4eb9-be2a-7b7731eb3611 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7338765b647543fe8e7234c241741a40, user_id=ca4f8af7550648c9975a43f936a6ea5b, role_id=610824e4f50f4fb8954610e98c1de784)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:27.895738 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7782cbb3-e955-4eb9-be2a-7b7731eb3611 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:27.896762 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 816/1639] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Oct 12 16:49:27 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 12 16:49:27.939973 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b3271e-6044-492b-b716-84dbb6d36f83 None None] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:27.940603 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b3271e-6044-492b-b716-84dbb6d36f83 None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:27.941150 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b3271e-6044-492b-b716-84dbb6d36f83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:27.974349 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.auth.core [None req-43b3271e-6044-492b-b716-84dbb6d36f83 None None] MFA Rules not processed for user `6e65f6d0598e4c539134292b86fb43d2`. Rule list: `[]` (Enabled: `True`). {{(pid=85205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:49:27.979391 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-43b3271e-6044-492b-b716-84dbb6d36f83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:49:27.988112 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 824/1640] 10.222.0.58 () {60 vars in 1482 bytes} [Tue Oct 12 16:49:27 2021] PUT /identity/v3/projects/7338765b647543fe8e7234c241741a40/users/ca4f8af7550648c9975a43f936a6ea5b/roles/610824e4f50f4fb8954610e98c1de784 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:49:28.003608 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb5d12b-0ea1-412c-a1a6-866db17f6cce None None] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:28.003899 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb5d12b-0ea1-412c-a1a6-866db17f6cce None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:28.004241 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb5d12b-0ea1-412c-a1a6-866db17f6cce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:28.115202 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 817/1641] 10.222.0.43 () {58 vars in 1015 bytes} [Tue Oct 12 16:49:27 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:49:28.116212 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b3271e-6044-492b-b716-84dbb6d36f83 None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:28.122156 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-43b3271e-6044-492b-b716-84dbb6d36f83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:49:28.124976 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.auth.core [None req-0eb5d12b-0ea1-412c-a1a6-866db17f6cce None None] MFA Rules not processed for user `ca4f8af7550648c9975a43f936a6ea5b`. Rule list: `[]` (Enabled: `True`). {{(pid=85204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:49:28.126705 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-0eb5d12b-0ea1-412c-a1a6-866db17f6cce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:49:28.306859 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b3271e-6044-492b-b716-84dbb6d36f83 None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:28.322801 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411ce3df-b697-4f37-b807-fe4ebb8246d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:28.326172 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411ce3df-b697-4f37-b807-fe4ebb8246d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:28.326172 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411ce3df-b697-4f37-b807-fe4ebb8246d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:28.326172 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411ce3df-b697-4f37-b807-fe4ebb8246d8 admin admin] PATH_INFO: `/v3/users/0a47cb1dbcdd4d53bb5acd4f29848bfe` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:28.328053 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411ce3df-b697-4f37-b807-fe4ebb8246d8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a47cb1dbcdd4d53bb5acd4f29848bfe)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:28.331958 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411ce3df-b697-4f37-b807-fe4ebb8246d8 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:28.462972 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 825/1642] 10.222.0.58 () {58 vars in 957 bytes} [Tue Oct 12 16:49:28 2021] POST /identity/v3/auth/tokens => generated 3468 bytes in 456 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:49:28.481597 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb5d12b-0ea1-412c-a1a6-866db17f6cce None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:28.500215 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-411ce3df-b697-4f37-b807-fe4ebb8246d8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a47cb1dbcdd4d53bb5acd4f29848bfe'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:28.524258 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-411ce3df-b697-4f37-b807-fe4ebb8246d8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a47cb1dbcdd4d53bb5acd4f29848bfe'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:28.540491 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-411ce3df-b697-4f37-b807-fe4ebb8246d8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a47cb1dbcdd4d53bb5acd4f29848bfe'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:28.540660 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb5d12b-0ea1-412c-a1a6-866db17f6cce None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:28.556027 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cd4239-0fdc-41f7-a33c-d1ac12d09fb0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e65f6d0598e4c539134292b86fb43d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:28.556417 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-411ce3df-b697-4f37-b807-fe4ebb8246d8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a47cb1dbcdd4d53bb5acd4f29848bfe'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:28.556714 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cd4239-0fdc-41f7-a33c-d1ac12d09fb0 service neutron] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:28.558238 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-411ce3df-b697-4f37-b807-fe4ebb8246d8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a47cb1dbcdd4d53bb5acd4f29848bfe'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:28.560148 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cd4239-0fdc-41f7-a33c-d1ac12d09fb0 service neutron] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:28.560267 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cd4239-0fdc-41f7-a33c-d1ac12d09fb0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:28.566637 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-23cd4239-0fdc-41f7-a33c-d1ac12d09fb0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:49:28.582890 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 818/1643] 10.222.0.58 () {58 vars in 1223 bytes} [Tue Oct 12 16:49:28 2021] DELETE /identity/v3/users/0a47cb1dbcdd4d53bb5acd4f29848bfe => generated 0 bytes in 464 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:49:28.583991 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411ce3df-b697-4f37-b807-fe4ebb8246d8 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:28.589314 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-411ce3df-b697-4f37-b807-fe4ebb8246d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:49:28.616617 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23cd4239-0fdc-41f7-a33c-d1ac12d09fb0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:28.618874 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23cd4239-0fdc-41f7-a33c-d1ac12d09fb0 service neutron] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:28.658210 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 826/1644] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Oct 12 16:49:28 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:49:28.660436 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5509a376-cf03-4b85-ba78-a7f9bb748913 None None] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:28.660736 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5509a376-cf03-4b85-ba78-a7f9bb748913 None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:28.661324 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5509a376-cf03-4b85-ba78-a7f9bb748913 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:28.763046 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.auth.core [None req-5509a376-cf03-4b85-ba78-a7f9bb748913 None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:49:28.767312 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-5509a376-cf03-4b85-ba78-a7f9bb748913 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:49:28.769109 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411ce3df-b697-4f37-b807-fe4ebb8246d8 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:28.786114 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35499aae-d83d-4c16-b0bd-93873561f6d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:28.787798 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35499aae-d83d-4c16-b0bd-93873561f6d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:28.788335 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35499aae-d83d-4c16-b0bd-93873561f6d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:28.788940 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35499aae-d83d-4c16-b0bd-93873561f6d1 admin admin] PATH_INFO: `/v3/users/6d5f9d9fa1004930a74b5e2fecea89d1` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:28.793137 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35499aae-d83d-4c16-b0bd-93873561f6d1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6d5f9d9fa1004930a74b5e2fecea89d1)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:28.800026 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35499aae-d83d-4c16-b0bd-93873561f6d1 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:28.811631 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 827/1645] 10.222.0.58 () {58 vars in 957 bytes} [Tue Oct 12 16:49:28 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:49:28.957486 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-35499aae-d83d-4c16-b0bd-93873561f6d1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6d5f9d9fa1004930a74b5e2fecea89d1'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:28.990018 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5509a376-cf03-4b85-ba78-a7f9bb748913 None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:28.991708 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-5509a376-cf03-4b85-ba78-a7f9bb748913 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:49:29.028940 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-35499aae-d83d-4c16-b0bd-93873561f6d1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6d5f9d9fa1004930a74b5e2fecea89d1'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:29.047802 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-35499aae-d83d-4c16-b0bd-93873561f6d1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6d5f9d9fa1004930a74b5e2fecea89d1'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:29.061651 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-35499aae-d83d-4c16-b0bd-93873561f6d1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6d5f9d9fa1004930a74b5e2fecea89d1'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:29.066383 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-35499aae-d83d-4c16-b0bd-93873561f6d1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6d5f9d9fa1004930a74b5e2fecea89d1'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:29.081296 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 819/1646] 10.222.0.58 () {58 vars in 1223 bytes} [Tue Oct 12 16:49:28 2021] DELETE /identity/v3/users/6d5f9d9fa1004930a74b5e2fecea89d1 => generated 0 bytes in 498 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:49:29.082187 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35499aae-d83d-4c16-b0bd-93873561f6d1 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:29.089596 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-35499aae-d83d-4c16-b0bd-93873561f6d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:49:29.173377 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5509a376-cf03-4b85-ba78-a7f9bb748913 None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:29.278762 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35499aae-d83d-4c16-b0bd-93873561f6d1 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:29.298451 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95432a1f-edda-4108-978f-01d3de81cd6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:29.299759 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95432a1f-edda-4108-978f-01d3de81cd6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:29.300368 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95432a1f-edda-4108-978f-01d3de81cd6c admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:29.300652 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95432a1f-edda-4108-978f-01d3de81cd6c admin admin] PATH_INFO: `/v3/projects/587528e2662a4cb89eedea831874bc2e` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:29.301920 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95432a1f-edda-4108-978f-01d3de81cd6c admin admin] RBAC: Authorizing `identity:delete_project(project_id=587528e2662a4cb89eedea831874bc2e)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:29.303939 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95432a1f-edda-4108-978f-01d3de81cd6c admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:29.304244 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f00e6f4-28f6-460f-9472-e04388bf896d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e65f6d0598e4c539134292b86fb43d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:29.305192 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f00e6f4-28f6-460f-9472-e04388bf896d service neutron] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:29.317248 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f00e6f4-28f6-460f-9472-e04388bf896d service neutron] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:29.317565 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f00e6f4-28f6-460f-9472-e04388bf896d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:29.324113 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-1f00e6f4-28f6-460f-9472-e04388bf896d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:49:29.361496 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f00e6f4-28f6-460f-9472-e04388bf896d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:29.363131 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f00e6f4-28f6-460f-9472-e04388bf896d service neutron] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:29.398528 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 828/1647] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Oct 12 16:49:28 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 12 16:49:29.405746 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea10f127-d536-4250-ab17-082989c4b9e7 None None] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:29.406063 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea10f127-d536-4250-ab17-082989c4b9e7 None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:29.406387 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea10f127-d536-4250-ab17-082989c4b9e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:29.449205 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-95432a1f-edda-4108-978f-01d3de81cd6c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '587528e2662a4cb89eedea831874bc2e', 'request_id': 'req-95432a1f-edda-4108-978f-01d3de81cd6c'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:29.462011 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-95432a1f-edda-4108-978f-01d3de81cd6c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '587528e2662a4cb89eedea831874bc2e', 'request_id': 'req-95432a1f-edda-4108-978f-01d3de81cd6c'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:29.469737 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.auth.core [None req-ea10f127-d536-4250-ab17-082989c4b9e7 None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:49:29.477670 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-ea10f127-d536-4250-ab17-082989c4b9e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:49:29.482924 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-95432a1f-edda-4108-978f-01d3de81cd6c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '587528e2662a4cb89eedea831874bc2e', 'request_id': 'req-95432a1f-edda-4108-978f-01d3de81cd6c'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:29.521258 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-95432a1f-edda-4108-978f-01d3de81cd6c admin admin] The token cache is being invalidate because project 587528e2662a4cb89eedea831874bc2e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=85205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 16:49:29.521656 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-95432a1f-edda-4108-978f-01d3de81cd6c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:29.532644 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-95432a1f-edda-4108-978f-01d3de81cd6c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:29.537851 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 820/1648] 10.222.0.58 () {58 vars in 1232 bytes} [Tue Oct 12 16:49:29 2021] DELETE /identity/v3/projects/587528e2662a4cb89eedea831874bc2e => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:49:29.540784 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95432a1f-edda-4108-978f-01d3de81cd6c admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:29.545125 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-95432a1f-edda-4108-978f-01d3de81cd6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:49:29.700299 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 829/1649] 10.222.0.58 () {58 vars in 957 bytes} [Tue Oct 12 16:49:29 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:49:29.701497 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb92310-ea51-4bce-93af-30d71ca73665 None None] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:29.701784 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb92310-ea51-4bce-93af-30d71ca73665 None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:29.702116 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb92310-ea51-4bce-93af-30d71ca73665 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:29.790398 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95432a1f-edda-4108-978f-01d3de81cd6c admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:29.811168 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.auth.core [None req-acb92310-ea51-4bce-93af-30d71ca73665 None None] MFA Rules not processed for user `69c3a35689e540b09d83fd072d5011b7`. Rule list: `[]` (Enabled: `True`). {{(pid=85204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:49:29.812883 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-acb92310-ea51-4bce-93af-30d71ca73665 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:49:29.822637 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1748e2-b6be-4103-a925-f762f0a27016 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:29.823358 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1748e2-b6be-4103-a925-f762f0a27016 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:29.823657 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1748e2-b6be-4103-a925-f762f0a27016 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:29.823987 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1748e2-b6be-4103-a925-f762f0a27016 admin admin] PATH_INFO: `/v3/users/90e4846346144405b339aca50d858d14` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:29.825769 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1748e2-b6be-4103-a925-f762f0a27016 admin admin] RBAC: Authorizing `identity:delete_user(user_id=90e4846346144405b339aca50d858d14)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:29.827815 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1748e2-b6be-4103-a925-f762f0a27016 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:29.991256 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-9f1748e2-b6be-4103-a925-f762f0a27016 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '90e4846346144405b339aca50d858d14'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:30.035563 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 830/1650] 10.222.0.58 () {58 vars in 957 bytes} [Tue Oct 12 16:49:29 2021] POST /identity/v3/auth/tokens => generated 3407 bytes in 335 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:49:30.039558 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e02ef37-373a-47d3-ab37-c00ea068415a None None] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:30.040893 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e02ef37-373a-47d3-ab37-c00ea068415a None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:30.041330 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e02ef37-373a-47d3-ab37-c00ea068415a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:30.066892 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-9f1748e2-b6be-4103-a925-f762f0a27016 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '90e4846346144405b339aca50d858d14'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:30.089905 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.auth.core [None req-2e02ef37-373a-47d3-ab37-c00ea068415a None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:49:30.092426 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-2e02ef37-373a-47d3-ab37-c00ea068415a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:49:30.102172 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-9f1748e2-b6be-4103-a925-f762f0a27016 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '90e4846346144405b339aca50d858d14'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:30.112261 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 831/1651] 10.222.0.58 () {58 vars in 957 bytes} [Tue Oct 12 16:49:30 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:49:30.114554 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e02ef37-373a-47d3-ab37-c00ea068415a None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:30.117710 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-2e02ef37-373a-47d3-ab37-c00ea068415a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:49:30.129634 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-9f1748e2-b6be-4103-a925-f762f0a27016 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '90e4846346144405b339aca50d858d14'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:30.137712 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-9f1748e2-b6be-4103-a925-f762f0a27016 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '90e4846346144405b339aca50d858d14'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:30.161779 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 821/1652] 10.222.0.58 () {58 vars in 1223 bytes} [Tue Oct 12 16:49:29 2021] DELETE /identity/v3/users/90e4846346144405b339aca50d858d14 => generated 0 bytes in 619 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:49:30.165852 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1294554-f182-4d9e-b9ca-529f2b408e9e None None] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:30.166447 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1294554-f182-4d9e-b9ca-529f2b408e9e None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:30.167002 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1294554-f182-4d9e-b9ca-529f2b408e9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:30.216130 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.auth.core [None req-c1294554-f182-4d9e-b9ca-529f2b408e9e None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:49:30.218428 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-c1294554-f182-4d9e-b9ca-529f2b408e9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:49:30.381090 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e02ef37-373a-47d3-ab37-c00ea068415a None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:30.413551 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 822/1653] 10.222.0.58 () {58 vars in 957 bytes} [Tue Oct 12 16:49:30 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:49:30.415826 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f2d9c4-42d0-4f1e-a402-7c5921ddbb6a None None] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:30.423976 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f2d9c4-42d0-4f1e-a402-7c5921ddbb6a None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:30.424213 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f2d9c4-42d0-4f1e-a402-7c5921ddbb6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:30.463476 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.auth.core [None req-76f2d9c4-42d0-4f1e-a402-7c5921ddbb6a None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:49:30.469062 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-76f2d9c4-42d0-4f1e-a402-7c5921ddbb6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:49:30.491306 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 823/1654] 10.222.0.58 () {58 vars in 957 bytes} [Tue Oct 12 16:49:30 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:49:30.493660 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83339de6-f81c-4bfb-b383-30be15b666b1 None None] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:30.494476 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83339de6-f81c-4bfb-b383-30be15b666b1 None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:30.494935 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83339de6-f81c-4bfb-b383-30be15b666b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:30.520195 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c80359c-5927-4fde-90aa-3ca6fa82c623 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e65f6d0598e4c539134292b86fb43d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:30.520920 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c80359c-5927-4fde-90aa-3ca6fa82c623 service neutron] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:30.521152 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c80359c-5927-4fde-90aa-3ca6fa82c623 service neutron] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:30.521482 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c80359c-5927-4fde-90aa-3ca6fa82c623 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:30.546146 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-9c80359c-5927-4fde-90aa-3ca6fa82c623 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:49:30.575599 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.auth.core [None req-83339de6-f81c-4bfb-b383-30be15b666b1 None None] MFA Rules not processed for user `c5d7300383ce48df8ec1fe078e1fa789`. Rule list: `[]` (Enabled: `True`). {{(pid=85205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:49:30.577016 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-83339de6-f81c-4bfb-b383-30be15b666b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:49:30.590821 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c80359c-5927-4fde-90aa-3ca6fa82c623 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:30.596806 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c80359c-5927-4fde-90aa-3ca6fa82c623 service neutron] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:30.646224 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 832/1655] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Oct 12 16:49:30 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 533 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:49:30.647559 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c80359c-5927-4fde-90aa-3ca6fa82c623 service neutron] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:30.650242 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-9c80359c-5927-4fde-90aa-3ca6fa82c623 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:49:30.837666 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c80359c-5927-4fde-90aa-3ca6fa82c623 service neutron] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:30.846238 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 824/1656] 10.222.0.58 () {58 vars in 957 bytes} [Tue Oct 12 16:49:30 2021] POST /identity/v3/auth/tokens => generated 3411 bytes in 354 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:49:30.848076 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83339de6-f81c-4bfb-b383-30be15b666b1 None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:30.853078 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7112245-ec9c-486c-a2c6-dce339821a0d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29d30b574eec4ad3990d77d235c8b424', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:30.853764 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7112245-ec9c-486c-a2c6-dce339821a0d service nova] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:30.854074 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7112245-ec9c-486c-a2c6-dce339821a0d service nova] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:30.856438 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7112245-ec9c-486c-a2c6-dce339821a0d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:30.861150 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-b7112245-ec9c-486c-a2c6-dce339821a0d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:49:30.883740 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83339de6-f81c-4bfb-b383-30be15b666b1 None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:30.917238 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0787486c-95df-41e5-94f8-90cbfd8a285d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:30.918109 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0787486c-95df-41e5-94f8-90cbfd8a285d admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:30.918394 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0787486c-95df-41e5-94f8-90cbfd8a285d admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:30.918691 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0787486c-95df-41e5-94f8-90cbfd8a285d admin admin] PATH_INFO: `/v3/domains` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:30.919474 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0787486c-95df-41e5-94f8-90cbfd8a285d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:49:30.919787 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0787486c-95df-41e5-94f8-90cbfd8a285d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:30.921584 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0787486c-95df-41e5-94f8-90cbfd8a285d admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:30.962489 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 825/1657] 10.222.0.58 () {58 vars in 1152 bytes} [Tue Oct 12 16:49:30 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:49:30.962489 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0787486c-95df-41e5-94f8-90cbfd8a285d admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:30.965045 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-0787486c-95df-41e5-94f8-90cbfd8a285d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:49:30.998204 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0787486c-95df-41e5-94f8-90cbfd8a285d admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:31.005687 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7112245-ec9c-486c-a2c6-dce339821a0d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:31.008311 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7112245-ec9c-486c-a2c6-dce339821a0d service nova] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:31.009484 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fcfca1-1def-4c5d-aa61-39809bbb5f40 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e65f6d0598e4c539134292b86fb43d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:31.010416 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fcfca1-1def-4c5d-aa61-39809bbb5f40 service neutron] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:31.010852 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fcfca1-1def-4c5d-aa61-39809bbb5f40 service neutron] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:31.011273 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fcfca1-1def-4c5d-aa61-39809bbb5f40 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:31.037054 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fcfca1-1def-4c5d-aa61-39809bbb5f40 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:31.058152 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fcfca1-1def-4c5d-aa61-39809bbb5f40 service neutron] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:31.063928 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 833/1658] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Oct 12 16:49:30 2021] GET /identity/v3/auth/tokens => generated 3407 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:49:31.064992 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7112245-ec9c-486c-a2c6-dce339821a0d service nova] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:31.112342 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 826/1659] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Oct 12 16:49:30 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:49:31.114748 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7112245-ec9c-486c-a2c6-dce339821a0d service nova] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:31.137661 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05c2316-216a-41ef-93c7-616e3d92d907 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:31.139795 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05c2316-216a-41ef-93c7-616e3d92d907 admin admin] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:31.140259 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05c2316-216a-41ef-93c7-616e3d92d907 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:31.140507 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05c2316-216a-41ef-93c7-616e3d92d907 admin admin] PATH_INFO: `/v3/projects` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:31.143104 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05c2316-216a-41ef-93c7-616e3d92d907 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:31.155992 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05c2316-216a-41ef-93c7-616e3d92d907 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:31.225559 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 834/1660] 10.222.0.58 () {60 vars in 1152 bytes} [Tue Oct 12 16:49:31 2021] POST /identity/v3/projects => generated 405 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:49:31.230141 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fcfca1-1def-4c5d-aa61-39809bbb5f40 service neutron] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:31.246858 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fcfca1-1def-4c5d-aa61-39809bbb5f40 service neutron] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:31.459998 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31cb802-d4b5-4e8a-b4df-9c4235f05593 None None] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:31.460435 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31cb802-d4b5-4e8a-b4df-9c4235f05593 None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:31.461474 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31cb802-d4b5-4e8a-b4df-9c4235f05593 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:31.474957 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f8f0e9-6b1f-4fd2-b72a-0d43366590b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:31.480929 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f8f0e9-6b1f-4fd2-b72a-0d43366590b1 admin admin] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:31.481519 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f8f0e9-6b1f-4fd2-b72a-0d43366590b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:31.482057 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f8f0e9-6b1f-4fd2-b72a-0d43366590b1 admin admin] PATH_INFO: `/v3/users` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:31.483148 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f8f0e9-6b1f-4fd2-b72a-0d43366590b1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:31.490060 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f8f0e9-6b1f-4fd2-b72a-0d43366590b1 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:31.558167 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.auth.core [None req-b31cb802-d4b5-4e8a-b4df-9c4235f05593 None None] MFA Rules not processed for user `aef11be7bb50427fb18d1ff2d29e9fac`. Rule list: `[]` (Enabled: `True`). {{(pid=85204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:49:31.559680 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-b31cb802-d4b5-4e8a-b4df-9c4235f05593 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:49:31.568335 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 827/1661] 10.222.0.58 () {60 vars in 1143 bytes} [Tue Oct 12 16:49:31 2021] POST /identity/v3/users => generated 303 bytes in 339 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 16:49:31.573447 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f8f0e9-6b1f-4fd2-b72a-0d43366590b1 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:31.610750 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f8f0e9-6b1f-4fd2-b72a-0d43366590b1 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:31.638530 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f3955c-ed51-431c-989a-c63c39b98458 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:31.639493 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f3955c-ed51-431c-989a-c63c39b98458 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:31.640015 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f3955c-ed51-431c-989a-c63c39b98458 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:31.641028 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f3955c-ed51-431c-989a-c63c39b98458 admin admin] PATH_INFO: `/v3/roles` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:31.645394 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f3955c-ed51-431c-989a-c63c39b98458 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:31.653634 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f3955c-ed51-431c-989a-c63c39b98458 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:31.716433 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 828/1662] 10.222.0.58 () {58 vars in 1121 bytes} [Tue Oct 12 16:49:31 2021] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:49:31.717679 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f3955c-ed51-431c-989a-c63c39b98458 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:31.749480 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f3955c-ed51-431c-989a-c63c39b98458 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:31.771582 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f567adf7-9d66-406c-a974-2a2cf9978cee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:31.773350 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f567adf7-9d66-406c-a974-2a2cf9978cee admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:31.775116 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f567adf7-9d66-406c-a974-2a2cf9978cee admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:31.775392 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f567adf7-9d66-406c-a974-2a2cf9978cee admin admin] PATH_INFO: `/v3/roles` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:31.776781 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f567adf7-9d66-406c-a974-2a2cf9978cee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:31.784675 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f567adf7-9d66-406c-a974-2a2cf9978cee admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:31.818022 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 829/1663] 10.222.0.58 () {58 vars in 1121 bytes} [Tue Oct 12 16:49:31 2021] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:49:31.821958 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f567adf7-9d66-406c-a974-2a2cf9978cee admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:31.829078 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 835/1664] 10.222.0.58 () {58 vars in 957 bytes} [Tue Oct 12 16:49:31 2021] POST /identity/v3/auth/tokens => generated 3397 bytes in 371 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:49:31.843474 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31cb802-d4b5-4e8a-b4df-9c4235f05593 None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:31.848807 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f567adf7-9d66-406c-a974-2a2cf9978cee admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:31.859616 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584a9843-12fe-4500-9238-8c4d5ffc920f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:31.860784 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584a9843-12fe-4500-9238-8c4d5ffc920f admin admin] REQUEST_METHOD: `PUT` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:31.861354 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584a9843-12fe-4500-9238-8c4d5ffc920f admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:31.861779 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584a9843-12fe-4500-9238-8c4d5ffc920f admin admin] PATH_INFO: `/v3/projects/2f646b4aa79a46898724bfd15fd93790/users/a2a325b7887344d7aba7ef3e6fe624c9/roles/55ba49fe29884e64b57c3ad13188d554` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:31.895541 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584a9843-12fe-4500-9238-8c4d5ffc920f admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f646b4aa79a46898724bfd15fd93790, user_id=a2a325b7887344d7aba7ef3e6fe624c9, role_id=55ba49fe29884e64b57c3ad13188d554)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:31.902035 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584a9843-12fe-4500-9238-8c4d5ffc920f admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:31.931363 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 830/1665] 10.222.0.58 () {60 vars in 1482 bytes} [Tue Oct 12 16:49:31 2021] PUT /identity/v3/projects/2f646b4aa79a46898724bfd15fd93790/users/a2a325b7887344d7aba7ef3e6fe624c9/roles/55ba49fe29884e64b57c3ad13188d554 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 16:49:31.937753 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b2b0cb-48e8-4d27-8766-a54f2b4142a3 None None] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:31.938322 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b2b0cb-48e8-4d27-8766-a54f2b4142a3 None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:31.938752 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b2b0cb-48e8-4d27-8766-a54f2b4142a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:31.985967 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.auth.core [None req-a7b2b0cb-48e8-4d27-8766-a54f2b4142a3 None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:49:31.987423 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-a7b2b0cb-48e8-4d27-8766-a54f2b4142a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:49:32.038552 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31cb802-d4b5-4e8a-b4df-9c4235f05593 None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:32.098297 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 831/1666] 10.222.0.58 () {58 vars in 957 bytes} [Tue Oct 12 16:49:31 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:49:32.124508 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b2b0cb-48e8-4d27-8766-a54f2b4142a3 None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:32.124662 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddff356-23e8-4dc1-a88d-d615a25a7389 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29d30b574eec4ad3990d77d235c8b424', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:32.125336 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddff356-23e8-4dc1-a88d-d615a25a7389 service nova] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:32.125655 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddff356-23e8-4dc1-a88d-d615a25a7389 service nova] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:32.125958 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddff356-23e8-4dc1-a88d-d615a25a7389 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:32.126939 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-a7b2b0cb-48e8-4d27-8766-a54f2b4142a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:49:32.336498 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddff356-23e8-4dc1-a88d-d615a25a7389 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:32.338741 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddff356-23e8-4dc1-a88d-d615a25a7389 service nova] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:32.340108 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b2b0cb-48e8-4d27-8766-a54f2b4142a3 None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:32.349076 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f0925d-2eb5-449d-a99d-74e99c739b07 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e65f6d0598e4c539134292b86fb43d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:32.350275 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f0925d-2eb5-449d-a99d-74e99c739b07 service neutron] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:32.350680 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f0925d-2eb5-449d-a99d-74e99c739b07 service neutron] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:32.351065 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f0925d-2eb5-449d-a99d-74e99c739b07 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:32.368575 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 836/1667] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Oct 12 16:49:31 2021] GET /identity/v3/auth/tokens => generated 3397 bytes in 526 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 12 16:49:32.386991 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f0925d-2eb5-449d-a99d-74e99c739b07 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:32.390367 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f0925d-2eb5-449d-a99d-74e99c739b07 service neutron] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:32.418918 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 832/1668] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Oct 12 16:49:32 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 12 16:49:32.769048 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddff356-23e8-4dc1-a88d-d615a25a7389 service nova] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:32.770942 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-3ddff356-23e8-4dc1-a88d-d615a25a7389 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:49:32.800361 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddff356-23e8-4dc1-a88d-d615a25a7389 service nova] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:32.814105 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c133922-b91c-4e1b-8dcf-dcd1112ad618 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:32.815172 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c133922-b91c-4e1b-8dcf-dcd1112ad618 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:32.815591 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c133922-b91c-4e1b-8dcf-dcd1112ad618 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:32.815900 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c133922-b91c-4e1b-8dcf-dcd1112ad618 admin admin] PATH_INFO: `/v3/projects/967de0d1fc57499591a7ebbfdaf1857e` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:32.819939 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c133922-b91c-4e1b-8dcf-dcd1112ad618 admin admin] RBAC: Authorizing `identity:delete_project(project_id=967de0d1fc57499591a7ebbfdaf1857e)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:32.825433 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c133922-b91c-4e1b-8dcf-dcd1112ad618 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:32.979382 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-2c133922-b91c-4e1b-8dcf-dcd1112ad618 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '967de0d1fc57499591a7ebbfdaf1857e', 'request_id': 'req-2c133922-b91c-4e1b-8dcf-dcd1112ad618'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:32.997391 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-2c133922-b91c-4e1b-8dcf-dcd1112ad618 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '967de0d1fc57499591a7ebbfdaf1857e', 'request_id': 'req-2c133922-b91c-4e1b-8dcf-dcd1112ad618'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:33.021085 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-2c133922-b91c-4e1b-8dcf-dcd1112ad618 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '967de0d1fc57499591a7ebbfdaf1857e', 'request_id': 'req-2c133922-b91c-4e1b-8dcf-dcd1112ad618'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:33.066803 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-2c133922-b91c-4e1b-8dcf-dcd1112ad618 admin admin] The token cache is being invalidate because project 967de0d1fc57499591a7ebbfdaf1857e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=85204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 16:49:33.067101 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-2c133922-b91c-4e1b-8dcf-dcd1112ad618 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:33.068217 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-2c133922-b91c-4e1b-8dcf-dcd1112ad618 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:33.071894 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 837/1669] 10.222.0.58 () {58 vars in 1232 bytes} [Tue Oct 12 16:49:32 2021] DELETE /identity/v3/projects/967de0d1fc57499591a7ebbfdaf1857e => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:49:33.077423 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a984a633-52e8-48bd-931f-7a91dc182967 None None] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:33.077988 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a984a633-52e8-48bd-931f-7a91dc182967 None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:33.078282 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a984a633-52e8-48bd-931f-7a91dc182967 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:33.136310 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.auth.core [None req-a984a633-52e8-48bd-931f-7a91dc182967 None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:49:33.137902 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-a984a633-52e8-48bd-931f-7a91dc182967 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:49:33.259197 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 833/1670] 10.222.0.58 () {58 vars in 957 bytes} [Tue Oct 12 16:49:33 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:49:33.261020 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e984ad-0bf3-437e-b7c7-9c7c3c820eb3 None None] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:33.261475 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e984ad-0bf3-437e-b7c7-9c7c3c820eb3 None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:33.261846 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e984ad-0bf3-437e-b7c7-9c7c3c820eb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:33.296714 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.auth.core [None req-e8e984ad-0bf3-437e-b7c7-9c7c3c820eb3 None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:49:33.297779 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-e8e984ad-0bf3-437e-b7c7-9c7c3c820eb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:49:33.329214 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 838/1671] 10.222.0.58 () {58 vars in 957 bytes} [Tue Oct 12 16:49:33 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:49:33.330334 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a984a633-52e8-48bd-931f-7a91dc182967 None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:33.342744 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a984a633-52e8-48bd-931f-7a91dc182967 None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:33.356677 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55520c3-525a-4221-87b7-4932250cb061 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:33.359346 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55520c3-525a-4221-87b7-4932250cb061 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:33.359808 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55520c3-525a-4221-87b7-4932250cb061 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:33.360079 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55520c3-525a-4221-87b7-4932250cb061 admin admin] PATH_INFO: `/v3/domains` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:33.363298 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e984ad-0bf3-437e-b7c7-9c7c3c820eb3 None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:33.365010 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-e8e984ad-0bf3-437e-b7c7-9c7c3c820eb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:49:33.374748 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55520c3-525a-4221-87b7-4932250cb061 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:49:33.375779 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55520c3-525a-4221-87b7-4932250cb061 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:33.379389 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55520c3-525a-4221-87b7-4932250cb061 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:33.403746 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e984ad-0bf3-437e-b7c7-9c7c3c820eb3 None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:33.450839 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9479049e-1e0d-4332-9241-a48ea3900175 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:33.454291 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9479049e-1e0d-4332-9241-a48ea3900175 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:33.455005 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9479049e-1e0d-4332-9241-a48ea3900175 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:33.456238 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9479049e-1e0d-4332-9241-a48ea3900175 admin admin] PATH_INFO: `/v3/projects/2d4ea1df29fb479e83de3b725e52e3f1` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:33.464143 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9479049e-1e0d-4332-9241-a48ea3900175 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d4ea1df29fb479e83de3b725e52e3f1)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:33.465488 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 834/1672] 10.222.0.58 () {58 vars in 1152 bytes} [Tue Oct 12 16:49:33 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:49:33.470355 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55520c3-525a-4221-87b7-4932250cb061 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:33.474451 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9479049e-1e0d-4332-9241-a48ea3900175 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:33.511128 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55520c3-525a-4221-87b7-4932250cb061 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:33.533204 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137e79ce-d7e8-4557-b599-d1f705a3dbc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:33.536442 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137e79ce-d7e8-4557-b599-d1f705a3dbc4 admin admin] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:33.537946 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137e79ce-d7e8-4557-b599-d1f705a3dbc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:33.540733 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137e79ce-d7e8-4557-b599-d1f705a3dbc4 admin admin] PATH_INFO: `/v3/projects` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:33.545801 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137e79ce-d7e8-4557-b599-d1f705a3dbc4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:33.557068 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137e79ce-d7e8-4557-b599-d1f705a3dbc4 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:33.672556 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 835/1673] 10.222.0.58 () {60 vars in 1152 bytes} [Tue Oct 12 16:49:33 2021] POST /identity/v3/projects => generated 373 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:49:33.673779 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137e79ce-d7e8-4557-b599-d1f705a3dbc4 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:33.677363 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-9479049e-1e0d-4332-9241-a48ea3900175 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d4ea1df29fb479e83de3b725e52e3f1', 'request_id': 'req-9479049e-1e0d-4332-9241-a48ea3900175'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:33.710021 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-9479049e-1e0d-4332-9241-a48ea3900175 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d4ea1df29fb479e83de3b725e52e3f1', 'request_id': 'req-9479049e-1e0d-4332-9241-a48ea3900175'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:33.728804 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-9479049e-1e0d-4332-9241-a48ea3900175 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d4ea1df29fb479e83de3b725e52e3f1', 'request_id': 'req-9479049e-1e0d-4332-9241-a48ea3900175'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:33.758419 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-9479049e-1e0d-4332-9241-a48ea3900175 admin admin] The token cache is being invalidate because project 2d4ea1df29fb479e83de3b725e52e3f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=85204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 16:49:33.758977 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-9479049e-1e0d-4332-9241-a48ea3900175 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:33.760675 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-9479049e-1e0d-4332-9241-a48ea3900175 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:33.771000 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 839/1674] 10.222.0.58 () {58 vars in 1232 bytes} [Tue Oct 12 16:49:33 2021] DELETE /identity/v3/projects/2d4ea1df29fb479e83de3b725e52e3f1 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:49:33.773221 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73411987-8860-407c-9979-c013ab965cbd None None] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:33.774053 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73411987-8860-407c-9979-c013ab965cbd None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:33.774742 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73411987-8860-407c-9979-c013ab965cbd None None] PATH_INFO: `/` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:33.777548 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 840/1675] 10.222.0.58 () {54 vars in 921 bytes} [Tue Oct 12 16:49:33 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:49:33.782062 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73411987-8860-407c-9979-c013ab965cbd None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:33.786437 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-73411987-8860-407c-9979-c013ab965cbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:49:33.853829 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137e79ce-d7e8-4557-b599-d1f705a3dbc4 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:33.872585 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2dbc7d-c4c5-4e9b-90ec-690b15a539c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:33.873377 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2dbc7d-c4c5-4e9b-90ec-690b15a539c3 admin admin] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:33.873736 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2dbc7d-c4c5-4e9b-90ec-690b15a539c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:33.874117 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2dbc7d-c4c5-4e9b-90ec-690b15a539c3 admin admin] PATH_INFO: `/v3/users` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:33.875406 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2dbc7d-c4c5-4e9b-90ec-690b15a539c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:33.881375 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2dbc7d-c4c5-4e9b-90ec-690b15a539c3 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:33.945488 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 836/1676] 10.222.0.58 () {60 vars in 1143 bytes} [Tue Oct 12 16:49:33 2021] POST /identity/v3/users => generated 287 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:49:33.945488 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0094745a-a526-48f2-9271-f1f8e09627ae None None] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:33.947402 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0094745a-a526-48f2-9271-f1f8e09627ae None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:33.947402 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0094745a-a526-48f2-9271-f1f8e09627ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:33.998722 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.auth.core [None req-0094745a-a526-48f2-9271-f1f8e09627ae None None] MFA Rules not processed for user `29d30b574eec4ad3990d77d235c8b424`. Rule list: `[]` (Enabled: `True`). {{(pid=85205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:49:34.000536 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-0094745a-a526-48f2-9271-f1f8e09627ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:49:34.063217 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73411987-8860-407c-9979-c013ab965cbd None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:34.080995 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad3c726-f1b1-40f6-b9fa-9ceaa915fd08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:34.096220 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad3c726-f1b1-40f6-b9fa-9ceaa915fd08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:34.096805 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad3c726-f1b1-40f6-b9fa-9ceaa915fd08 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:34.097307 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad3c726-f1b1-40f6-b9fa-9ceaa915fd08 admin admin] PATH_INFO: `/v3/users/ca4f8af7550648c9975a43f936a6ea5b` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:34.099631 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad3c726-f1b1-40f6-b9fa-9ceaa915fd08 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca4f8af7550648c9975a43f936a6ea5b)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:34.104823 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad3c726-f1b1-40f6-b9fa-9ceaa915fd08 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:34.181603 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 837/1677] 10.222.0.58 () {58 vars in 1018 bytes} [Tue Oct 12 16:49:33 2021] POST /identity/v3/auth/tokens => generated 3515 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:49:34.183832 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0094745a-a526-48f2-9271-f1f8e09627ae None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:34.188881 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-0094745a-a526-48f2-9271-f1f8e09627ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:49:34.234822 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0094745a-a526-48f2-9271-f1f8e09627ae None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:34.253712 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422f5af2-762d-4069-8a0d-d1dbc36a9791 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:34.254824 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422f5af2-762d-4069-8a0d-d1dbc36a9791 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:34.255299 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422f5af2-762d-4069-8a0d-d1dbc36a9791 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:34.255700 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422f5af2-762d-4069-8a0d-d1dbc36a9791 admin admin] PATH_INFO: `/v3/roles` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:34.256828 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422f5af2-762d-4069-8a0d-d1dbc36a9791 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:34.263295 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422f5af2-762d-4069-8a0d-d1dbc36a9791 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:34.277173 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-3ad3c726-f1b1-40f6-b9fa-9ceaa915fd08 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca4f8af7550648c9975a43f936a6ea5b'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:34.296561 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 838/1678] 10.222.0.58 () {58 vars in 1121 bytes} [Tue Oct 12 16:49:34 2021] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:49:34.300877 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422f5af2-762d-4069-8a0d-d1dbc36a9791 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:34.335237 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422f5af2-762d-4069-8a0d-d1dbc36a9791 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:34.346159 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c641119-3015-46ba-92d5-1d300bcbcfbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:34.347532 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c641119-3015-46ba-92d5-1d300bcbcfbc admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:34.349639 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c641119-3015-46ba-92d5-1d300bcbcfbc admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:34.350111 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c641119-3015-46ba-92d5-1d300bcbcfbc admin admin] PATH_INFO: `/v3/roles` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:34.351037 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c641119-3015-46ba-92d5-1d300bcbcfbc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:34.354208 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-3ad3c726-f1b1-40f6-b9fa-9ceaa915fd08 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca4f8af7550648c9975a43f936a6ea5b'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:34.369525 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c641119-3015-46ba-92d5-1d300bcbcfbc admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:34.382847 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-3ad3c726-f1b1-40f6-b9fa-9ceaa915fd08 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca4f8af7550648c9975a43f936a6ea5b'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:34.395943 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 839/1679] 10.222.0.58 () {58 vars in 1121 bytes} [Tue Oct 12 16:49:34 2021] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 16:49:34.400488 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c641119-3015-46ba-92d5-1d300bcbcfbc admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:34.400783 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-3ad3c726-f1b1-40f6-b9fa-9ceaa915fd08 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca4f8af7550648c9975a43f936a6ea5b'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:34.401994 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-3ad3c726-f1b1-40f6-b9fa-9ceaa915fd08 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca4f8af7550648c9975a43f936a6ea5b'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:34.420363 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 841/1680] 10.222.0.58 () {58 vars in 1223 bytes} [Tue Oct 12 16:49:33 2021] DELETE /identity/v3/users/ca4f8af7550648c9975a43f936a6ea5b => generated 0 bytes in 636 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:49:34.444561 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c641119-3015-46ba-92d5-1d300bcbcfbc admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:34.629927 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad968a7c-c86e-4fb5-88fc-18476ff87f92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:34.631360 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad968a7c-c86e-4fb5-88fc-18476ff87f92 admin admin] REQUEST_METHOD: `PUT` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:34.632073 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad968a7c-c86e-4fb5-88fc-18476ff87f92 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:34.635278 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad968a7c-c86e-4fb5-88fc-18476ff87f92 admin admin] PATH_INFO: `/v3/projects/6c362c2dbf97489fb14864b1216960ed/users/e3d92ce744804dd1b1095415310e963a/roles/55ba49fe29884e64b57c3ad13188d554` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:34.672517 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad968a7c-c86e-4fb5-88fc-18476ff87f92 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c362c2dbf97489fb14864b1216960ed, user_id=e3d92ce744804dd1b1095415310e963a, role_id=55ba49fe29884e64b57c3ad13188d554)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:34.682795 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad968a7c-c86e-4fb5-88fc-18476ff87f92 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:34.720106 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 840/1681] 10.222.0.58 () {60 vars in 1482 bytes} [Tue Oct 12 16:49:34 2021] PUT /identity/v3/projects/6c362c2dbf97489fb14864b1216960ed/users/e3d92ce744804dd1b1095415310e963a/roles/55ba49fe29884e64b57c3ad13188d554 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:49:34.721640 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67f9de7-cc25-4fd1-8983-f14ef5c420f9 None None] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:34.722073 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67f9de7-cc25-4fd1-8983-f14ef5c420f9 None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:34.722401 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67f9de7-cc25-4fd1-8983-f14ef5c420f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:34.797529 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.auth.core [None req-b67f9de7-cc25-4fd1-8983-f14ef5c420f9 None None] MFA Rules not processed for user `e3d92ce744804dd1b1095415310e963a`. Rule list: `[]` (Enabled: `True`). {{(pid=85204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:49:34.801407 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-b67f9de7-cc25-4fd1-8983-f14ef5c420f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:49:34.891838 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad968a7c-c86e-4fb5-88fc-18476ff87f92 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:34.900120 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-ad968a7c-c86e-4fb5-88fc-18476ff87f92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:49:35.100913 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 842/1682] 10.222.0.58 () {58 vars in 957 bytes} [Tue Oct 12 16:49:34 2021] POST /identity/v3/auth/tokens => generated 3393 bytes in 380 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:49:35.104051 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67f9de7-cc25-4fd1-8983-f14ef5c420f9 None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:35.108923 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-b67f9de7-cc25-4fd1-8983-f14ef5c420f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:49:35.160052 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad968a7c-c86e-4fb5-88fc-18476ff87f92 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:35.178718 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d24594-f07f-4147-b664-80d052410d6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:35.180269 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d24594-f07f-4147-b664-80d052410d6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:35.180550 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d24594-f07f-4147-b664-80d052410d6d admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:35.180824 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d24594-f07f-4147-b664-80d052410d6d admin admin] PATH_INFO: `/v3/projects/358fc36e15df4b6a979eda55c9f13063` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:35.185743 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d24594-f07f-4147-b664-80d052410d6d admin admin] RBAC: Authorizing `identity:delete_project(project_id=358fc36e15df4b6a979eda55c9f13063)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:35.207572 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d24594-f07f-4147-b664-80d052410d6d admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:35.291558 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67f9de7-cc25-4fd1-8983-f14ef5c420f9 None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:35.300258 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc72c6e-bbba-4b3b-b7a7-c6a26428c003 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29d30b574eec4ad3990d77d235c8b424', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:35.301126 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc72c6e-bbba-4b3b-b7a7-c6a26428c003 service nova] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:35.302074 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc72c6e-bbba-4b3b-b7a7-c6a26428c003 service nova] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:35.302253 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc72c6e-bbba-4b3b-b7a7-c6a26428c003 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:35.308597 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-5bc72c6e-bbba-4b3b-b7a7-c6a26428c003 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:49:35.337156 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc72c6e-bbba-4b3b-b7a7-c6a26428c003 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:35.342772 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc72c6e-bbba-4b3b-b7a7-c6a26428c003 service nova] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:35.344104 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-a2d24594-f07f-4147-b664-80d052410d6d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '358fc36e15df4b6a979eda55c9f13063', 'request_id': 'req-a2d24594-f07f-4147-b664-80d052410d6d'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:35.369483 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-a2d24594-f07f-4147-b664-80d052410d6d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '358fc36e15df4b6a979eda55c9f13063', 'request_id': 'req-a2d24594-f07f-4147-b664-80d052410d6d'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:35.380277 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 843/1683] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Oct 12 16:49:35 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:49:35.387709 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-a2d24594-f07f-4147-b664-80d052410d6d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '358fc36e15df4b6a979eda55c9f13063', 'request_id': 'req-a2d24594-f07f-4147-b664-80d052410d6d'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:35.418843 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-a2d24594-f07f-4147-b664-80d052410d6d admin admin] The token cache is being invalidate because project 358fc36e15df4b6a979eda55c9f13063 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=85205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 16:49:35.419232 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-a2d24594-f07f-4147-b664-80d052410d6d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:35.420439 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-a2d24594-f07f-4147-b664-80d052410d6d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:35.425167 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 841/1684] 10.222.0.58 () {58 vars in 1232 bytes} [Tue Oct 12 16:49:34 2021] DELETE /identity/v3/projects/358fc36e15df4b6a979eda55c9f13063 => generated 0 bytes in 534 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:49:35.429134 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc72c6e-bbba-4b3b-b7a7-c6a26428c003 service nova] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:35.445577 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc72c6e-bbba-4b3b-b7a7-c6a26428c003 service nova] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:35.620536 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59848cb5-146c-4ae1-9aea-371ccc08b989 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:35.621605 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59848cb5-146c-4ae1-9aea-371ccc08b989 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:35.621968 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59848cb5-146c-4ae1-9aea-371ccc08b989 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:35.622245 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59848cb5-146c-4ae1-9aea-371ccc08b989 admin admin] PATH_INFO: `/v3/users/0106b010632e4ad59af3f2921725012b` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:35.623812 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59848cb5-146c-4ae1-9aea-371ccc08b989 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0106b010632e4ad59af3f2921725012b)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:35.631297 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59848cb5-146c-4ae1-9aea-371ccc08b989 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:35.634833 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d24594-f07f-4147-b664-80d052410d6d admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:35.636338 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-a2d24594-f07f-4147-b664-80d052410d6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:49:35.793235 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-59848cb5-146c-4ae1-9aea-371ccc08b989 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0106b010632e4ad59af3f2921725012b'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:35.827003 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-59848cb5-146c-4ae1-9aea-371ccc08b989 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0106b010632e4ad59af3f2921725012b'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:35.842426 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-59848cb5-146c-4ae1-9aea-371ccc08b989 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0106b010632e4ad59af3f2921725012b'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:35.873164 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-59848cb5-146c-4ae1-9aea-371ccc08b989 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0106b010632e4ad59af3f2921725012b'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:35.873570 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d24594-f07f-4147-b664-80d052410d6d admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:35.874011 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-59848cb5-146c-4ae1-9aea-371ccc08b989 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0106b010632e4ad59af3f2921725012b'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:35.897022 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 844/1685] 10.222.0.58 () {58 vars in 1223 bytes} [Tue Oct 12 16:49:35 2021] DELETE /identity/v3/users/0106b010632e4ad59af3f2921725012b => generated 0 bytes in 468 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:49:35.901736 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5047ac96-1616-4123-9e98-030eced0d5e9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29d30b574eec4ad3990d77d235c8b424', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:35.902844 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5047ac96-1616-4123-9e98-030eced0d5e9 service nova] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:35.903167 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5047ac96-1616-4123-9e98-030eced0d5e9 service nova] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:35.903451 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5047ac96-1616-4123-9e98-030eced0d5e9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:35.905489 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-5047ac96-1616-4123-9e98-030eced0d5e9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:49:36.143216 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5047ac96-1616-4123-9e98-030eced0d5e9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:36.150654 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5047ac96-1616-4123-9e98-030eced0d5e9 service nova] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:36.196989 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 842/1686] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Oct 12 16:49:35 2021] GET /identity/v3/auth/tokens => generated 3393 bytes in 562 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 12 16:49:36.689971 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59848cb5-146c-4ae1-9aea-371ccc08b989 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:36.692632 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-59848cb5-146c-4ae1-9aea-371ccc08b989 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:49:36.866576 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59848cb5-146c-4ae1-9aea-371ccc08b989 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:36.874912 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d16514-039f-4509-a238-2ef4d7888a4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:36.879268 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d16514-039f-4509-a238-2ef4d7888a4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:36.879866 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d16514-039f-4509-a238-2ef4d7888a4e admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:36.880334 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d16514-039f-4509-a238-2ef4d7888a4e admin admin] PATH_INFO: `/v3/users/e3d92ce744804dd1b1095415310e963a` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:36.884737 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d16514-039f-4509-a238-2ef4d7888a4e admin admin] RBAC: Authorizing `identity:delete_user(user_id=e3d92ce744804dd1b1095415310e963a)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:36.896641 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d16514-039f-4509-a238-2ef4d7888a4e admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:37.019421 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-73d16514-039f-4509-a238-2ef4d7888a4e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e3d92ce744804dd1b1095415310e963a'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:37.052556 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-73d16514-039f-4509-a238-2ef4d7888a4e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e3d92ce744804dd1b1095415310e963a'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:37.072935 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-73d16514-039f-4509-a238-2ef4d7888a4e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e3d92ce744804dd1b1095415310e963a'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:37.087927 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-73d16514-039f-4509-a238-2ef4d7888a4e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e3d92ce744804dd1b1095415310e963a'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:37.090037 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-73d16514-039f-4509-a238-2ef4d7888a4e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e3d92ce744804dd1b1095415310e963a'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:37.104392 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 845/1687] 10.222.0.58 () {58 vars in 1223 bytes} [Tue Oct 12 16:49:36 2021] DELETE /identity/v3/users/e3d92ce744804dd1b1095415310e963a => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:49:37.109174 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8620b0a-67ca-4529-929e-20c2ddfdc3e7 None None] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:37.109681 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8620b0a-67ca-4529-929e-20c2ddfdc3e7 None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:37.110095 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8620b0a-67ca-4529-929e-20c2ddfdc3e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:37.142095 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.auth.core [None req-e8620b0a-67ca-4529-929e-20c2ddfdc3e7 None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:49:37.143438 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-e8620b0a-67ca-4529-929e-20c2ddfdc3e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:49:37.250743 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d16514-039f-4509-a238-2ef4d7888a4e admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:37.252562 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-73d16514-039f-4509-a238-2ef4d7888a4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:49:37.311450 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 843/1688] 10.222.0.58 () {58 vars in 957 bytes} [Tue Oct 12 16:49:37 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:49:37.398722 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8620b0a-67ca-4529-929e-20c2ddfdc3e7 None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:37.400185 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-e8620b0a-67ca-4529-929e-20c2ddfdc3e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:49:37.420487 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d16514-039f-4509-a238-2ef4d7888a4e admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:37.444955 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b51f5f1-9303-43cf-a9cf-c3347206e52a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:37.446833 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b51f5f1-9303-43cf-a9cf-c3347206e52a admin admin] REQUEST_METHOD: `DELETE` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:37.447190 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b51f5f1-9303-43cf-a9cf-c3347206e52a admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:37.449587 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b51f5f1-9303-43cf-a9cf-c3347206e52a admin admin] PATH_INFO: `/v3/projects/7338765b647543fe8e7234c241741a40` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:37.451025 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b51f5f1-9303-43cf-a9cf-c3347206e52a admin admin] RBAC: Authorizing `identity:delete_project(project_id=7338765b647543fe8e7234c241741a40)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:37.453178 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b51f5f1-9303-43cf-a9cf-c3347206e52a admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:37.579392 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-5b51f5f1-9303-43cf-a9cf-c3347206e52a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7338765b647543fe8e7234c241741a40', 'request_id': 'req-5b51f5f1-9303-43cf-a9cf-c3347206e52a'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:37.584962 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8620b0a-67ca-4529-929e-20c2ddfdc3e7 None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:37.588733 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-5b51f5f1-9303-43cf-a9cf-c3347206e52a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7338765b647543fe8e7234c241741a40', 'request_id': 'req-5b51f5f1-9303-43cf-a9cf-c3347206e52a'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:37.597056 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-5b51f5f1-9303-43cf-a9cf-c3347206e52a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7338765b647543fe8e7234c241741a40', 'request_id': 'req-5b51f5f1-9303-43cf-a9cf-c3347206e52a'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:37.646473 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-5b51f5f1-9303-43cf-a9cf-c3347206e52a admin admin] The token cache is being invalidate because project 7338765b647543fe8e7234c241741a40 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=85204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 16:49:37.646862 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-5b51f5f1-9303-43cf-a9cf-c3347206e52a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:37.650489 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-5b51f5f1-9303-43cf-a9cf-c3347206e52a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:37.658952 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 846/1689] 10.222.0.58 () {58 vars in 1232 bytes} [Tue Oct 12 16:49:37 2021] DELETE /identity/v3/projects/7338765b647543fe8e7234c241741a40 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 16:49:37.664825 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf8116f-8fde-4202-b1b5-3dba508b87fb None None] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:37.665272 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf8116f-8fde-4202-b1b5-3dba508b87fb None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:37.665653 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf8116f-8fde-4202-b1b5-3dba508b87fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:37.721431 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.auth.core [None req-1bf8116f-8fde-4202-b1b5-3dba508b87fb None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:49:37.725782 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-1bf8116f-8fde-4202-b1b5-3dba508b87fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:49:37.771768 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181862c0-5642-42e3-8d2d-05ed1107945f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e65f6d0598e4c539134292b86fb43d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:37.772434 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181862c0-5642-42e3-8d2d-05ed1107945f service neutron] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:37.772719 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181862c0-5642-42e3-8d2d-05ed1107945f service neutron] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:37.772995 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181862c0-5642-42e3-8d2d-05ed1107945f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:37.777004 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-181862c0-5642-42e3-8d2d-05ed1107945f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:49:37.928529 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 847/1690] 10.222.0.58 () {58 vars in 957 bytes} [Tue Oct 12 16:49:37 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:49:37.929805 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf8116f-8fde-4202-b1b5-3dba508b87fb None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:37.935863 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-1bf8116f-8fde-4202-b1b5-3dba508b87fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:49:38.038455 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf8116f-8fde-4202-b1b5-3dba508b87fb None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:38.057368 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62406a50-f197-45bd-b2f0-f0deaa51939f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:38.059214 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62406a50-f197-45bd-b2f0-f0deaa51939f admin admin] REQUEST_METHOD: `DELETE` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:38.068764 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62406a50-f197-45bd-b2f0-f0deaa51939f admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:38.071060 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62406a50-f197-45bd-b2f0-f0deaa51939f admin admin] PATH_INFO: `/v3/projects/b4fc2cceaf6b4386b10efb36b8ac4c43` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:38.077618 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62406a50-f197-45bd-b2f0-f0deaa51939f admin admin] RBAC: Authorizing `identity:delete_project(project_id=b4fc2cceaf6b4386b10efb36b8ac4c43)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:38.083072 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62406a50-f197-45bd-b2f0-f0deaa51939f admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:38.150208 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181862c0-5642-42e3-8d2d-05ed1107945f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:38.151659 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181862c0-5642-42e3-8d2d-05ed1107945f service neutron] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:38.199193 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 844/1691] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Oct 12 16:49:37 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 801 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 12 16:49:38.200400 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34f1c10-2d77-4c26-b017-b642502eab5c None None] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:38.200694 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34f1c10-2d77-4c26-b017-b642502eab5c None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:38.200975 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34f1c10-2d77-4c26-b017-b642502eab5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:38.270146 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-62406a50-f197-45bd-b2f0-f0deaa51939f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b4fc2cceaf6b4386b10efb36b8ac4c43', 'request_id': 'req-62406a50-f197-45bd-b2f0-f0deaa51939f'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:38.274967 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.auth.core [None req-d34f1c10-2d77-4c26-b017-b642502eab5c None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:49:38.276225 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-d34f1c10-2d77-4c26-b017-b642502eab5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:49:38.299921 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-62406a50-f197-45bd-b2f0-f0deaa51939f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b4fc2cceaf6b4386b10efb36b8ac4c43', 'request_id': 'req-62406a50-f197-45bd-b2f0-f0deaa51939f'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:38.318557 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-62406a50-f197-45bd-b2f0-f0deaa51939f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b4fc2cceaf6b4386b10efb36b8ac4c43', 'request_id': 'req-62406a50-f197-45bd-b2f0-f0deaa51939f'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:38.367369 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-62406a50-f197-45bd-b2f0-f0deaa51939f admin admin] The token cache is being invalidate because project b4fc2cceaf6b4386b10efb36b8ac4c43 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=85204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 16:49:38.367743 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-62406a50-f197-45bd-b2f0-f0deaa51939f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:38.368998 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-62406a50-f197-45bd-b2f0-f0deaa51939f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:38.375291 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 848/1692] 10.222.0.58 () {58 vars in 1232 bytes} [Tue Oct 12 16:49:37 2021] DELETE /identity/v3/projects/b4fc2cceaf6b4386b10efb36b8ac4c43 => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:49:38.377156 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e6ad9c-afcc-4926-bf43-98db39f7b5e6 None None] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:38.377430 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e6ad9c-afcc-4926-bf43-98db39f7b5e6 None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:38.377709 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e6ad9c-afcc-4926-bf43-98db39f7b5e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:38.438318 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 845/1693] 10.222.0.58 () {58 vars in 957 bytes} [Tue Oct 12 16:49:38 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:49:38.442813 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34f1c10-2d77-4c26-b017-b642502eab5c None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:38.461307 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34f1c10-2d77-4c26-b017-b642502eab5c None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:38.483185 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa03447-527f-4b6d-bb3b-612dcf0a1f10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:38.483901 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa03447-527f-4b6d-bb3b-612dcf0a1f10 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:38.484169 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa03447-527f-4b6d-bb3b-612dcf0a1f10 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:38.484623 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa03447-527f-4b6d-bb3b-612dcf0a1f10 admin admin] PATH_INFO: `/v3/domains` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:38.485536 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa03447-527f-4b6d-bb3b-612dcf0a1f10 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:49:38.486034 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa03447-527f-4b6d-bb3b-612dcf0a1f10 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:38.486157 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.auth.core [None req-90e6ad9c-afcc-4926-bf43-98db39f7b5e6 None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:49:38.487398 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-90e6ad9c-afcc-4926-bf43-98db39f7b5e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:49:38.488093 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa03447-527f-4b6d-bb3b-612dcf0a1f10 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:38.521663 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 846/1694] 10.222.0.58 () {58 vars in 1152 bytes} [Tue Oct 12 16:49:38 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 16:49:38.522830 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 849/1695] 10.222.0.58 () {58 vars in 957 bytes} [Tue Oct 12 16:49:38 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:49:38.532270 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa03447-527f-4b6d-bb3b-612dcf0a1f10 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:38.534218 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27146acd-57f6-4a5f-9508-bac056e459d3 None None] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:38.534510 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27146acd-57f6-4a5f-9508-bac056e459d3 None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:38.534794 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27146acd-57f6-4a5f-9508-bac056e459d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:38.586424 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa03447-527f-4b6d-bb3b-612dcf0a1f10 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:38.611849 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.auth.core [None req-27146acd-57f6-4a5f-9508-bac056e459d3 None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:49:38.613101 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-27146acd-57f6-4a5f-9508-bac056e459d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:49:38.614877 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93752766-5fac-4a50-ba79-5217172d36ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:38.615881 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93752766-5fac-4a50-ba79-5217172d36ab admin admin] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:38.616209 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93752766-5fac-4a50-ba79-5217172d36ab admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:38.616472 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93752766-5fac-4a50-ba79-5217172d36ab admin admin] PATH_INFO: `/v3/projects` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:38.617783 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93752766-5fac-4a50-ba79-5217172d36ab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:38.619741 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93752766-5fac-4a50-ba79-5217172d36ab admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:38.687907 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 850/1696] 10.222.0.58 () {58 vars in 957 bytes} [Tue Oct 12 16:49:38 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:49:38.691925 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27146acd-57f6-4a5f-9508-bac056e459d3 None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:38.736522 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27146acd-57f6-4a5f-9508-bac056e459d3 None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:38.754175 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d8419a-c10c-48bc-970b-8a4b6666ff71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:38.755034 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d8419a-c10c-48bc-970b-8a4b6666ff71 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:38.755475 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d8419a-c10c-48bc-970b-8a4b6666ff71 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:38.755794 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d8419a-c10c-48bc-970b-8a4b6666ff71 admin admin] PATH_INFO: `/v3/domains` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:38.756662 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d8419a-c10c-48bc-970b-8a4b6666ff71 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:49:38.757079 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d8419a-c10c-48bc-970b-8a4b6666ff71 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:38.759823 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d8419a-c10c-48bc-970b-8a4b6666ff71 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:38.772630 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 847/1697] 10.222.0.58 () {60 vars in 1152 bytes} [Tue Oct 12 16:49:38 2021] POST /identity/v3/projects => generated 367 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:49:38.774101 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93752766-5fac-4a50-ba79-5217172d36ab admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:38.794006 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 851/1698] 10.222.0.58 () {58 vars in 1152 bytes} [Tue Oct 12 16:49:38 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:49:38.798746 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d8419a-c10c-48bc-970b-8a4b6666ff71 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:38.852333 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d8419a-c10c-48bc-970b-8a4b6666ff71 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:38.978136 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc89470c-db2a-4ca7-95ac-dba2b3bd0014 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:38.979151 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc89470c-db2a-4ca7-95ac-dba2b3bd0014 admin admin] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:38.981816 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc89470c-db2a-4ca7-95ac-dba2b3bd0014 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:38.982508 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc89470c-db2a-4ca7-95ac-dba2b3bd0014 admin admin] PATH_INFO: `/v3/projects` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:38.983705 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc89470c-db2a-4ca7-95ac-dba2b3bd0014 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:38.989154 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc89470c-db2a-4ca7-95ac-dba2b3bd0014 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:39.006711 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93752766-5fac-4a50-ba79-5217172d36ab admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:39.032978 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c49dcfe-78d0-4904-a188-cb9f5cd33297 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:39.033736 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c49dcfe-78d0-4904-a188-cb9f5cd33297 admin admin] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:39.034105 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c49dcfe-78d0-4904-a188-cb9f5cd33297 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:39.034386 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c49dcfe-78d0-4904-a188-cb9f5cd33297 admin admin] PATH_INFO: `/v3/users` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:39.035118 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c49dcfe-78d0-4904-a188-cb9f5cd33297 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:39.037066 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c49dcfe-78d0-4904-a188-cb9f5cd33297 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:39.104332 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 852/1699] 10.222.0.58 () {60 vars in 1152 bytes} [Tue Oct 12 16:49:38 2021] POST /identity/v3/projects => generated 371 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:49:39.106921 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 848/1700] 10.222.0.58 () {60 vars in 1143 bytes} [Tue Oct 12 16:49:38 2021] POST /identity/v3/users => generated 284 bytes in 334 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:49:39.108133 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc89470c-db2a-4ca7-95ac-dba2b3bd0014 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:39.110625 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c49dcfe-78d0-4904-a188-cb9f5cd33297 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:39.127869 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c49dcfe-78d0-4904-a188-cb9f5cd33297 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:39.244360 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e93003-4e1c-4148-a063-95d3e57b5b14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:39.247598 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e93003-4e1c-4148-a063-95d3e57b5b14 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:39.248180 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e93003-4e1c-4148-a063-95d3e57b5b14 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:39.248660 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e93003-4e1c-4148-a063-95d3e57b5b14 admin admin] PATH_INFO: `/v3/roles` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:39.250849 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e93003-4e1c-4148-a063-95d3e57b5b14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:39.253808 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e93003-4e1c-4148-a063-95d3e57b5b14 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:39.282097 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 849/1701] 10.222.0.58 () {58 vars in 1121 bytes} [Tue Oct 12 16:49:39 2021] GET /identity/v3/roles => generated 1420 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 16:49:39.283106 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e93003-4e1c-4148-a063-95d3e57b5b14 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:39.306404 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e93003-4e1c-4148-a063-95d3e57b5b14 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:39.318363 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9ff19a-7c87-4b9b-8052-a6aa2b798f13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:39.319172 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9ff19a-7c87-4b9b-8052-a6aa2b798f13 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:39.319728 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9ff19a-7c87-4b9b-8052-a6aa2b798f13 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:39.320745 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9ff19a-7c87-4b9b-8052-a6aa2b798f13 admin admin] PATH_INFO: `/v3/roles` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:39.321709 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9ff19a-7c87-4b9b-8052-a6aa2b798f13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:39.326483 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9ff19a-7c87-4b9b-8052-a6aa2b798f13 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:39.327524 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc89470c-db2a-4ca7-95ac-dba2b3bd0014 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:39.342630 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae18f7c-64a2-4b17-9d06-e4c77cf29dbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:39.343425 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae18f7c-64a2-4b17-9d06-e4c77cf29dbc admin admin] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:39.346793 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae18f7c-64a2-4b17-9d06-e4c77cf29dbc admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:39.347269 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae18f7c-64a2-4b17-9d06-e4c77cf29dbc admin admin] PATH_INFO: `/v3/users` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:39.349265 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae18f7c-64a2-4b17-9d06-e4c77cf29dbc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:39.358006 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 850/1702] 10.222.0.58 () {58 vars in 1121 bytes} [Tue Oct 12 16:49:39 2021] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:49:39.359264 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9ff19a-7c87-4b9b-8052-a6aa2b798f13 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:39.363845 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae18f7c-64a2-4b17-9d06-e4c77cf29dbc admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:39.390896 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9ff19a-7c87-4b9b-8052-a6aa2b798f13 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:39.403636 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f52396d-73cb-4792-b303-c889fb9c4f5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:39.405975 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f52396d-73cb-4792-b303-c889fb9c4f5d admin admin] REQUEST_METHOD: `PUT` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:39.406404 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f52396d-73cb-4792-b303-c889fb9c4f5d admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:39.407389 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f52396d-73cb-4792-b303-c889fb9c4f5d admin admin] PATH_INFO: `/v3/projects/836bd645d8794f779b7ab9db47de0476/users/c13d9c04de8848d7b4546bbe9a457e3a/roles/55ba49fe29884e64b57c3ad13188d554` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:39.420438 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 853/1703] 10.222.0.58 () {60 vars in 1143 bytes} [Tue Oct 12 16:49:39 2021] POST /identity/v3/users => generated 286 bytes in 314 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:49:39.424801 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae18f7c-64a2-4b17-9d06-e4c77cf29dbc admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:39.449054 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f52396d-73cb-4792-b303-c889fb9c4f5d admin admin] RBAC: Authorizing `identity:create_grant(project_id=836bd645d8794f779b7ab9db47de0476, user_id=c13d9c04de8848d7b4546bbe9a457e3a, role_id=55ba49fe29884e64b57c3ad13188d554)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:39.452717 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f52396d-73cb-4792-b303-c889fb9c4f5d admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:39.473438 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae18f7c-64a2-4b17-9d06-e4c77cf29dbc admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:39.474824 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 851/1704] 10.222.0.58 () {60 vars in 1482 bytes} [Tue Oct 12 16:49:39 2021] PUT /identity/v3/projects/836bd645d8794f779b7ab9db47de0476/users/c13d9c04de8848d7b4546bbe9a457e3a/roles/55ba49fe29884e64b57c3ad13188d554 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:49:39.487674 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb4a5ae-ea5c-4a4f-b777-a754951ee63c None None] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:39.488088 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb4a5ae-ea5c-4a4f-b777-a754951ee63c None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:39.488513 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb4a5ae-ea5c-4a4f-b777-a754951ee63c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:39.566092 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.auth.core [None req-aeb4a5ae-ea5c-4a4f-b777-a754951ee63c None None] MFA Rules not processed for user `a2a325b7887344d7aba7ef3e6fe624c9`. Rule list: `[]` (Enabled: `True`). {{(pid=85205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:49:39.567474 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-aeb4a5ae-ea5c-4a4f-b777-a754951ee63c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:49:39.653707 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d65acd-6d39-4c45-ba45-e07a638d2427 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:39.654490 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d65acd-6d39-4c45-ba45-e07a638d2427 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:39.654817 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d65acd-6d39-4c45-ba45-e07a638d2427 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:39.655090 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d65acd-6d39-4c45-ba45-e07a638d2427 admin admin] PATH_INFO: `/v3/roles` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:39.655845 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d65acd-6d39-4c45-ba45-e07a638d2427 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:39.658263 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d65acd-6d39-4c45-ba45-e07a638d2427 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:39.686043 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 854/1705] 10.222.0.58 () {58 vars in 1121 bytes} [Tue Oct 12 16:49:39 2021] GET /identity/v3/roles => generated 1420 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:49:39.687805 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c6e969-5d18-42d3-bf44-2da3739e77b6 None None] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:39.688293 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c6e969-5d18-42d3-bf44-2da3739e77b6 None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:39.689046 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c6e969-5d18-42d3-bf44-2da3739e77b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:39.719611 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 852/1706] 10.222.0.58 () {58 vars in 957 bytes} [Tue Oct 12 16:49:39 2021] POST /identity/v3/auth/tokens => generated 3425 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:49:39.721450 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb4a5ae-ea5c-4a4f-b777-a754951ee63c None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:39.722561 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.auth.core [None req-86c6e969-5d18-42d3-bf44-2da3739e77b6 None None] MFA Rules not processed for user `c13d9c04de8848d7b4546bbe9a457e3a`. Rule list: `[]` (Enabled: `True`). {{(pid=85204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:49:39.724700 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-86c6e969-5d18-42d3-bf44-2da3739e77b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:49:39.742352 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb4a5ae-ea5c-4a4f-b777-a754951ee63c None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:39.752597 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853f85a8-93e0-4707-8ad7-0c9d130b279b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:39.753571 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853f85a8-93e0-4707-8ad7-0c9d130b279b admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:39.753984 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853f85a8-93e0-4707-8ad7-0c9d130b279b admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:39.754579 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853f85a8-93e0-4707-8ad7-0c9d130b279b admin admin] PATH_INFO: `/v3/roles` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:39.756258 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853f85a8-93e0-4707-8ad7-0c9d130b279b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:39.759990 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853f85a8-93e0-4707-8ad7-0c9d130b279b admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:39.782660 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 853/1707] 10.222.0.58 () {58 vars in 1121 bytes} [Tue Oct 12 16:49:39 2021] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:49:39.787981 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853f85a8-93e0-4707-8ad7-0c9d130b279b admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:39.791615 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-853f85a8-93e0-4707-8ad7-0c9d130b279b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:49:39.826004 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853f85a8-93e0-4707-8ad7-0c9d130b279b admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:39.839780 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c7ecca-4fb6-4208-adda-7d762ce52df0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:39.841162 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c7ecca-4fb6-4208-adda-7d762ce52df0 admin admin] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:39.841580 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c7ecca-4fb6-4208-adda-7d762ce52df0 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:39.841914 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c7ecca-4fb6-4208-adda-7d762ce52df0 admin admin] PATH_INFO: `/v3/projects` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:39.843118 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c7ecca-4fb6-4208-adda-7d762ce52df0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:39.848877 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c7ecca-4fb6-4208-adda-7d762ce52df0 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:39.877095 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 855/1708] 10.222.0.58 () {58 vars in 957 bytes} [Tue Oct 12 16:49:39 2021] POST /identity/v3/auth/tokens => generated 3387 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:49:39.877985 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c6e969-5d18-42d3-bf44-2da3739e77b6 None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:39.900859 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 854/1709] 10.222.0.58 () {60 vars in 1152 bytes} [Tue Oct 12 16:49:39 2021] POST /identity/v3/projects => generated 405 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:49:39.902632 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c7ecca-4fb6-4208-adda-7d762ce52df0 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:39.903634 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c6e969-5d18-42d3-bf44-2da3739e77b6 None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:40.014392 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97039126-b835-4293-925b-1638ca269098 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:40.015643 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97039126-b835-4293-925b-1638ca269098 admin admin] REQUEST_METHOD: `PUT` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:40.017713 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97039126-b835-4293-925b-1638ca269098 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:40.017911 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97039126-b835-4293-925b-1638ca269098 admin admin] PATH_INFO: `/v3/projects/1c794f0e91f4416d8d822d8ed1f970fb/users/ec884ca51e9243c6a660dd494d49d17b/roles/55ba49fe29884e64b57c3ad13188d554` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:40.026639 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c7ecca-4fb6-4208-adda-7d762ce52df0 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:40.036669 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e279ab-5057-46a7-9f5a-d451758f1bd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:40.041283 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e279ab-5057-46a7-9f5a-d451758f1bd4 admin admin] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:40.041934 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e279ab-5057-46a7-9f5a-d451758f1bd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:40.042421 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e279ab-5057-46a7-9f5a-d451758f1bd4 admin admin] PATH_INFO: `/v3/projects` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:40.043323 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e279ab-5057-46a7-9f5a-d451758f1bd4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:40.049038 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e279ab-5057-46a7-9f5a-d451758f1bd4 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:40.052440 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97039126-b835-4293-925b-1638ca269098 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c794f0e91f4416d8d822d8ed1f970fb, user_id=ec884ca51e9243c6a660dd494d49d17b, role_id=55ba49fe29884e64b57c3ad13188d554)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:40.055802 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97039126-b835-4293-925b-1638ca269098 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:40.109011 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 856/1710] 10.222.0.58 () {60 vars in 1482 bytes} [Tue Oct 12 16:49:39 2021] PUT /identity/v3/projects/1c794f0e91f4416d8d822d8ed1f970fb/users/ec884ca51e9243c6a660dd494d49d17b/roles/55ba49fe29884e64b57c3ad13188d554 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:49:40.111156 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 855/1711] 10.222.0.58 () {60 vars in 1152 bytes} [Tue Oct 12 16:49:39 2021] POST /identity/v3/projects => generated 367 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:49:40.111987 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97039126-b835-4293-925b-1638ca269098 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:40.112321 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24eef3b-88d9-4768-aa76-f5c4aee97e29 None None] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:40.112613 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24eef3b-88d9-4768-aa76-f5c4aee97e29 None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:40.112896 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24eef3b-88d9-4768-aa76-f5c4aee97e29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:40.183311 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.auth.core [None req-e24eef3b-88d9-4768-aa76-f5c4aee97e29 None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:49:40.185774 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-e24eef3b-88d9-4768-aa76-f5c4aee97e29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:49:40.244147 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97039126-b835-4293-925b-1638ca269098 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:40.323585 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 856/1712] 10.222.0.58 () {58 vars in 957 bytes} [Tue Oct 12 16:49:40 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:49:40.324355 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24eef3b-88d9-4768-aa76-f5c4aee97e29 None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:40.328131 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1a368a-5d49-415f-808d-15df228282b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:40.328837 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1a368a-5d49-415f-808d-15df228282b0 admin admin] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:40.329132 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1a368a-5d49-415f-808d-15df228282b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:40.329408 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1a368a-5d49-415f-808d-15df228282b0 admin admin] PATH_INFO: `/v3/users` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:40.330375 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1a368a-5d49-415f-808d-15df228282b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:40.334551 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1a368a-5d49-415f-808d-15df228282b0 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:40.344334 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24eef3b-88d9-4768-aa76-f5c4aee97e29 None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:40.361383 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2764ef8c-8124-4524-8547-0d70561d1589 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:40.363733 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2764ef8c-8124-4524-8547-0d70561d1589 admin admin] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:40.365429 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2764ef8c-8124-4524-8547-0d70561d1589 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:40.367357 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2764ef8c-8124-4524-8547-0d70561d1589 admin admin] PATH_INFO: `/v3/users` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:40.368137 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2764ef8c-8124-4524-8547-0d70561d1589 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:40.373531 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2764ef8c-8124-4524-8547-0d70561d1589 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:40.379481 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 857/1713] 10.222.0.58 () {60 vars in 1143 bytes} [Tue Oct 12 16:49:40 2021] POST /identity/v3/users => generated 309 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:49:40.380003 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1a368a-5d49-415f-808d-15df228282b0 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:40.386233 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-0a1a368a-5d49-415f-808d-15df228282b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:49:40.462532 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 857/1714] 10.222.0.58 () {60 vars in 1143 bytes} [Tue Oct 12 16:49:40 2021] POST /identity/v3/users => generated 290 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:49:40.463562 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2764ef8c-8124-4524-8547-0d70561d1589 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:40.480794 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2764ef8c-8124-4524-8547-0d70561d1589 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:40.496476 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c1f524-dcf9-4853-af4c-00fa018fa8d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:40.498804 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c1f524-dcf9-4853-af4c-00fa018fa8d4 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:40.499097 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c1f524-dcf9-4853-af4c-00fa018fa8d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:40.499835 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c1f524-dcf9-4853-af4c-00fa018fa8d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:40.502065 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c1f524-dcf9-4853-af4c-00fa018fa8d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:40.506932 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c1f524-dcf9-4853-af4c-00fa018fa8d4 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:40.537908 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1a368a-5d49-415f-808d-15df228282b0 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:40.538077 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 858/1715] 10.222.0.58 () {58 vars in 1121 bytes} [Tue Oct 12 16:49:40 2021] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:49:40.539364 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c1f524-dcf9-4853-af4c-00fa018fa8d4 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:40.549033 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215b8d52-4085-41b2-9980-e9ef334a6b26 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e65f6d0598e4c539134292b86fb43d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:40.549951 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215b8d52-4085-41b2-9980-e9ef334a6b26 service neutron] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:40.550314 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215b8d52-4085-41b2-9980-e9ef334a6b26 service neutron] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:40.550761 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215b8d52-4085-41b2-9980-e9ef334a6b26 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:40.566058 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c1f524-dcf9-4853-af4c-00fa018fa8d4 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:40.576940 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215b8d52-4085-41b2-9980-e9ef334a6b26 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:40.578336 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215b8d52-4085-41b2-9980-e9ef334a6b26 service neutron] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:40.583443 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c634b4-f38b-49b6-b4c1-ccfa17c4dc57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:40.583989 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c634b4-f38b-49b6-b4c1-ccfa17c4dc57 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:40.584157 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c634b4-f38b-49b6-b4c1-ccfa17c4dc57 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:40.584439 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c634b4-f38b-49b6-b4c1-ccfa17c4dc57 admin admin] PATH_INFO: `/v3/roles` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:40.585351 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c634b4-f38b-49b6-b4c1-ccfa17c4dc57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:40.589662 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c634b4-f38b-49b6-b4c1-ccfa17c4dc57 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:40.616348 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 859/1716] 10.222.0.58 () {58 vars in 1121 bytes} [Tue Oct 12 16:49:40 2021] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:49:40.616348 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c634b4-f38b-49b6-b4c1-ccfa17c4dc57 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:40.619254 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 858/1717] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Oct 12 16:49:40 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:49:40.631992 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215b8d52-4085-41b2-9980-e9ef334a6b26 service neutron] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:40.640202 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c634b4-f38b-49b6-b4c1-ccfa17c4dc57 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:40.643640 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215b8d52-4085-41b2-9980-e9ef334a6b26 service neutron] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:40.649850 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdf1d8e-ab4e-4655-849c-31445a02e48e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:40.651733 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdf1d8e-ab4e-4655-849c-31445a02e48e admin admin] REQUEST_METHOD: `PUT` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:40.652227 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdf1d8e-ab4e-4655-849c-31445a02e48e admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:40.652723 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdf1d8e-ab4e-4655-849c-31445a02e48e admin admin] PATH_INFO: `/v3/projects/87a8fa54fd2b489da5ada318bbcfe717/users/8b0342467f704f25a16d4e0b223fa6a2/roles/610824e4f50f4fb8954610e98c1de784` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:40.654847 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ce84fa-1d27-4bd2-8f8d-809305248b9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:40.655891 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ce84fa-1d27-4bd2-8f8d-809305248b9e admin admin] REQUEST_METHOD: `PUT` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:40.656183 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ce84fa-1d27-4bd2-8f8d-809305248b9e admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:40.656462 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ce84fa-1d27-4bd2-8f8d-809305248b9e admin admin] PATH_INFO: `/v3/projects/bbadd882da994b30977abe5b6b5205fe/users/7ece85a776474c4ca8eb4905d8b15f62/roles/610824e4f50f4fb8954610e98c1de784` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:40.683719 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdf1d8e-ab4e-4655-849c-31445a02e48e admin admin] RBAC: Authorizing `identity:create_grant(project_id=87a8fa54fd2b489da5ada318bbcfe717, user_id=8b0342467f704f25a16d4e0b223fa6a2, role_id=610824e4f50f4fb8954610e98c1de784)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:40.687224 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdf1d8e-ab4e-4655-849c-31445a02e48e admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:40.701563 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ce84fa-1d27-4bd2-8f8d-809305248b9e admin admin] RBAC: Authorizing `identity:create_grant(project_id=bbadd882da994b30977abe5b6b5205fe, user_id=7ece85a776474c4ca8eb4905d8b15f62, role_id=610824e4f50f4fb8954610e98c1de784)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:40.717014 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 859/1718] 10.222.0.58 () {60 vars in 1482 bytes} [Tue Oct 12 16:49:40 2021] PUT /identity/v3/projects/87a8fa54fd2b489da5ada318bbcfe717/users/8b0342467f704f25a16d4e0b223fa6a2/roles/610824e4f50f4fb8954610e98c1de784 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:49:40.719194 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ce84fa-1d27-4bd2-8f8d-809305248b9e admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:40.722584 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdf1d8e-ab4e-4655-849c-31445a02e48e admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:40.769523 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 860/1719] 10.222.0.58 () {60 vars in 1482 bytes} [Tue Oct 12 16:49:40 2021] PUT /identity/v3/projects/bbadd882da994b30977abe5b6b5205fe/users/7ece85a776474c4ca8eb4905d8b15f62/roles/610824e4f50f4fb8954610e98c1de784 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:49:40.773361 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ce84fa-1d27-4bd2-8f8d-809305248b9e admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:40.901099 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdf1d8e-ab4e-4655-849c-31445a02e48e admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:40.926147 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ce84fa-1d27-4bd2-8f8d-809305248b9e admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:40.940341 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be454f8-695f-4e77-8ff3-9f8c19216f71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:40.941042 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be454f8-695f-4e77-8ff3-9f8c19216f71 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:40.941670 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be454f8-695f-4e77-8ff3-9f8c19216f71 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:40.941670 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be454f8-695f-4e77-8ff3-9f8c19216f71 admin admin] PATH_INFO: `/v3/roles` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:40.942529 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be454f8-695f-4e77-8ff3-9f8c19216f71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:40.944410 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be454f8-695f-4e77-8ff3-9f8c19216f71 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:40.967917 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 861/1720] 10.222.0.58 () {58 vars in 1121 bytes} [Tue Oct 12 16:49:40 2021] GET /identity/v3/roles => generated 1420 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 16:49:40.971814 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be454f8-695f-4e77-8ff3-9f8c19216f71 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:40.990875 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8f4c7a-a974-4c81-88a3-cae0a88cb698 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:40.993905 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8f4c7a-a974-4c81-88a3-cae0a88cb698 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:40.994831 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8f4c7a-a974-4c81-88a3-cae0a88cb698 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:40.996091 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8f4c7a-a974-4c81-88a3-cae0a88cb698 admin admin] PATH_INFO: `/v3/roles` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:40.996859 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be454f8-695f-4e77-8ff3-9f8c19216f71 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:40.997958 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8f4c7a-a974-4c81-88a3-cae0a88cb698 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:41.002248 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51951433-6a5f-42dc-ad1b-434335594458 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:41.002872 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8f4c7a-a974-4c81-88a3-cae0a88cb698 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:41.003148 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51951433-6a5f-42dc-ad1b-434335594458 admin admin] REQUEST_METHOD: `PUT` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:41.003558 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51951433-6a5f-42dc-ad1b-434335594458 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:41.003705 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51951433-6a5f-42dc-ad1b-434335594458 admin admin] PATH_INFO: `/v3/projects/bbadd882da994b30977abe5b6b5205fe/users/7ece85a776474c4ca8eb4905d8b15f62/roles/610824e4f50f4fb8954610e98c1de784` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:41.010966 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51951433-6a5f-42dc-ad1b-434335594458 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bbadd882da994b30977abe5b6b5205fe, user_id=7ece85a776474c4ca8eb4905d8b15f62, role_id=610824e4f50f4fb8954610e98c1de784)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:41.014056 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51951433-6a5f-42dc-ad1b-434335594458 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:41.026907 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 860/1721] 10.222.0.58 () {58 vars in 1121 bytes} [Tue Oct 12 16:49:40 2021] GET /identity/v3/roles => generated 1420 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:49:41.030730 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8f4c7a-a974-4c81-88a3-cae0a88cb698 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:41.043701 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8f4c7a-a974-4c81-88a3-cae0a88cb698 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:41.045517 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 862/1722] 10.222.0.58 () {60 vars in 1482 bytes} [Tue Oct 12 16:49:40 2021] PUT /identity/v3/projects/bbadd882da994b30977abe5b6b5205fe/users/7ece85a776474c4ca8eb4905d8b15f62/roles/610824e4f50f4fb8954610e98c1de784 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:49:41.155987 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fa13a9-c3f0-46fc-ad2f-9ed1b85df8d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:41.158792 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fa13a9-c3f0-46fc-ad2f-9ed1b85df8d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:41.159300 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fa13a9-c3f0-46fc-ad2f-9ed1b85df8d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:41.159866 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fa13a9-c3f0-46fc-ad2f-9ed1b85df8d3 admin admin] PATH_INFO: `/v3/projects/87a8fa54fd2b489da5ada318bbcfe717/users/8b0342467f704f25a16d4e0b223fa6a2/roles/610824e4f50f4fb8954610e98c1de784` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:41.167662 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fa13a9-c3f0-46fc-ad2f-9ed1b85df8d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=87a8fa54fd2b489da5ada318bbcfe717, user_id=8b0342467f704f25a16d4e0b223fa6a2, role_id=610824e4f50f4fb8954610e98c1de784)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:41.171101 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fa13a9-c3f0-46fc-ad2f-9ed1b85df8d3 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:41.185839 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 861/1723] 10.222.0.58 () {60 vars in 1482 bytes} [Tue Oct 12 16:49:41 2021] PUT /identity/v3/projects/87a8fa54fd2b489da5ada318bbcfe717/users/8b0342467f704f25a16d4e0b223fa6a2/roles/610824e4f50f4fb8954610e98c1de784 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 16:49:41.196834 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfab3ba-10df-4dd6-b071-9a84b79bcfbd None None] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:41.197355 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfab3ba-10df-4dd6-b071-9a84b79bcfbd None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:41.197632 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfab3ba-10df-4dd6-b071-9a84b79bcfbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:41.233102 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.auth.core [None req-1dfab3ba-10df-4dd6-b071-9a84b79bcfbd None None] MFA Rules not processed for user `8b0342467f704f25a16d4e0b223fa6a2`. Rule list: `[]` (Enabled: `True`). {{(pid=85205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:49:41.234484 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-1dfab3ba-10df-4dd6-b071-9a84b79bcfbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:49:41.324611 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 863/1724] 10.222.0.58 () {58 vars in 957 bytes} [Tue Oct 12 16:49:41 2021] POST /identity/v3/auth/tokens => generated 3454 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:49:41.339902 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fa13a9-c3f0-46fc-ad2f-9ed1b85df8d3 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:41.342336 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-f0fa13a9-c3f0-46fc-ad2f-9ed1b85df8d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:49:41.434645 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fa13a9-c3f0-46fc-ad2f-9ed1b85df8d3 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:41.439063 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf82cff4-9006-4fd1-8527-8370738d923e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04704222b3d64a33a6c092fc641ccbb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:41.439849 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf82cff4-9006-4fd1-8527-8370738d923e service cinder] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:41.443186 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf82cff4-9006-4fd1-8527-8370738d923e service cinder] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:41.443731 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf82cff4-9006-4fd1-8527-8370738d923e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:41.458738 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf82cff4-9006-4fd1-8527-8370738d923e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:41.460917 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf82cff4-9006-4fd1-8527-8370738d923e service cinder] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:41.474676 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 862/1725] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Oct 12 16:49:41 2021] GET /identity/v3/auth/tokens => generated 3454 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:49:41.519966 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfab3ba-10df-4dd6-b071-9a84b79bcfbd None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:41.521635 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-1dfab3ba-10df-4dd6-b071-9a84b79bcfbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:49:41.643340 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfab3ba-10df-4dd6-b071-9a84b79bcfbd None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:41.648512 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ffd670-9001-4ea3-9064-a7be6457dee1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:41.649707 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ffd670-9001-4ea3-9064-a7be6457dee1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:41.650043 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ffd670-9001-4ea3-9064-a7be6457dee1 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:41.650319 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ffd670-9001-4ea3-9064-a7be6457dee1 admin admin] PATH_INFO: `/v3/projects/6c362c2dbf97489fb14864b1216960ed` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:41.651633 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ffd670-9001-4ea3-9064-a7be6457dee1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c362c2dbf97489fb14864b1216960ed)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:41.653554 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ffd670-9001-4ea3-9064-a7be6457dee1 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:41.736311 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-15ffd670-9001-4ea3-9064-a7be6457dee1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c362c2dbf97489fb14864b1216960ed', 'request_id': 'req-15ffd670-9001-4ea3-9064-a7be6457dee1'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:41.762851 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-15ffd670-9001-4ea3-9064-a7be6457dee1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c362c2dbf97489fb14864b1216960ed', 'request_id': 'req-15ffd670-9001-4ea3-9064-a7be6457dee1'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:41.789845 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-15ffd670-9001-4ea3-9064-a7be6457dee1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c362c2dbf97489fb14864b1216960ed', 'request_id': 'req-15ffd670-9001-4ea3-9064-a7be6457dee1'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:41.816218 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-15ffd670-9001-4ea3-9064-a7be6457dee1 admin admin] The token cache is being invalidate because project 6c362c2dbf97489fb14864b1216960ed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=85205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 16:49:41.816421 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-15ffd670-9001-4ea3-9064-a7be6457dee1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:41.821654 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-15ffd670-9001-4ea3-9064-a7be6457dee1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:41.823543 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 864/1726] 10.222.0.58 () {58 vars in 1232 bytes} [Tue Oct 12 16:49:41 2021] DELETE /identity/v3/projects/6c362c2dbf97489fb14864b1216960ed => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:49:41.829635 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd73262-84a7-4514-b2f8-6c647c67e2fe None None] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:41.829952 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd73262-84a7-4514-b2f8-6c647c67e2fe None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:41.830234 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd73262-84a7-4514-b2f8-6c647c67e2fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:41.875615 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.auth.core [None req-ddd73262-84a7-4514-b2f8-6c647c67e2fe None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:49:41.877093 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-ddd73262-84a7-4514-b2f8-6c647c67e2fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:49:41.994018 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 863/1727] 10.222.0.58 () {58 vars in 957 bytes} [Tue Oct 12 16:49:41 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:49:42.063899 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9168ff1-b508-4e85-8aed-1a9b4904b92f None None] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:42.064164 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9168ff1-b508-4e85-8aed-1a9b4904b92f None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:42.064441 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9168ff1-b508-4e85-8aed-1a9b4904b92f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:42.100156 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.auth.core [None req-d9168ff1-b508-4e85-8aed-1a9b4904b92f None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:49:42.101409 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-d9168ff1-b508-4e85-8aed-1a9b4904b92f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:49:42.121372 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 865/1728] 10.222.0.58 () {58 vars in 957 bytes} [Tue Oct 12 16:49:42 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:49:42.125935 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd73262-84a7-4514-b2f8-6c647c67e2fe None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:42.137841 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd73262-84a7-4514-b2f8-6c647c67e2fe None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:42.155528 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161feb7a-c05b-474e-8ba3-db97b9b60cfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:42.156450 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161feb7a-c05b-474e-8ba3-db97b9b60cfe admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:42.157040 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161feb7a-c05b-474e-8ba3-db97b9b60cfe admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:42.157466 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161feb7a-c05b-474e-8ba3-db97b9b60cfe admin admin] PATH_INFO: `/v3/domains` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:42.158584 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161feb7a-c05b-474e-8ba3-db97b9b60cfe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:49:42.159112 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161feb7a-c05b-474e-8ba3-db97b9b60cfe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:42.161548 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161feb7a-c05b-474e-8ba3-db97b9b60cfe admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:42.184940 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 864/1729] 10.222.0.58 () {58 vars in 1152 bytes} [Tue Oct 12 16:49:42 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:49:42.189344 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9168ff1-b508-4e85-8aed-1a9b4904b92f None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:42.203517 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9168ff1-b508-4e85-8aed-1a9b4904b92f None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:42.217859 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab80e052-cef8-428e-ac6c-aeba33310d57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:42.218861 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab80e052-cef8-428e-ac6c-aeba33310d57 admin admin] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:42.219147 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab80e052-cef8-428e-ac6c-aeba33310d57 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:42.219423 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab80e052-cef8-428e-ac6c-aeba33310d57 admin admin] PATH_INFO: `/v3/projects` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:42.220133 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab80e052-cef8-428e-ac6c-aeba33310d57 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:42.222043 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab80e052-cef8-428e-ac6c-aeba33310d57 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:42.284505 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 866/1730] 10.222.0.58 () {60 vars in 1152 bytes} [Tue Oct 12 16:49:42 2021] POST /identity/v3/projects => generated 363 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:49:42.286103 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161feb7a-c05b-474e-8ba3-db97b9b60cfe admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:42.302692 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161feb7a-c05b-474e-8ba3-db97b9b60cfe admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:42.438095 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d5e28e-9c51-467e-b725-d3c712c283bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:42.439000 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d5e28e-9c51-467e-b725-d3c712c283bc admin admin] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:42.439432 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d5e28e-9c51-467e-b725-d3c712c283bc admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:42.440020 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d5e28e-9c51-467e-b725-d3c712c283bc admin admin] PATH_INFO: `/v3/users` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:42.440909 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d5e28e-9c51-467e-b725-d3c712c283bc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:42.443035 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d5e28e-9c51-467e-b725-d3c712c283bc admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:42.493108 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 865/1731] 10.222.0.58 () {60 vars in 1143 bytes} [Tue Oct 12 16:49:42 2021] POST /identity/v3/users => generated 282 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:49:42.497192 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab80e052-cef8-428e-ac6c-aeba33310d57 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:42.510720 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab80e052-cef8-428e-ac6c-aeba33310d57 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:42.526511 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da832c25-a5a7-4571-a288-4777ae0af250 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:42.527202 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da832c25-a5a7-4571-a288-4777ae0af250 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:42.527499 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da832c25-a5a7-4571-a288-4777ae0af250 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:42.527783 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da832c25-a5a7-4571-a288-4777ae0af250 admin admin] PATH_INFO: `/v3/roles` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:42.529401 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da832c25-a5a7-4571-a288-4777ae0af250 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:42.535426 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da832c25-a5a7-4571-a288-4777ae0af250 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:42.563897 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d5e28e-9c51-467e-b725-d3c712c283bc admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:42.571111 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 867/1732] 10.222.0.58 () {58 vars in 1121 bytes} [Tue Oct 12 16:49:42 2021] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 16:49:42.575675 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d5e28e-9c51-467e-b725-d3c712c283bc admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:42.580948 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9372556f-6437-4d58-a8cd-11883da40298 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:42.582101 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9372556f-6437-4d58-a8cd-11883da40298 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:42.582572 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9372556f-6437-4d58-a8cd-11883da40298 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:42.583134 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9372556f-6437-4d58-a8cd-11883da40298 admin admin] PATH_INFO: `/v3/roles` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:42.584068 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9372556f-6437-4d58-a8cd-11883da40298 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:42.587217 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9372556f-6437-4d58-a8cd-11883da40298 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:42.608390 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da832c25-a5a7-4571-a288-4777ae0af250 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:42.626452 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 866/1733] 10.222.0.58 () {58 vars in 1121 bytes} [Tue Oct 12 16:49:42 2021] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 16:49:42.626666 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da832c25-a5a7-4571-a288-4777ae0af250 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:42.636879 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62e8b23-65ed-457e-94d8-84ae9b0ba6f9 None None] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:42.638505 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62e8b23-65ed-457e-94d8-84ae9b0ba6f9 None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:42.638799 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62e8b23-65ed-457e-94d8-84ae9b0ba6f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:42.658593 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bc5b3a-3421-4848-97c1-7b09a73706e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:42.659571 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bc5b3a-3421-4848-97c1-7b09a73706e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:42.659878 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bc5b3a-3421-4848-97c1-7b09a73706e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:42.660068 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bc5b3a-3421-4848-97c1-7b09a73706e9 admin admin] PATH_INFO: `/v3/projects/148ca3d35f794b15a1b7f80973032ec0/users/e8ec33b6119449638f8a2702057122e4/roles/55ba49fe29884e64b57c3ad13188d554` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:42.718520 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.auth.core [None req-a62e8b23-65ed-457e-94d8-84ae9b0ba6f9 None None] MFA Rules not processed for user `69c3a35689e540b09d83fd072d5011b7`. Rule list: `[]` (Enabled: `True`). {{(pid=85204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:49:42.723844 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-a62e8b23-65ed-457e-94d8-84ae9b0ba6f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:49:42.732905 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bc5b3a-3421-4848-97c1-7b09a73706e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=148ca3d35f794b15a1b7f80973032ec0, user_id=e8ec33b6119449638f8a2702057122e4, role_id=55ba49fe29884e64b57c3ad13188d554)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:42.741164 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bc5b3a-3421-4848-97c1-7b09a73706e9 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:42.779572 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 868/1734] 10.222.0.58 () {60 vars in 1482 bytes} [Tue Oct 12 16:49:42 2021] PUT /identity/v3/projects/148ca3d35f794b15a1b7f80973032ec0/users/e8ec33b6119449638f8a2702057122e4/roles/55ba49fe29884e64b57c3ad13188d554 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:49:42.792047 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5774523f-a4a3-4afc-9cce-22c188f2cb12 None None] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:42.792610 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5774523f-a4a3-4afc-9cce-22c188f2cb12 None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:42.792963 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5774523f-a4a3-4afc-9cce-22c188f2cb12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:42.892075 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.auth.core [None req-5774523f-a4a3-4afc-9cce-22c188f2cb12 None None] MFA Rules not processed for user `e8ec33b6119449638f8a2702057122e4`. Rule list: `[]` (Enabled: `True`). {{(pid=85205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:49:42.894150 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-5774523f-a4a3-4afc-9cce-22c188f2cb12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:49:42.896744 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 867/1735] 10.222.0.58 () {58 vars in 957 bytes} [Tue Oct 12 16:49:42 2021] POST /identity/v3/auth/tokens => generated 3407 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:49:43.050893 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 869/1736] 10.222.0.58 () {58 vars in 957 bytes} [Tue Oct 12 16:49:42 2021] POST /identity/v3/auth/tokens => generated 3383 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:49:43.055235 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62e8b23-65ed-457e-94d8-84ae9b0ba6f9 None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:43.074917 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62e8b23-65ed-457e-94d8-84ae9b0ba6f9 None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:43.252947 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1c064c-f971-4e98-88bd-3e58c37a6342 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:43.253647 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1c064c-f971-4e98-88bd-3e58c37a6342 admin admin] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:43.254341 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1c064c-f971-4e98-88bd-3e58c37a6342 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:43.255107 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1c064c-f971-4e98-88bd-3e58c37a6342 admin admin] PATH_INFO: `/v3/projects` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:43.255343 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1c064c-f971-4e98-88bd-3e58c37a6342 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:43.257951 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1c064c-f971-4e98-88bd-3e58c37a6342 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:43.313651 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 868/1737] 10.222.0.58 () {60 vars in 1152 bytes} [Tue Oct 12 16:49:43 2021] POST /identity/v3/projects => generated 363 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:49:43.318187 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5774523f-a4a3-4afc-9cce-22c188f2cb12 None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:43.330555 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5774523f-a4a3-4afc-9cce-22c188f2cb12 None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:43.418337 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e401419f-f953-445a-80f1-016cc8be1e32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:43.419324 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e401419f-f953-445a-80f1-016cc8be1e32 admin admin] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:43.419684 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e401419f-f953-445a-80f1-016cc8be1e32 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:43.420035 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e401419f-f953-445a-80f1-016cc8be1e32 admin admin] PATH_INFO: `/v3/users` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:43.420940 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e401419f-f953-445a-80f1-016cc8be1e32 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:43.423140 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e401419f-f953-445a-80f1-016cc8be1e32 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:43.457751 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 870/1738] 10.222.0.58 () {60 vars in 1143 bytes} [Tue Oct 12 16:49:43 2021] POST /identity/v3/users => generated 288 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:49:43.461746 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1c064c-f971-4e98-88bd-3e58c37a6342 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:43.478786 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1c064c-f971-4e98-88bd-3e58c37a6342 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:43.489210 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93e9e48-09b7-42e6-a619-8b649e9af71f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:43.490233 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93e9e48-09b7-42e6-a619-8b649e9af71f admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:43.490756 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93e9e48-09b7-42e6-a619-8b649e9af71f admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:43.491032 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93e9e48-09b7-42e6-a619-8b649e9af71f admin admin] PATH_INFO: `/v3/roles` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:43.492324 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93e9e48-09b7-42e6-a619-8b649e9af71f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:43.493925 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93e9e48-09b7-42e6-a619-8b649e9af71f admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:43.517255 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 869/1739] 10.222.0.58 () {58 vars in 1121 bytes} [Tue Oct 12 16:49:43 2021] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:49:43.518704 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e401419f-f953-445a-80f1-016cc8be1e32 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:43.534699 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e401419f-f953-445a-80f1-016cc8be1e32 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:43.546239 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbaf9034-8b5f-47ae-b690-3b27de68cf20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:43.547157 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaf9034-8b5f-47ae-b690-3b27de68cf20 admin admin] REQUEST_METHOD: `PUT` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:43.547743 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaf9034-8b5f-47ae-b690-3b27de68cf20 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:43.548033 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaf9034-8b5f-47ae-b690-3b27de68cf20 admin admin] PATH_INFO: `/v3/projects/3815383fd3ea4a6a8b84361e379d7414/users/c98386bcd4324cc1a251c68040865493/roles/610824e4f50f4fb8954610e98c1de784` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:43.580862 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbaf9034-8b5f-47ae-b690-3b27de68cf20 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3815383fd3ea4a6a8b84361e379d7414, user_id=c98386bcd4324cc1a251c68040865493, role_id=610824e4f50f4fb8954610e98c1de784)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:43.592684 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbaf9034-8b5f-47ae-b690-3b27de68cf20 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:43.617399 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 871/1740] 10.222.0.58 () {60 vars in 1482 bytes} [Tue Oct 12 16:49:43 2021] PUT /identity/v3/projects/3815383fd3ea4a6a8b84361e379d7414/users/c98386bcd4324cc1a251c68040865493/roles/610824e4f50f4fb8954610e98c1de784 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:49:43.621746 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93e9e48-09b7-42e6-a619-8b649e9af71f admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:43.638024 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4baef6-5658-4c83-a038-5894091a56fb None None] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:43.638542 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4baef6-5658-4c83-a038-5894091a56fb None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:43.638958 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4baef6-5658-4c83-a038-5894091a56fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:43.641718 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93e9e48-09b7-42e6-a619-8b649e9af71f admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:43.682594 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.auth.core [None req-de4baef6-5658-4c83-a038-5894091a56fb None None] MFA Rules not processed for user `ec884ca51e9243c6a660dd494d49d17b`. Rule list: `[]` (Enabled: `True`). {{(pid=85205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:49:43.684075 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-de4baef6-5658-4c83-a038-5894091a56fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:49:43.752794 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb10c2a-87e8-475d-aacd-d77ca6371f0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:43.755071 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb10c2a-87e8-475d-aacd-d77ca6371f0c admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:43.756209 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb10c2a-87e8-475d-aacd-d77ca6371f0c admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:43.757238 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb10c2a-87e8-475d-aacd-d77ca6371f0c admin admin] PATH_INFO: `/v3/roles` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:43.760753 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb10c2a-87e8-475d-aacd-d77ca6371f0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:43.764680 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb10c2a-87e8-475d-aacd-d77ca6371f0c admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:43.790964 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 870/1741] 10.222.0.58 () {58 vars in 1121 bytes} [Tue Oct 12 16:49:43 2021] GET /identity/v3/roles => generated 1420 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 16:49:43.790964 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac67536f-175e-4772-836f-c51728571c0b None None] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:43.790964 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac67536f-175e-4772-836f-c51728571c0b None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:43.792615 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac67536f-175e-4772-836f-c51728571c0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:43.799575 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 872/1742] 10.222.0.58 () {58 vars in 957 bytes} [Tue Oct 12 16:49:43 2021] POST /identity/v3/auth/tokens => generated 3391 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:49:43.800617 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4baef6-5658-4c83-a038-5894091a56fb None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:43.821060 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4baef6-5658-4c83-a038-5894091a56fb None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:43.823818 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.auth.core [None req-ac67536f-175e-4772-836f-c51728571c0b None None] MFA Rules not processed for user `aef11be7bb50427fb18d1ff2d29e9fac`. Rule list: `[]` (Enabled: `True`). {{(pid=85204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:49:43.825582 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-ac67536f-175e-4772-836f-c51728571c0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:49:43.826690 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9cdfd4-a8f4-4ede-a12c-a55e2b17ab06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:43.827814 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9cdfd4-a8f4-4ede-a12c-a55e2b17ab06 admin admin] REQUEST_METHOD: `PUT` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:43.828290 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9cdfd4-a8f4-4ede-a12c-a55e2b17ab06 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:43.828755 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9cdfd4-a8f4-4ede-a12c-a55e2b17ab06 admin admin] PATH_INFO: `/v3/projects/3815383fd3ea4a6a8b84361e379d7414/users/c98386bcd4324cc1a251c68040865493/roles/610824e4f50f4fb8954610e98c1de784` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:43.831032 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9cdfd4-a8f4-4ede-a12c-a55e2b17ab06 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3815383fd3ea4a6a8b84361e379d7414, user_id=c98386bcd4324cc1a251c68040865493, role_id=610824e4f50f4fb8954610e98c1de784)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:43.834094 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9cdfd4-a8f4-4ede-a12c-a55e2b17ab06 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:43.844944 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 873/1743] 10.222.0.58 () {60 vars in 1482 bytes} [Tue Oct 12 16:49:43 2021] PUT /identity/v3/projects/3815383fd3ea4a6a8b84361e379d7414/users/c98386bcd4324cc1a251c68040865493/roles/610824e4f50f4fb8954610e98c1de784 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:49:43.846067 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9cdfd4-a8f4-4ede-a12c-a55e2b17ab06 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:43.847855 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-3b9cdfd4-a8f4-4ede-a12c-a55e2b17ab06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:49:43.953244 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9cdfd4-a8f4-4ede-a12c-a55e2b17ab06 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:43.959369 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c12dc9-7c78-457a-b31c-67ee34c3116a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:43.961694 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c12dc9-7c78-457a-b31c-67ee34c3116a admin admin] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:43.962433 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c12dc9-7c78-457a-b31c-67ee34c3116a admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:43.962731 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c12dc9-7c78-457a-b31c-67ee34c3116a admin admin] PATH_INFO: `/v3/projects` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:43.964078 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c12dc9-7c78-457a-b31c-67ee34c3116a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:43.968176 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c12dc9-7c78-457a-b31c-67ee34c3116a admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:43.976698 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 871/1744] 10.222.0.58 () {58 vars in 957 bytes} [Tue Oct 12 16:49:43 2021] POST /identity/v3/auth/tokens => generated 3397 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:49:43.976698 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9838efdc-bed6-4006-b398-25290f0bdbb9 None None] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:43.976698 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9838efdc-bed6-4006-b398-25290f0bdbb9 None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:43.976698 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9838efdc-bed6-4006-b398-25290f0bdbb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:44.038289 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 874/1745] 10.222.0.58 () {60 vars in 1152 bytes} [Tue Oct 12 16:49:43 2021] POST /identity/v3/projects => generated 373 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:49:44.039294 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.auth.core [None req-9838efdc-bed6-4006-b398-25290f0bdbb9 None None] MFA Rules not processed for user `c98386bcd4324cc1a251c68040865493`. Rule list: `[]` (Enabled: `True`). {{(pid=85204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:49:44.040343 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c12dc9-7c78-457a-b31c-67ee34c3116a admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:44.040768 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-9838efdc-bed6-4006-b398-25290f0bdbb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:49:44.043317 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-28c12dc9-7c78-457a-b31c-67ee34c3116a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:49:44.115398 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c12dc9-7c78-457a-b31c-67ee34c3116a admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:44.123225 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185f370e-2c85-4872-83e1-b9aee65a40d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:44.124576 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185f370e-2c85-4872-83e1-b9aee65a40d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:44.124871 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185f370e-2c85-4872-83e1-b9aee65a40d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:44.125152 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185f370e-2c85-4872-83e1-b9aee65a40d3 admin admin] PATH_INFO: `/v3/users/c13d9c04de8848d7b4546bbe9a457e3a` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:44.126663 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185f370e-2c85-4872-83e1-b9aee65a40d3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c13d9c04de8848d7b4546bbe9a457e3a)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:44.129164 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185f370e-2c85-4872-83e1-b9aee65a40d3 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:44.136860 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 872/1746] 10.222.0.58 () {58 vars in 957 bytes} [Tue Oct 12 16:49:43 2021] POST /identity/v3/auth/tokens => generated 3450 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:49:44.138676 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9838efdc-bed6-4006-b398-25290f0bdbb9 None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:44.153550 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9838efdc-bed6-4006-b398-25290f0bdbb9 None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:44.160760 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14acf995-e1cc-482c-b0fd-011e386cc954 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:44.161766 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14acf995-e1cc-482c-b0fd-011e386cc954 admin admin] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:44.162444 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14acf995-e1cc-482c-b0fd-011e386cc954 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:44.164385 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14acf995-e1cc-482c-b0fd-011e386cc954 admin admin] PATH_INFO: `/v3/users` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:44.165404 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14acf995-e1cc-482c-b0fd-011e386cc954 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:44.167582 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14acf995-e1cc-482c-b0fd-011e386cc954 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:44.195348 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 873/1747] 10.222.0.58 () {60 vars in 1143 bytes} [Tue Oct 12 16:49:44 2021] POST /identity/v3/users => generated 293 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:49:44.196346 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14acf995-e1cc-482c-b0fd-011e386cc954 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:44.199254 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-14acf995-e1cc-482c-b0fd-011e386cc954 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:49:44.204183 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-185f370e-2c85-4872-83e1-b9aee65a40d3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c13d9c04de8848d7b4546bbe9a457e3a'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:44.219456 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-185f370e-2c85-4872-83e1-b9aee65a40d3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c13d9c04de8848d7b4546bbe9a457e3a'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:44.231513 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-185f370e-2c85-4872-83e1-b9aee65a40d3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c13d9c04de8848d7b4546bbe9a457e3a'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:44.243395 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-185f370e-2c85-4872-83e1-b9aee65a40d3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c13d9c04de8848d7b4546bbe9a457e3a'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:44.245307 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-185f370e-2c85-4872-83e1-b9aee65a40d3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c13d9c04de8848d7b4546bbe9a457e3a'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:44.257542 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 875/1748] 10.222.0.58 () {58 vars in 1223 bytes} [Tue Oct 12 16:49:44 2021] DELETE /identity/v3/users/c13d9c04de8848d7b4546bbe9a457e3a => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:49:44.260021 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dc5882-614e-407b-98d0-c2ec96decce2 None None] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:44.260633 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dc5882-614e-407b-98d0-c2ec96decce2 None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:44.261087 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dc5882-614e-407b-98d0-c2ec96decce2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:44.275116 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14acf995-e1cc-482c-b0fd-011e386cc954 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:44.306471 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.auth.core [None req-06dc5882-614e-407b-98d0-c2ec96decce2 None None] MFA Rules not processed for user `7ece85a776474c4ca8eb4905d8b15f62`. Rule list: `[]` (Enabled: `True`). {{(pid=85205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:49:44.308242 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-06dc5882-614e-407b-98d0-c2ec96decce2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:49:44.354715 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c491b29-6af5-4dfe-86f5-15ea835455f3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04704222b3d64a33a6c092fc641ccbb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:44.356158 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c491b29-6af5-4dfe-86f5-15ea835455f3 service cinder] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:44.356605 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c491b29-6af5-4dfe-86f5-15ea835455f3 service cinder] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:44.357033 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c491b29-6af5-4dfe-86f5-15ea835455f3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:44.359715 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-9c491b29-6af5-4dfe-86f5-15ea835455f3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:49:44.396305 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 876/1749] 10.222.0.58 () {58 vars in 957 bytes} [Tue Oct 12 16:49:44 2021] POST /identity/v3/auth/tokens => generated 3492 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:49:44.397184 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dc5882-614e-407b-98d0-c2ec96decce2 None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:44.399399 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-06dc5882-614e-407b-98d0-c2ec96decce2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:49:44.446783 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c491b29-6af5-4dfe-86f5-15ea835455f3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:44.448480 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c491b29-6af5-4dfe-86f5-15ea835455f3 service cinder] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:44.461250 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 874/1750] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Oct 12 16:49:44 2021] GET /identity/v3/auth/tokens => generated 3450 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:49:44.462772 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8c580d-c3ed-481f-b842-63d775e5001f None None] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:44.463266 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8c580d-c3ed-481f-b842-63d775e5001f None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:44.463648 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8c580d-c3ed-481f-b842-63d775e5001f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:44.479321 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dc5882-614e-407b-98d0-c2ec96decce2 None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:44.484570 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873a2a1e-3ed9-4c57-bc96-36466510e754 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:44.485427 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873a2a1e-3ed9-4c57-bc96-36466510e754 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:44.485852 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873a2a1e-3ed9-4c57-bc96-36466510e754 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:44.486319 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873a2a1e-3ed9-4c57-bc96-36466510e754 admin admin] PATH_INFO: `/v3/roles` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:44.487105 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.auth.core [None req-6e8c580d-c3ed-481f-b842-63d775e5001f None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:49:44.487382 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873a2a1e-3ed9-4c57-bc96-36466510e754 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:44.488692 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-6e8c580d-c3ed-481f-b842-63d775e5001f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:49:44.489328 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873a2a1e-3ed9-4c57-bc96-36466510e754 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:44.500106 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 875/1751] 10.222.0.58 () {58 vars in 957 bytes} [Tue Oct 12 16:49:44 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:49:44.502125 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 877/1752] 10.222.0.58 () {58 vars in 1121 bytes} [Tue Oct 12 16:49:44 2021] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:49:44.514358 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8c580d-c3ed-481f-b842-63d775e5001f None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:44.541172 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873a2a1e-3ed9-4c57-bc96-36466510e754 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:44.544150 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-873a2a1e-3ed9-4c57-bc96-36466510e754 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:49:44.553522 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8c580d-c3ed-481f-b842-63d775e5001f None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:44.574960 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0f6b29-8c8b-4507-98ac-c71c53c1babe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:44.578858 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0f6b29-8c8b-4507-98ac-c71c53c1babe admin admin] REQUEST_METHOD: `PUT` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:44.581304 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0f6b29-8c8b-4507-98ac-c71c53c1babe admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:44.581837 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0f6b29-8c8b-4507-98ac-c71c53c1babe admin admin] PATH_INFO: `/v3/projects/10ffc3749dea4c4bb03f685b13e04077/users/dc2c7c95c0c24f05834490aa8a47870a/roles/610824e4f50f4fb8954610e98c1de784` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:44.616933 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873a2a1e-3ed9-4c57-bc96-36466510e754 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:44.621355 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06e432a-d7ac-42b9-b2b8-49470d080081 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e65f6d0598e4c539134292b86fb43d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:44.622284 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06e432a-d7ac-42b9-b2b8-49470d080081 service neutron] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:44.622640 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06e432a-d7ac-42b9-b2b8-49470d080081 service neutron] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:44.623004 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0f6b29-8c8b-4507-98ac-c71c53c1babe admin admin] RBAC: Authorizing `identity:create_grant(project_id=10ffc3749dea4c4bb03f685b13e04077, user_id=dc2c7c95c0c24f05834490aa8a47870a, role_id=610824e4f50f4fb8954610e98c1de784)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:44.623691 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06e432a-d7ac-42b9-b2b8-49470d080081 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:44.632087 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0f6b29-8c8b-4507-98ac-c71c53c1babe admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:44.635002 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06e432a-d7ac-42b9-b2b8-49470d080081 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:44.636538 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06e432a-d7ac-42b9-b2b8-49470d080081 service neutron] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:44.650378 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 878/1753] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Oct 12 16:49:44 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 12 16:49:44.651636 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06e432a-d7ac-42b9-b2b8-49470d080081 service neutron] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:44.653611 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-f06e432a-d7ac-42b9-b2b8-49470d080081 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:49:44.663536 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 876/1754] 10.222.0.58 () {60 vars in 1482 bytes} [Tue Oct 12 16:49:44 2021] PUT /identity/v3/projects/10ffc3749dea4c4bb03f685b13e04077/users/dc2c7c95c0c24f05834490aa8a47870a/roles/610824e4f50f4fb8954610e98c1de784 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:49:44.667814 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0f6b29-8c8b-4507-98ac-c71c53c1babe admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:44.670903 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06e432a-d7ac-42b9-b2b8-49470d080081 service neutron] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:44.801256 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d28e0d8-cd9f-4d41-9952-69cbe65f4760 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04704222b3d64a33a6c092fc641ccbb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:44.803100 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d28e0d8-cd9f-4d41-9952-69cbe65f4760 service cinder] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:44.803386 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d28e0d8-cd9f-4d41-9952-69cbe65f4760 service cinder] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:44.803658 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d28e0d8-cd9f-4d41-9952-69cbe65f4760 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:44.809800 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-8d28e0d8-cd9f-4d41-9952-69cbe65f4760 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:49:44.824649 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0f6b29-8c8b-4507-98ac-c71c53c1babe admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:44.832943 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11440d82-f47e-4d02-a9ea-5c0b0552345a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:44.834076 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11440d82-f47e-4d02-a9ea-5c0b0552345a admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:44.834765 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11440d82-f47e-4d02-a9ea-5c0b0552345a admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:44.835257 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11440d82-f47e-4d02-a9ea-5c0b0552345a admin admin] PATH_INFO: `/v3/roles` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:44.836511 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11440d82-f47e-4d02-a9ea-5c0b0552345a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:44.838403 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11440d82-f47e-4d02-a9ea-5c0b0552345a admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:44.852772 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 877/1755] 10.222.0.58 () {58 vars in 1121 bytes} [Tue Oct 12 16:49:44 2021] GET /identity/v3/roles => generated 1420 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 16:49:44.857064 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11440d82-f47e-4d02-a9ea-5c0b0552345a admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:44.873071 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11440d82-f47e-4d02-a9ea-5c0b0552345a admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:44.883137 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7071f1-d6e7-420a-a305-ee2909cb9b21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:44.884502 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7071f1-d6e7-420a-a305-ee2909cb9b21 admin admin] REQUEST_METHOD: `PUT` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:44.885024 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7071f1-d6e7-420a-a305-ee2909cb9b21 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:44.885313 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d28e0d8-cd9f-4d41-9952-69cbe65f4760 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:44.885664 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7071f1-d6e7-420a-a305-ee2909cb9b21 admin admin] PATH_INFO: `/v3/projects/10ffc3749dea4c4bb03f685b13e04077/users/dc2c7c95c0c24f05834490aa8a47870a/roles/610824e4f50f4fb8954610e98c1de784` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:44.887313 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d28e0d8-cd9f-4d41-9952-69cbe65f4760 service cinder] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:44.888294 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7071f1-d6e7-420a-a305-ee2909cb9b21 admin admin] RBAC: Authorizing `identity:create_grant(project_id=10ffc3749dea4c4bb03f685b13e04077, user_id=dc2c7c95c0c24f05834490aa8a47870a, role_id=610824e4f50f4fb8954610e98c1de784)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:44.892476 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7071f1-d6e7-420a-a305-ee2909cb9b21 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:44.905572 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 878/1756] 10.222.0.58 () {60 vars in 1482 bytes} [Tue Oct 12 16:49:44 2021] PUT /identity/v3/projects/10ffc3749dea4c4bb03f685b13e04077/users/dc2c7c95c0c24f05834490aa8a47870a/roles/610824e4f50f4fb8954610e98c1de784 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:49:44.907961 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 879/1757] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Oct 12 16:49:44 2021] GET /identity/v3/auth/tokens => generated 3383 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:49:45.761618 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d83b9e8-9826-4e72-8573-dbfa0229995e None None] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:45.762165 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d83b9e8-9826-4e72-8573-dbfa0229995e None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:45.762261 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d83b9e8-9826-4e72-8573-dbfa0229995e None None] PATH_INFO: `/` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:45.764164 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 879/1758] 10.222.0.58 () {54 vars in 921 bytes} [Tue Oct 12 16:49:45 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:49:45.820584 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de359ef1-b68c-49cc-9cfc-a06929285b5a None None] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:45.821768 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de359ef1-b68c-49cc-9cfc-a06929285b5a None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:45.822219 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de359ef1-b68c-49cc-9cfc-a06929285b5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:45.856869 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.auth.core [None req-de359ef1-b68c-49cc-9cfc-a06929285b5a None None] MFA Rules not processed for user `29d30b574eec4ad3990d77d235c8b424`. Rule list: `[]` (Enabled: `True`). {{(pid=85205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:49:45.863489 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-de359ef1-b68c-49cc-9cfc-a06929285b5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:49:46.016171 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 880/1759] 10.222.0.58 () {58 vars in 1018 bytes} [Tue Oct 12 16:49:45 2021] POST /identity/v3/auth/tokens => generated 3515 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:49:46.154081 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d83b9e8-9826-4e72-8573-dbfa0229995e None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:46.158026 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-4d83b9e8-9826-4e72-8573-dbfa0229995e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:49:46.187968 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d83b9e8-9826-4e72-8573-dbfa0229995e None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:46.198975 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e8d9ba-074c-4f60-b8b4-190dfa7bf991 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29d30b574eec4ad3990d77d235c8b424', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:46.200183 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e8d9ba-074c-4f60-b8b4-190dfa7bf991 service nova] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:46.200632 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e8d9ba-074c-4f60-b8b4-190dfa7bf991 service nova] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:46.201974 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e8d9ba-074c-4f60-b8b4-190dfa7bf991 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:46.224940 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e8d9ba-074c-4f60-b8b4-190dfa7bf991 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:46.227600 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e8d9ba-074c-4f60-b8b4-190dfa7bf991 service nova] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:46.261623 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 880/1760] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Oct 12 16:49:46 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:49:46.315210 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1d3073-3d8c-405f-ad44-412698f8d4d5 None None] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:46.315589 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1d3073-3d8c-405f-ad44-412698f8d4d5 None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:46.315873 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1d3073-3d8c-405f-ad44-412698f8d4d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:46.367516 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.auth.core [None req-8f1d3073-3d8c-405f-ad44-412698f8d4d5 None None] MFA Rules not processed for user `dc2c7c95c0c24f05834490aa8a47870a`. Rule list: `[]` (Enabled: `True`). {{(pid=85205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:49:46.369633 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-8f1d3073-3d8c-405f-ad44-412698f8d4d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:49:46.544912 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 881/1761] 10.222.0.58 () {58 vars in 957 bytes} [Tue Oct 12 16:49:46 2021] POST /identity/v3/auth/tokens => generated 3460 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:49:46.566110 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e8d9ba-074c-4f60-b8b4-190dfa7bf991 service nova] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:46.681089 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e8d9ba-074c-4f60-b8b4-190dfa7bf991 service nova] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:46.691308 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8e9b8a-3e97-4e65-8e13-b783bc3353ac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04704222b3d64a33a6c092fc641ccbb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:46.692349 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8e9b8a-3e97-4e65-8e13-b783bc3353ac service cinder] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:46.692615 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8e9b8a-3e97-4e65-8e13-b783bc3353ac service cinder] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:46.693165 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8e9b8a-3e97-4e65-8e13-b783bc3353ac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:46.696432 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-1b8e9b8a-3e97-4e65-8e13-b783bc3353ac service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:49:46.853350 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8e9b8a-3e97-4e65-8e13-b783bc3353ac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:46.854895 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8e9b8a-3e97-4e65-8e13-b783bc3353ac service cinder] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:46.882130 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 881/1762] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Oct 12 16:49:46 2021] GET /identity/v3/auth/tokens => generated 3391 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:49:46.938174 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1d3073-3d8c-405f-ad44-412698f8d4d5 None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:46.939808 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-8f1d3073-3d8c-405f-ad44-412698f8d4d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:49:47.107122 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1d3073-3d8c-405f-ad44-412698f8d4d5 None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:47.119692 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ce5c75-081c-45d8-acf5-58947f05bdd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:47.120188 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ce5c75-081c-45d8-acf5-58947f05bdd1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:47.120473 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ce5c75-081c-45d8-acf5-58947f05bdd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:47.120817 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ce5c75-081c-45d8-acf5-58947f05bdd1 admin admin] PATH_INFO: `/v3/projects/836bd645d8794f779b7ab9db47de0476` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:47.122195 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ce5c75-081c-45d8-acf5-58947f05bdd1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=836bd645d8794f779b7ab9db47de0476)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:47.124336 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ce5c75-081c-45d8-acf5-58947f05bdd1 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:47.226885 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-f8ce5c75-081c-45d8-acf5-58947f05bdd1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '836bd645d8794f779b7ab9db47de0476', 'request_id': 'req-f8ce5c75-081c-45d8-acf5-58947f05bdd1'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:47.235124 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-f8ce5c75-081c-45d8-acf5-58947f05bdd1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '836bd645d8794f779b7ab9db47de0476', 'request_id': 'req-f8ce5c75-081c-45d8-acf5-58947f05bdd1'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:47.245252 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-f8ce5c75-081c-45d8-acf5-58947f05bdd1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '836bd645d8794f779b7ab9db47de0476', 'request_id': 'req-f8ce5c75-081c-45d8-acf5-58947f05bdd1'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:47.271388 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-f8ce5c75-081c-45d8-acf5-58947f05bdd1 admin admin] The token cache is being invalidate because project 836bd645d8794f779b7ab9db47de0476 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=85205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 16:49:47.272072 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-f8ce5c75-081c-45d8-acf5-58947f05bdd1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:47.274424 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-f8ce5c75-081c-45d8-acf5-58947f05bdd1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:47.277552 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 882/1763] 10.222.0.58 () {58 vars in 1232 bytes} [Tue Oct 12 16:49:46 2021] DELETE /identity/v3/projects/836bd645d8794f779b7ab9db47de0476 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:49:47.281923 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8e9b8a-3e97-4e65-8e13-b783bc3353ac service cinder] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:47.298915 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8e9b8a-3e97-4e65-8e13-b783bc3353ac service cinder] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:47.375345 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5461c51f-49e3-4d0c-b6b3-2ed5f61bd302 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:47.376308 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5461c51f-49e3-4d0c-b6b3-2ed5f61bd302 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:47.376596 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5461c51f-49e3-4d0c-b6b3-2ed5f61bd302 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:47.376988 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5461c51f-49e3-4d0c-b6b3-2ed5f61bd302 admin admin] PATH_INFO: `/v3/users/8b0342467f704f25a16d4e0b223fa6a2` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:47.378197 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5461c51f-49e3-4d0c-b6b3-2ed5f61bd302 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b0342467f704f25a16d4e0b223fa6a2)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:47.380113 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5461c51f-49e3-4d0c-b6b3-2ed5f61bd302 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:47.437702 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-5461c51f-49e3-4d0c-b6b3-2ed5f61bd302 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b0342467f704f25a16d4e0b223fa6a2'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:47.509328 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-5461c51f-49e3-4d0c-b6b3-2ed5f61bd302 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b0342467f704f25a16d4e0b223fa6a2'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:47.528133 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-5461c51f-49e3-4d0c-b6b3-2ed5f61bd302 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b0342467f704f25a16d4e0b223fa6a2'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:47.538143 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-5461c51f-49e3-4d0c-b6b3-2ed5f61bd302 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b0342467f704f25a16d4e0b223fa6a2'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:47.539392 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-5461c51f-49e3-4d0c-b6b3-2ed5f61bd302 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b0342467f704f25a16d4e0b223fa6a2'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:47.552025 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 882/1764] 10.222.0.58 () {58 vars in 1223 bytes} [Tue Oct 12 16:49:47 2021] DELETE /identity/v3/users/8b0342467f704f25a16d4e0b223fa6a2 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 16:49:47.690154 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c60f07-767b-42e9-aa1b-d26d61c6c5e0 None None] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:47.690444 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c60f07-767b-42e9-aa1b-d26d61c6c5e0 None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:47.690820 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c60f07-767b-42e9-aa1b-d26d61c6c5e0 None None] PATH_INFO: `/` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:47.692734 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 883/1765] 10.222.0.58 () {54 vars in 921 bytes} [Tue Oct 12 16:49:47 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:49:47.704959 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce64e2f-4939-4134-a539-af5260cf7b2f None None] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:47.705238 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce64e2f-4939-4134-a539-af5260cf7b2f None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:47.705516 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce64e2f-4939-4134-a539-af5260cf7b2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:47.756760 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.auth.core [None req-dce64e2f-4939-4134-a539-af5260cf7b2f None None] MFA Rules not processed for user `29d30b574eec4ad3990d77d235c8b424`. Rule list: `[]` (Enabled: `True`). {{(pid=85204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:49:47.759898 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-dce64e2f-4939-4134-a539-af5260cf7b2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:49:47.905778 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 883/1766] 10.222.0.58 () {58 vars in 1018 bytes} [Tue Oct 12 16:49:47 2021] POST /identity/v3/auth/tokens => generated 3515 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:49:48.033577 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c60f07-767b-42e9-aa1b-d26d61c6c5e0 None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:48.035510 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-f8c60f07-767b-42e9-aa1b-d26d61c6c5e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:49:48.065720 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c60f07-767b-42e9-aa1b-d26d61c6c5e0 None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:48.085104 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d29fc05-b699-4bd9-9c7f-fc7bf79b1656 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29d30b574eec4ad3990d77d235c8b424', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:48.086508 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d29fc05-b699-4bd9-9c7f-fc7bf79b1656 service nova] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:48.087045 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d29fc05-b699-4bd9-9c7f-fc7bf79b1656 service nova] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:48.087527 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d29fc05-b699-4bd9-9c7f-fc7bf79b1656 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:48.101997 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d29fc05-b699-4bd9-9c7f-fc7bf79b1656 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:48.104187 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d29fc05-b699-4bd9-9c7f-fc7bf79b1656 service nova] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:48.135862 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 884/1767] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Oct 12 16:49:48 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:49:48.273724 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce64e2f-4939-4134-a539-af5260cf7b2f None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:48.275353 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-dce64e2f-4939-4134-a539-af5260cf7b2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:49:48.433606 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce64e2f-4939-4134-a539-af5260cf7b2f None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:48.439495 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9853a7a2-d97d-4b8d-a21b-b1c8d2d05457 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:48.442075 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9853a7a2-d97d-4b8d-a21b-b1c8d2d05457 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:48.442685 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9853a7a2-d97d-4b8d-a21b-b1c8d2d05457 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:48.443109 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9853a7a2-d97d-4b8d-a21b-b1c8d2d05457 admin admin] PATH_INFO: `/v3/users/a2a325b7887344d7aba7ef3e6fe624c9` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:48.444732 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9853a7a2-d97d-4b8d-a21b-b1c8d2d05457 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a2a325b7887344d7aba7ef3e6fe624c9)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:48.451647 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9853a7a2-d97d-4b8d-a21b-b1c8d2d05457 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:48.491495 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d29fc05-b699-4bd9-9c7f-fc7bf79b1656 service nova] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:48.493780 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-8d29fc05-b699-4bd9-9c7f-fc7bf79b1656 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:49:48.576850 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-9853a7a2-d97d-4b8d-a21b-b1c8d2d05457 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a2a325b7887344d7aba7ef3e6fe624c9'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:48.578457 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d29fc05-b699-4bd9-9c7f-fc7bf79b1656 service nova] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:48.587931 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b011473a-083c-4332-896f-a01f205dbd4c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04704222b3d64a33a6c092fc641ccbb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:48.590383 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b011473a-083c-4332-896f-a01f205dbd4c service cinder] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:48.590780 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b011473a-083c-4332-896f-a01f205dbd4c service cinder] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:48.591314 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b011473a-083c-4332-896f-a01f205dbd4c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:48.595139 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-b011473a-083c-4332-896f-a01f205dbd4c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:49:48.599265 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-9853a7a2-d97d-4b8d-a21b-b1c8d2d05457 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a2a325b7887344d7aba7ef3e6fe624c9'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:48.609342 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-9853a7a2-d97d-4b8d-a21b-b1c8d2d05457 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a2a325b7887344d7aba7ef3e6fe624c9'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:48.621349 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-9853a7a2-d97d-4b8d-a21b-b1c8d2d05457 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a2a325b7887344d7aba7ef3e6fe624c9'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:48.622360 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-9853a7a2-d97d-4b8d-a21b-b1c8d2d05457 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a2a325b7887344d7aba7ef3e6fe624c9'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:48.632230 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 884/1768] 10.222.0.58 () {58 vars in 1223 bytes} [Tue Oct 12 16:49:48 2021] DELETE /identity/v3/users/a2a325b7887344d7aba7ef3e6fe624c9 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:49:48.634585 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9853a7a2-d97d-4b8d-a21b-b1c8d2d05457 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:48.636606 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-9853a7a2-d97d-4b8d-a21b-b1c8d2d05457 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:49:48.671404 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b011473a-083c-4332-896f-a01f205dbd4c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:48.673848 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b011473a-083c-4332-896f-a01f205dbd4c service cinder] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:48.686918 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 885/1769] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Oct 12 16:49:48 2021] GET /identity/v3/auth/tokens => generated 3460 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 12 16:49:48.743206 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9853a7a2-d97d-4b8d-a21b-b1c8d2d05457 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:48.748500 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34ea32e-6ea1-4cb8-a33e-cb8b6b160a02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:48.749385 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34ea32e-6ea1-4cb8-a33e-cb8b6b160a02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:48.749665 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34ea32e-6ea1-4cb8-a33e-cb8b6b160a02 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:48.750114 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34ea32e-6ea1-4cb8-a33e-cb8b6b160a02 admin admin] PATH_INFO: `/v3/users/e8ec33b6119449638f8a2702057122e4` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:48.751957 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34ea32e-6ea1-4cb8-a33e-cb8b6b160a02 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e8ec33b6119449638f8a2702057122e4)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:48.754082 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34ea32e-6ea1-4cb8-a33e-cb8b6b160a02 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:48.879858 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-c34ea32e-6ea1-4cb8-a33e-cb8b6b160a02 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e8ec33b6119449638f8a2702057122e4'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:48.902716 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-c34ea32e-6ea1-4cb8-a33e-cb8b6b160a02 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e8ec33b6119449638f8a2702057122e4'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:48.915491 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-c34ea32e-6ea1-4cb8-a33e-cb8b6b160a02 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e8ec33b6119449638f8a2702057122e4'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:48.931363 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-c34ea32e-6ea1-4cb8-a33e-cb8b6b160a02 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e8ec33b6119449638f8a2702057122e4'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:48.935027 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-c34ea32e-6ea1-4cb8-a33e-cb8b6b160a02 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e8ec33b6119449638f8a2702057122e4'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:48.949076 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 885/1770] 10.222.0.58 () {58 vars in 1223 bytes} [Tue Oct 12 16:49:48 2021] DELETE /identity/v3/users/e8ec33b6119449638f8a2702057122e4 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:49:48.954161 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc4ae05-15de-4266-b445-4dd574af000a None None] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:48.954810 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc4ae05-15de-4266-b445-4dd574af000a None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:48.955478 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc4ae05-15de-4266-b445-4dd574af000a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:48.987207 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.auth.core [None req-dbc4ae05-15de-4266-b445-4dd574af000a None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:49:48.989103 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-dbc4ae05-15de-4266-b445-4dd574af000a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:49:49.099544 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 886/1771] 10.222.0.58 () {58 vars in 957 bytes} [Tue Oct 12 16:49:48 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:49:49.141144 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34ea32e-6ea1-4cb8-a33e-cb8b6b160a02 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:49.145182 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-c34ea32e-6ea1-4cb8-a33e-cb8b6b160a02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:49:49.146237 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc4ae05-15de-4266-b445-4dd574af000a None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:49.147679 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-dbc4ae05-15de-4266-b445-4dd574af000a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:49:49.173060 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc4ae05-15de-4266-b445-4dd574af000a None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:49.192585 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e882c9-99fb-450c-94fa-1767c00bd04f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:49.195425 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e882c9-99fb-450c-94fa-1767c00bd04f admin admin] REQUEST_METHOD: `DELETE` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:49.196959 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e882c9-99fb-450c-94fa-1767c00bd04f admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:49.197255 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e882c9-99fb-450c-94fa-1767c00bd04f admin admin] PATH_INFO: `/v3/projects/87a8fa54fd2b489da5ada318bbcfe717` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:49.200509 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e882c9-99fb-450c-94fa-1767c00bd04f admin admin] RBAC: Authorizing `identity:delete_project(project_id=87a8fa54fd2b489da5ada318bbcfe717)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:49.202793 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e882c9-99fb-450c-94fa-1767c00bd04f admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:49.260413 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34ea32e-6ea1-4cb8-a33e-cb8b6b160a02 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:49.265475 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c0f682-51e5-4416-8ab4-21c71c68baf6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e65f6d0598e4c539134292b86fb43d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:49.266262 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c0f682-51e5-4416-8ab4-21c71c68baf6 service neutron] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:49.266540 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c0f682-51e5-4416-8ab4-21c71c68baf6 service neutron] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:49.266820 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c0f682-51e5-4416-8ab4-21c71c68baf6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:49.278905 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c0f682-51e5-4416-8ab4-21c71c68baf6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:49.281352 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c0f682-51e5-4416-8ab4-21c71c68baf6 service neutron] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:49.293104 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 886/1772] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Oct 12 16:49:49 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:49:49.326100 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-f9e882c9-99fb-450c-94fa-1767c00bd04f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '87a8fa54fd2b489da5ada318bbcfe717', 'request_id': 'req-f9e882c9-99fb-450c-94fa-1767c00bd04f'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:49.332444 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-f9e882c9-99fb-450c-94fa-1767c00bd04f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '87a8fa54fd2b489da5ada318bbcfe717', 'request_id': 'req-f9e882c9-99fb-450c-94fa-1767c00bd04f'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:49.340316 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-f9e882c9-99fb-450c-94fa-1767c00bd04f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '87a8fa54fd2b489da5ada318bbcfe717', 'request_id': 'req-f9e882c9-99fb-450c-94fa-1767c00bd04f'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:49.358637 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-f9e882c9-99fb-450c-94fa-1767c00bd04f admin admin] The token cache is being invalidate because project 87a8fa54fd2b489da5ada318bbcfe717 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=85205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 16:49:49.358958 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-f9e882c9-99fb-450c-94fa-1767c00bd04f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:49.359898 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-f9e882c9-99fb-450c-94fa-1767c00bd04f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:49.361781 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 887/1773] 10.222.0.58 () {58 vars in 1232 bytes} [Tue Oct 12 16:49:49 2021] DELETE /identity/v3/projects/87a8fa54fd2b489da5ada318bbcfe717 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 16:49:49.368555 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb768c6-57ee-4843-8729-02c667628ff5 None None] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:49.369208 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb768c6-57ee-4843-8729-02c667628ff5 None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:49.369493 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb768c6-57ee-4843-8729-02c667628ff5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:49.394270 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.auth.core [None req-fbb768c6-57ee-4843-8729-02c667628ff5 None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:49:49.395665 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-fbb768c6-57ee-4843-8729-02c667628ff5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:49:49.467175 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 887/1774] 10.222.0.58 () {58 vars in 957 bytes} [Tue Oct 12 16:49:49 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:49:49.474925 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1958657e-baa8-4f80-885e-bcad0168a04e None None] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:49.475260 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1958657e-baa8-4f80-885e-bcad0168a04e None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:49.475615 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1958657e-baa8-4f80-885e-bcad0168a04e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:49.499156 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.auth.core [None req-1958657e-baa8-4f80-885e-bcad0168a04e None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:49:49.500657 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-1958657e-baa8-4f80-885e-bcad0168a04e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:49:49.516942 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 888/1775] 10.222.0.58 () {58 vars in 957 bytes} [Tue Oct 12 16:49:49 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:49:49.517449 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb768c6-57ee-4843-8729-02c667628ff5 None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:49.528303 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb768c6-57ee-4843-8729-02c667628ff5 None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:49.535382 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d86379-e30c-46e6-a3ad-dd0275f68802 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:49.536411 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d86379-e30c-46e6-a3ad-dd0275f68802 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:49.536695 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d86379-e30c-46e6-a3ad-dd0275f68802 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:49.536972 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d86379-e30c-46e6-a3ad-dd0275f68802 admin admin] PATH_INFO: `/v3/domains` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:49.537785 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d86379-e30c-46e6-a3ad-dd0275f68802 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:49:49.538148 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d86379-e30c-46e6-a3ad-dd0275f68802 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:49.539898 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d86379-e30c-46e6-a3ad-dd0275f68802 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:49.553184 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 888/1776] 10.222.0.58 () {58 vars in 1152 bytes} [Tue Oct 12 16:49:49 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:49:49.557901 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1958657e-baa8-4f80-885e-bcad0168a04e None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:49.577932 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1958657e-baa8-4f80-885e-bcad0168a04e None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:49.589118 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9b3936-918b-4dfc-8182-c0107595dbbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:49.589961 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9b3936-918b-4dfc-8182-c0107595dbbf admin admin] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:49.590254 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9b3936-918b-4dfc-8182-c0107595dbbf admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:49.590538 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9b3936-918b-4dfc-8182-c0107595dbbf admin admin] PATH_INFO: `/v3/projects` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:49.592624 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9b3936-918b-4dfc-8182-c0107595dbbf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:49.594580 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9b3936-918b-4dfc-8182-c0107595dbbf admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:49.613740 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d86379-e30c-46e6-a3ad-dd0275f68802 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:49.616857 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-d2d86379-e30c-46e6-a3ad-dd0275f68802 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:49:49.630497 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 889/1777] 10.222.0.58 () {60 vars in 1152 bytes} [Tue Oct 12 16:49:49 2021] POST /identity/v3/projects => generated 381 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 16:49:49.631578 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9b3936-918b-4dfc-8182-c0107595dbbf admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:49.639242 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d86379-e30c-46e6-a3ad-dd0275f68802 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:49.729510 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9b3936-918b-4dfc-8182-c0107595dbbf admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:49.753755 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ee1a71-2f27-4c46-81a2-6fcf6ec9cbf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:49.755472 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ee1a71-2f27-4c46-81a2-6fcf6ec9cbf3 admin admin] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:49.756389 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ee1a71-2f27-4c46-81a2-6fcf6ec9cbf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:49.756644 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ee1a71-2f27-4c46-81a2-6fcf6ec9cbf3 admin admin] PATH_INFO: `/v3/users` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:49.758650 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ee1a71-2f27-4c46-81a2-6fcf6ec9cbf3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:49.760637 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ee1a71-2f27-4c46-81a2-6fcf6ec9cbf3 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:49.775401 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f416ad67-2f2a-4355-9e6b-cdf82be08c8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:49.776502 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f416ad67-2f2a-4355-9e6b-cdf82be08c8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:49.776998 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f416ad67-2f2a-4355-9e6b-cdf82be08c8b admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:49.777330 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f416ad67-2f2a-4355-9e6b-cdf82be08c8b admin admin] PATH_INFO: `/v3/projects/2f646b4aa79a46898724bfd15fd93790` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:49.778851 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f416ad67-2f2a-4355-9e6b-cdf82be08c8b admin admin] RBAC: Authorizing `identity:delete_project(project_id=2f646b4aa79a46898724bfd15fd93790)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:49.780865 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f416ad67-2f2a-4355-9e6b-cdf82be08c8b admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:49.789755 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 890/1778] 10.222.0.58 () {60 vars in 1143 bytes} [Tue Oct 12 16:49:49 2021] POST /identity/v3/users => generated 291 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:49:49.790926 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ee1a71-2f27-4c46-81a2-6fcf6ec9cbf3 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:49.793674 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-d2ee1a71-2f27-4c46-81a2-6fcf6ec9cbf3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:49:49.807791 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ee1a71-2f27-4c46-81a2-6fcf6ec9cbf3 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:49.814345 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa0f45d-a9c9-4322-be35-488481914a5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:49.815015 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa0f45d-a9c9-4322-be35-488481914a5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:49.815482 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa0f45d-a9c9-4322-be35-488481914a5f admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:49.815850 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa0f45d-a9c9-4322-be35-488481914a5f admin admin] PATH_INFO: `/v3/projects/148ca3d35f794b15a1b7f80973032ec0` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:49.817389 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa0f45d-a9c9-4322-be35-488481914a5f admin admin] RBAC: Authorizing `identity:delete_project(project_id=148ca3d35f794b15a1b7f80973032ec0)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:49.819849 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa0f45d-a9c9-4322-be35-488481914a5f admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:49.853294 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-f416ad67-2f2a-4355-9e6b-cdf82be08c8b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2f646b4aa79a46898724bfd15fd93790', 'request_id': 'req-f416ad67-2f2a-4355-9e6b-cdf82be08c8b'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:49.861753 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-f416ad67-2f2a-4355-9e6b-cdf82be08c8b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2f646b4aa79a46898724bfd15fd93790', 'request_id': 'req-f416ad67-2f2a-4355-9e6b-cdf82be08c8b'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:49.870949 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-f416ad67-2f2a-4355-9e6b-cdf82be08c8b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2f646b4aa79a46898724bfd15fd93790', 'request_id': 'req-f416ad67-2f2a-4355-9e6b-cdf82be08c8b'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:49.875866 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-7aa0f45d-a9c9-4322-be35-488481914a5f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '148ca3d35f794b15a1b7f80973032ec0', 'request_id': 'req-7aa0f45d-a9c9-4322-be35-488481914a5f'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:49.883597 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-7aa0f45d-a9c9-4322-be35-488481914a5f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '148ca3d35f794b15a1b7f80973032ec0', 'request_id': 'req-7aa0f45d-a9c9-4322-be35-488481914a5f'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:49.891584 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-f416ad67-2f2a-4355-9e6b-cdf82be08c8b admin admin] The token cache is being invalidate because project 2f646b4aa79a46898724bfd15fd93790 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=85204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 16:49:49.893291 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-f416ad67-2f2a-4355-9e6b-cdf82be08c8b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:49.894623 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-f416ad67-2f2a-4355-9e6b-cdf82be08c8b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:49.895827 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-7aa0f45d-a9c9-4322-be35-488481914a5f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '148ca3d35f794b15a1b7f80973032ec0', 'request_id': 'req-7aa0f45d-a9c9-4322-be35-488481914a5f'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:49.898800 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 889/1779] 10.222.0.58 () {58 vars in 1232 bytes} [Tue Oct 12 16:49:49 2021] DELETE /identity/v3/projects/2f646b4aa79a46898724bfd15fd93790 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 16:49:49.899683 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f416ad67-2f2a-4355-9e6b-cdf82be08c8b admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:49.902428 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-f416ad67-2f2a-4355-9e6b-cdf82be08c8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:49:49.919011 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-7aa0f45d-a9c9-4322-be35-488481914a5f admin admin] The token cache is being invalidate because project 148ca3d35f794b15a1b7f80973032ec0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=85205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 16:49:49.919304 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-7aa0f45d-a9c9-4322-be35-488481914a5f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:49.919982 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-7aa0f45d-a9c9-4322-be35-488481914a5f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:49.922059 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 891/1780] 10.222.0.58 () {58 vars in 1232 bytes} [Tue Oct 12 16:49:49 2021] DELETE /identity/v3/projects/148ca3d35f794b15a1b7f80973032ec0 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:49:49.922969 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa0f45d-a9c9-4322-be35-488481914a5f admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:49.924262 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-7aa0f45d-a9c9-4322-be35-488481914a5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:49:49.997537 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa0f45d-a9c9-4322-be35-488481914a5f admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:50.007846 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7904fd82-757f-4238-b715-3c6254eb2697 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:50.009457 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f416ad67-2f2a-4355-9e6b-cdf82be08c8b admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:50.010210 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7904fd82-757f-4238-b715-3c6254eb2697 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:50.010575 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7904fd82-757f-4238-b715-3c6254eb2697 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:50.010926 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7904fd82-757f-4238-b715-3c6254eb2697 admin admin] PATH_INFO: `/v3/users/7ece85a776474c4ca8eb4905d8b15f62` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:50.012370 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7904fd82-757f-4238-b715-3c6254eb2697 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7ece85a776474c4ca8eb4905d8b15f62)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:50.014782 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7904fd82-757f-4238-b715-3c6254eb2697 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:50.021788 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97f4f9a-bce4-4662-98cc-59606a7f1e87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:50.022520 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97f4f9a-bce4-4662-98cc-59606a7f1e87 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:50.023349 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97f4f9a-bce4-4662-98cc-59606a7f1e87 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:50.023632 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97f4f9a-bce4-4662-98cc-59606a7f1e87 admin admin] PATH_INFO: `/v3/roles` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:50.024390 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97f4f9a-bce4-4662-98cc-59606a7f1e87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:50.026172 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97f4f9a-bce4-4662-98cc-59606a7f1e87 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:50.040946 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 890/1781] 10.222.0.58 () {58 vars in 1121 bytes} [Tue Oct 12 16:49:49 2021] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:49:50.040946 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97f4f9a-bce4-4662-98cc-59606a7f1e87 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:50.056244 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-a97f4f9a-bce4-4662-98cc-59606a7f1e87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:49:50.091790 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97f4f9a-bce4-4662-98cc-59606a7f1e87 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:50.114090 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8ca6ad-7a45-43e6-8699-d39e8d1f5b91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:50.114993 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8ca6ad-7a45-43e6-8699-d39e8d1f5b91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:50.115283 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8ca6ad-7a45-43e6-8699-d39e8d1f5b91 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:50.115831 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8ca6ad-7a45-43e6-8699-d39e8d1f5b91 admin admin] PATH_INFO: `/v3/users/c98386bcd4324cc1a251c68040865493` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:50.117589 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8ca6ad-7a45-43e6-8699-d39e8d1f5b91 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c98386bcd4324cc1a251c68040865493)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:50.119547 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8ca6ad-7a45-43e6-8699-d39e8d1f5b91 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:50.122035 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-7904fd82-757f-4238-b715-3c6254eb2697 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7ece85a776474c4ca8eb4905d8b15f62'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:50.148131 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-7904fd82-757f-4238-b715-3c6254eb2697 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7ece85a776474c4ca8eb4905d8b15f62'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:50.161222 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-7904fd82-757f-4238-b715-3c6254eb2697 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7ece85a776474c4ca8eb4905d8b15f62'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:50.182855 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-7904fd82-757f-4238-b715-3c6254eb2697 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7ece85a776474c4ca8eb4905d8b15f62'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:50.184192 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-7904fd82-757f-4238-b715-3c6254eb2697 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7ece85a776474c4ca8eb4905d8b15f62'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:50.199137 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 892/1782] 10.222.0.58 () {58 vars in 1223 bytes} [Tue Oct 12 16:49:49 2021] DELETE /identity/v3/users/7ece85a776474c4ca8eb4905d8b15f62 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:49:50.199912 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7904fd82-757f-4238-b715-3c6254eb2697 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:50.201950 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-7904fd82-757f-4238-b715-3c6254eb2697 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:49:50.216072 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-2f8ca6ad-7a45-43e6-8699-d39e8d1f5b91 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c98386bcd4324cc1a251c68040865493'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:50.242219 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-2f8ca6ad-7a45-43e6-8699-d39e8d1f5b91 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c98386bcd4324cc1a251c68040865493'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:50.264410 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-2f8ca6ad-7a45-43e6-8699-d39e8d1f5b91 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c98386bcd4324cc1a251c68040865493'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:50.283925 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-2f8ca6ad-7a45-43e6-8699-d39e8d1f5b91 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c98386bcd4324cc1a251c68040865493'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:50.295722 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-2f8ca6ad-7a45-43e6-8699-d39e8d1f5b91 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c98386bcd4324cc1a251c68040865493'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:50.317172 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 891/1783] 10.222.0.58 () {58 vars in 1223 bytes} [Tue Oct 12 16:49:50 2021] DELETE /identity/v3/users/c98386bcd4324cc1a251c68040865493 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:49:50.321820 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7904fd82-757f-4238-b715-3c6254eb2697 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:50.451359 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34780a03-2ba4-4607-81b9-675b9b9ddc50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:50.452309 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34780a03-2ba4-4607-81b9-675b9b9ddc50 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:50.452767 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34780a03-2ba4-4607-81b9-675b9b9ddc50 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:50.453057 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34780a03-2ba4-4607-81b9-675b9b9ddc50 admin admin] PATH_INFO: `/v3/roles` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:50.453912 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34780a03-2ba4-4607-81b9-675b9b9ddc50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:50.455618 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34780a03-2ba4-4607-81b9-675b9b9ddc50 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:50.470089 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 893/1784] 10.222.0.58 () {58 vars in 1121 bytes} [Tue Oct 12 16:49:50 2021] GET /identity/v3/roles => generated 1420 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:49:50.475356 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8ca6ad-7a45-43e6-8699-d39e8d1f5b91 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:50.478045 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-2f8ca6ad-7a45-43e6-8699-d39e8d1f5b91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:49:50.502606 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8ca6ad-7a45-43e6-8699-d39e8d1f5b91 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:50.511350 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7538572a-52b1-4878-a4c9-61d6aca84aa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:50.512409 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7538572a-52b1-4878-a4c9-61d6aca84aa6 admin admin] REQUEST_METHOD: `PUT` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:50.512735 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7538572a-52b1-4878-a4c9-61d6aca84aa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:50.513277 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7538572a-52b1-4878-a4c9-61d6aca84aa6 admin admin] PATH_INFO: `/v3/projects/2ab070d081a2475896a55d3175de2b70/users/6a0bbaf88965464f897f92965a463530/roles/55ba49fe29884e64b57c3ad13188d554` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:50.542276 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7538572a-52b1-4878-a4c9-61d6aca84aa6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ab070d081a2475896a55d3175de2b70, user_id=6a0bbaf88965464f897f92965a463530, role_id=55ba49fe29884e64b57c3ad13188d554)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:50.547628 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7538572a-52b1-4878-a4c9-61d6aca84aa6 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:50.577338 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 892/1785] 10.222.0.58 () {60 vars in 1482 bytes} [Tue Oct 12 16:49:50 2021] PUT /identity/v3/projects/2ab070d081a2475896a55d3175de2b70/users/6a0bbaf88965464f897f92965a463530/roles/55ba49fe29884e64b57c3ad13188d554 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:49:50.580620 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d35c746-7e69-4cbf-b593-c495b8ecf720 None None] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:50.581143 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d35c746-7e69-4cbf-b593-c495b8ecf720 None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:50.581665 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d35c746-7e69-4cbf-b593-c495b8ecf720 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:50.616397 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.auth.core [None req-7d35c746-7e69-4cbf-b593-c495b8ecf720 None None] MFA Rules not processed for user `6a0bbaf88965464f897f92965a463530`. Rule list: `[]` (Enabled: `True`). {{(pid=85205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:49:50.618188 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-7d35c746-7e69-4cbf-b593-c495b8ecf720 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:49:50.724717 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 894/1786] 10.222.0.58 () {58 vars in 957 bytes} [Tue Oct 12 16:49:50 2021] POST /identity/v3/auth/tokens => generated 3401 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:49:50.729785 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7538572a-52b1-4878-a4c9-61d6aca84aa6 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:50.832780 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7538572a-52b1-4878-a4c9-61d6aca84aa6 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:50.843684 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2182f763-9c60-4eb1-8957-bd829c5bbe05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:50.845586 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2182f763-9c60-4eb1-8957-bd829c5bbe05 admin admin] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:50.846291 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2182f763-9c60-4eb1-8957-bd829c5bbe05 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:50.846799 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2182f763-9c60-4eb1-8957-bd829c5bbe05 admin admin] PATH_INFO: `/v3/projects` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:50.847792 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2182f763-9c60-4eb1-8957-bd829c5bbe05 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:50.853322 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2182f763-9c60-4eb1-8957-bd829c5bbe05 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:50.892604 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 893/1787] 10.222.0.58 () {60 vars in 1152 bytes} [Tue Oct 12 16:49:50 2021] POST /identity/v3/projects => generated 381 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:49:50.894607 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d35c746-7e69-4cbf-b593-c495b8ecf720 None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:50.922862 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d35c746-7e69-4cbf-b593-c495b8ecf720 None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:51.003697 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab46f28-9546-4489-a855-61297cc2c893 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:51.004650 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab46f28-9546-4489-a855-61297cc2c893 admin admin] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:51.005128 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab46f28-9546-4489-a855-61297cc2c893 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:51.006155 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab46f28-9546-4489-a855-61297cc2c893 admin admin] PATH_INFO: `/v3/users` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:51.007793 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab46f28-9546-4489-a855-61297cc2c893 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:51.011805 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab46f28-9546-4489-a855-61297cc2c893 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:51.052441 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 895/1788] 10.222.0.58 () {60 vars in 1143 bytes} [Tue Oct 12 16:49:50 2021] POST /identity/v3/users => generated 297 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:49:51.058610 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2182f763-9c60-4eb1-8957-bd829c5bbe05 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:51.063158 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab46f28-9546-4489-a855-61297cc2c893 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:51.068981 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2182f763-9c60-4eb1-8957-bd829c5bbe05 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:51.071201 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-5ab46f28-9546-4489-a855-61297cc2c893 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:49:51.076984 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f7bb97-a02b-4a57-83db-babecb41385a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:51.078486 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f7bb97-a02b-4a57-83db-babecb41385a admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:51.078849 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f7bb97-a02b-4a57-83db-babecb41385a admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:51.079193 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f7bb97-a02b-4a57-83db-babecb41385a admin admin] PATH_INFO: `/v3/roles` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:51.080019 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f7bb97-a02b-4a57-83db-babecb41385a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:51.082497 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f7bb97-a02b-4a57-83db-babecb41385a admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:51.085852 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab46f28-9546-4489-a855-61297cc2c893 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:51.092189 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3c9b84-3b7f-423e-895e-6a1ea5c98c22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:51.093054 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3c9b84-3b7f-423e-895e-6a1ea5c98c22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:51.093523 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3c9b84-3b7f-423e-895e-6a1ea5c98c22 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:51.093619 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3c9b84-3b7f-423e-895e-6a1ea5c98c22 admin admin] PATH_INFO: `/v3/projects/bbadd882da994b30977abe5b6b5205fe` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:51.095007 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3c9b84-3b7f-423e-895e-6a1ea5c98c22 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bbadd882da994b30977abe5b6b5205fe)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:51.096903 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3c9b84-3b7f-423e-895e-6a1ea5c98c22 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:51.101844 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 894/1789] 10.222.0.58 () {58 vars in 1121 bytes} [Tue Oct 12 16:49:51 2021] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:49:51.105593 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f7bb97-a02b-4a57-83db-babecb41385a admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:51.138083 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f7bb97-a02b-4a57-83db-babecb41385a admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:51.143425 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f760c2-9b44-4419-8302-48b6547e0156 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:51.144333 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f760c2-9b44-4419-8302-48b6547e0156 admin admin] REQUEST_METHOD: `PUT` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:51.144612 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f760c2-9b44-4419-8302-48b6547e0156 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:51.144888 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f760c2-9b44-4419-8302-48b6547e0156 admin admin] PATH_INFO: `/v3/projects/0aee69bc40a54329b859a4cbb5b7a6bf/users/3c980c3afe574f15a5bfe8c75718060b/roles/610824e4f50f4fb8954610e98c1de784` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:51.166155 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-1e3c9b84-3b7f-423e-895e-6a1ea5c98c22 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bbadd882da994b30977abe5b6b5205fe', 'request_id': 'req-1e3c9b84-3b7f-423e-895e-6a1ea5c98c22'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:51.171847 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f760c2-9b44-4419-8302-48b6547e0156 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0aee69bc40a54329b859a4cbb5b7a6bf, user_id=3c980c3afe574f15a5bfe8c75718060b, role_id=610824e4f50f4fb8954610e98c1de784)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:51.172922 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-1e3c9b84-3b7f-423e-895e-6a1ea5c98c22 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bbadd882da994b30977abe5b6b5205fe', 'request_id': 'req-1e3c9b84-3b7f-423e-895e-6a1ea5c98c22'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:51.174535 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f760c2-9b44-4419-8302-48b6547e0156 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:51.180837 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-1e3c9b84-3b7f-423e-895e-6a1ea5c98c22 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bbadd882da994b30977abe5b6b5205fe', 'request_id': 'req-1e3c9b84-3b7f-423e-895e-6a1ea5c98c22'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:51.196569 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 895/1790] 10.222.0.58 () {60 vars in 1482 bytes} [Tue Oct 12 16:49:51 2021] PUT /identity/v3/projects/0aee69bc40a54329b859a4cbb5b7a6bf/users/3c980c3afe574f15a5bfe8c75718060b/roles/610824e4f50f4fb8954610e98c1de784 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:49:51.198151 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f760c2-9b44-4419-8302-48b6547e0156 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:51.201744 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-1e3c9b84-3b7f-423e-895e-6a1ea5c98c22 admin admin] The token cache is being invalidate because project bbadd882da994b30977abe5b6b5205fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=85205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 16:49:51.202268 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-1e3c9b84-3b7f-423e-895e-6a1ea5c98c22 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:51.203240 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-1e3c9b84-3b7f-423e-895e-6a1ea5c98c22 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:51.205110 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 896/1791] 10.222.0.58 () {58 vars in 1232 bytes} [Tue Oct 12 16:49:51 2021] DELETE /identity/v3/projects/bbadd882da994b30977abe5b6b5205fe => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:49:51.211327 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9875651c-2d2a-480b-a3ac-fdadf617e200 None None] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:51.212137 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9875651c-2d2a-480b-a3ac-fdadf617e200 None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:51.212641 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9875651c-2d2a-480b-a3ac-fdadf617e200 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:51.244836 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.auth.core [None req-9875651c-2d2a-480b-a3ac-fdadf617e200 None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:49:51.246653 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-9875651c-2d2a-480b-a3ac-fdadf617e200 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:49:51.302251 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f760c2-9b44-4419-8302-48b6547e0156 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:51.321728 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ace975-7018-4c6e-b4d8-282dd1fd7473 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:51.322412 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ace975-7018-4c6e-b4d8-282dd1fd7473 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:51.322704 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ace975-7018-4c6e-b4d8-282dd1fd7473 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:51.322976 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ace975-7018-4c6e-b4d8-282dd1fd7473 admin admin] PATH_INFO: `/v3/roles` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:51.323734 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ace975-7018-4c6e-b4d8-282dd1fd7473 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:51.325348 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ace975-7018-4c6e-b4d8-282dd1fd7473 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:51.345466 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 896/1792] 10.222.0.58 () {58 vars in 1121 bytes} [Tue Oct 12 16:49:51 2021] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 16:49:51.346457 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ace975-7018-4c6e-b4d8-282dd1fd7473 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:51.351228 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-28ace975-7018-4c6e-b4d8-282dd1fd7473 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:49:51.378213 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 897/1793] 10.222.0.58 () {58 vars in 957 bytes} [Tue Oct 12 16:49:51 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:49:51.379340 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9875651c-2d2a-480b-a3ac-fdadf617e200 None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:51.379471 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ace975-7018-4c6e-b4d8-282dd1fd7473 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:51.384525 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-9875651c-2d2a-480b-a3ac-fdadf617e200 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:49:51.386167 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfadd79-3ffe-489b-9572-dc832aceade4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:51.387279 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfadd79-3ffe-489b-9572-dc832aceade4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:51.387567 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfadd79-3ffe-489b-9572-dc832aceade4 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:51.387959 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfadd79-3ffe-489b-9572-dc832aceade4 admin admin] PATH_INFO: `/v3/projects/3815383fd3ea4a6a8b84361e379d7414` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:51.389176 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfadd79-3ffe-489b-9572-dc832aceade4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3815383fd3ea4a6a8b84361e379d7414)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:51.391973 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfadd79-3ffe-489b-9572-dc832aceade4 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:51.396661 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9875651c-2d2a-480b-a3ac-fdadf617e200 None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:51.402390 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5163ea9-6218-49c6-a412-94d90146009d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:51.403468 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5163ea9-6218-49c6-a412-94d90146009d admin admin] REQUEST_METHOD: `PUT` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:51.403760 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5163ea9-6218-49c6-a412-94d90146009d admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:51.404041 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5163ea9-6218-49c6-a412-94d90146009d admin admin] PATH_INFO: `/v3/projects/0aee69bc40a54329b859a4cbb5b7a6bf/users/3c980c3afe574f15a5bfe8c75718060b/roles/610824e4f50f4fb8954610e98c1de784` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:51.406125 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5163ea9-6218-49c6-a412-94d90146009d admin admin] RBAC: Authorizing `identity:create_grant(project_id=0aee69bc40a54329b859a4cbb5b7a6bf, user_id=3c980c3afe574f15a5bfe8c75718060b, role_id=610824e4f50f4fb8954610e98c1de784)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:51.408816 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5163ea9-6218-49c6-a412-94d90146009d admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:51.425463 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 898/1794] 10.222.0.58 () {60 vars in 1482 bytes} [Tue Oct 12 16:49:51 2021] PUT /identity/v3/projects/0aee69bc40a54329b859a4cbb5b7a6bf/users/3c980c3afe574f15a5bfe8c75718060b/roles/610824e4f50f4fb8954610e98c1de784 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:49:51.426922 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b6a132-c220-4c4e-9b47-97b68db8d69e None None] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:51.427285 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b6a132-c220-4c4e-9b47-97b68db8d69e None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:51.430522 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b6a132-c220-4c4e-9b47-97b68db8d69e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:51.454998 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-ccfadd79-3ffe-489b-9572-dc832aceade4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3815383fd3ea4a6a8b84361e379d7414', 'request_id': 'req-ccfadd79-3ffe-489b-9572-dc832aceade4'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:51.461981 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-ccfadd79-3ffe-489b-9572-dc832aceade4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3815383fd3ea4a6a8b84361e379d7414', 'request_id': 'req-ccfadd79-3ffe-489b-9572-dc832aceade4'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:51.468763 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.auth.core [None req-b0b6a132-c220-4c4e-9b47-97b68db8d69e None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:49:51.469689 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-ccfadd79-3ffe-489b-9572-dc832aceade4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3815383fd3ea4a6a8b84361e379d7414', 'request_id': 'req-ccfadd79-3ffe-489b-9572-dc832aceade4'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:51.470083 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-b0b6a132-c220-4c4e-9b47-97b68db8d69e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:49:51.488730 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-ccfadd79-3ffe-489b-9572-dc832aceade4 admin admin] The token cache is being invalidate because project 3815383fd3ea4a6a8b84361e379d7414 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=85204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 16:49:51.489150 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-ccfadd79-3ffe-489b-9572-dc832aceade4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:51.494951 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-ccfadd79-3ffe-489b-9572-dc832aceade4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:51.502575 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 897/1795] 10.222.0.58 () {58 vars in 1232 bytes} [Tue Oct 12 16:49:51 2021] DELETE /identity/v3/projects/3815383fd3ea4a6a8b84361e379d7414 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:49:51.504427 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31e8d91-a001-4464-80a2-cb362dc0d2b0 None None] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:51.508355 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31e8d91-a001-4464-80a2-cb362dc0d2b0 None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:51.508671 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31e8d91-a001-4464-80a2-cb362dc0d2b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:51.568224 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.auth.core [None req-c31e8d91-a001-4464-80a2-cb362dc0d2b0 None None] MFA Rules not processed for user `3c980c3afe574f15a5bfe8c75718060b`. Rule list: `[]` (Enabled: `True`). {{(pid=85204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:49:51.570836 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-c31e8d91-a001-4464-80a2-cb362dc0d2b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:49:51.600065 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 899/1796] 10.222.0.58 () {58 vars in 957 bytes} [Tue Oct 12 16:49:51 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:49:51.602081 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cd2c1c-0933-46fb-b1d4-e7c5da5a4ab1 None None] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:51.602373 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cd2c1c-0933-46fb-b1d4-e7c5da5a4ab1 None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:51.602644 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cd2c1c-0933-46fb-b1d4-e7c5da5a4ab1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:51.637288 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.auth.core [None req-60cd2c1c-0933-46fb-b1d4-e7c5da5a4ab1 None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:49:51.638873 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-60cd2c1c-0933-46fb-b1d4-e7c5da5a4ab1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:49:51.651195 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 900/1797] 10.222.0.58 () {58 vars in 957 bytes} [Tue Oct 12 16:49:51 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:49:51.652467 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cd2c1c-0933-46fb-b1d4-e7c5da5a4ab1 None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:51.696727 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cd2c1c-0933-46fb-b1d4-e7c5da5a4ab1 None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:51.714842 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 898/1798] 10.222.0.58 () {58 vars in 957 bytes} [Tue Oct 12 16:49:51 2021] POST /identity/v3/auth/tokens => generated 3468 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:49:51.716501 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb39b8e5-a593-4275-b897-ed112474654d None None] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:51.716800 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb39b8e5-a593-4275-b897-ed112474654d None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:51.717130 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb39b8e5-a593-4275-b897-ed112474654d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:51.725327 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68cb96a-c6a6-4a49-9429-d225ea2aa0cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:51.733187 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68cb96a-c6a6-4a49-9429-d225ea2aa0cd admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:51.735264 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68cb96a-c6a6-4a49-9429-d225ea2aa0cd admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:51.735754 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68cb96a-c6a6-4a49-9429-d225ea2aa0cd admin admin] PATH_INFO: `/v3/domains` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:51.738640 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68cb96a-c6a6-4a49-9429-d225ea2aa0cd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:49:51.739634 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68cb96a-c6a6-4a49-9429-d225ea2aa0cd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:51.741392 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.auth.core [None req-cb39b8e5-a593-4275-b897-ed112474654d None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:49:51.743244 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-cb39b8e5-a593-4275-b897-ed112474654d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:49:51.749692 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68cb96a-c6a6-4a49-9429-d225ea2aa0cd admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:51.776185 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 899/1799] 10.222.0.58 () {58 vars in 957 bytes} [Tue Oct 12 16:49:51 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:49:51.781070 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb39b8e5-a593-4275-b897-ed112474654d None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:51.783973 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-cb39b8e5-a593-4275-b897-ed112474654d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:49:51.795816 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 901/1800] 10.222.0.58 () {58 vars in 1152 bytes} [Tue Oct 12 16:49:51 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:49:51.796846 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68cb96a-c6a6-4a49-9429-d225ea2aa0cd admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:51.821548 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68cb96a-c6a6-4a49-9429-d225ea2aa0cd admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:51.837590 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b1ff98-5fdd-4d08-ba1d-52f1db2e3ac4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:51.838295 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b1ff98-5fdd-4d08-ba1d-52f1db2e3ac4 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:51.839078 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b1ff98-5fdd-4d08-ba1d-52f1db2e3ac4 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:51.839366 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b1ff98-5fdd-4d08-ba1d-52f1db2e3ac4 admin admin] PATH_INFO: `/v3/domains` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:51.840124 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b1ff98-5fdd-4d08-ba1d-52f1db2e3ac4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:49:51.840439 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b1ff98-5fdd-4d08-ba1d-52f1db2e3ac4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:51.845363 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b1ff98-5fdd-4d08-ba1d-52f1db2e3ac4 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:51.880691 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 902/1801] 10.222.0.58 () {58 vars in 1152 bytes} [Tue Oct 12 16:49:51 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:49:51.881641 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b1ff98-5fdd-4d08-ba1d-52f1db2e3ac4 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:51.901611 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b1ff98-5fdd-4d08-ba1d-52f1db2e3ac4 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:51.915497 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf8a5d2-a0a7-4411-9290-769cecb41dfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:51.915497 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf8a5d2-a0a7-4411-9290-769cecb41dfe admin admin] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:51.915497 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf8a5d2-a0a7-4411-9290-769cecb41dfe admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:51.915497 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf8a5d2-a0a7-4411-9290-769cecb41dfe admin admin] PATH_INFO: `/v3/projects` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:51.917175 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf8a5d2-a0a7-4411-9290-769cecb41dfe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:51.919121 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb39b8e5-a593-4275-b897-ed112474654d None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:51.920899 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf8a5d2-a0a7-4411-9290-769cecb41dfe admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:51.932746 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bda970c-7ae6-458c-828f-553e91e8da56 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04704222b3d64a33a6c092fc641ccbb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:51.933354 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bda970c-7ae6-458c-828f-553e91e8da56 service cinder] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:51.933645 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bda970c-7ae6-458c-828f-553e91e8da56 service cinder] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:51.933946 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bda970c-7ae6-458c-828f-553e91e8da56 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:51.948962 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bda970c-7ae6-458c-828f-553e91e8da56 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:51.950457 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bda970c-7ae6-458c-828f-553e91e8da56 service cinder] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:51.970181 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 900/1802] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Oct 12 16:49:51 2021] GET /identity/v3/auth/tokens => generated 3468 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:49:51.981017 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 903/1803] 10.222.0.58 () {60 vars in 1152 bytes} [Tue Oct 12 16:49:51 2021] POST /identity/v3/projects => generated 375 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:49:51.986056 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bda970c-7ae6-458c-828f-553e91e8da56 service cinder] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:51.986600 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf8a5d2-a0a7-4411-9290-769cecb41dfe admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:52.008342 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bda970c-7ae6-458c-828f-553e91e8da56 service cinder] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:52.096784 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf8a5d2-a0a7-4411-9290-769cecb41dfe admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:52.103337 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cc50d7-18b4-48ec-ae85-a026e5d5dd13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:52.104282 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cc50d7-18b4-48ec-ae85-a026e5d5dd13 admin admin] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:52.104783 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cc50d7-18b4-48ec-ae85-a026e5d5dd13 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:52.105277 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cc50d7-18b4-48ec-ae85-a026e5d5dd13 admin admin] PATH_INFO: `/v3/users` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:52.106209 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cc50d7-18b4-48ec-ae85-a026e5d5dd13 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:52.108393 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cc50d7-18b4-48ec-ae85-a026e5d5dd13 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:52.139052 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 904/1804] 10.222.0.58 () {60 vars in 1143 bytes} [Tue Oct 12 16:49:51 2021] POST /identity/v3/users => generated 288 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 16:49:52.143605 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cc50d7-18b4-48ec-ae85-a026e5d5dd13 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:52.174132 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cc50d7-18b4-48ec-ae85-a026e5d5dd13 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:52.175645 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6ff20c-0315-4b2a-8622-4ced8aa058ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:52.177986 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6ff20c-0315-4b2a-8622-4ced8aa058ed admin admin] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:52.178614 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6ff20c-0315-4b2a-8622-4ced8aa058ed admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:52.179525 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6ff20c-0315-4b2a-8622-4ced8aa058ed admin admin] PATH_INFO: `/v3/projects` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:52.180404 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6ff20c-0315-4b2a-8622-4ced8aa058ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:52.191853 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6ff20c-0315-4b2a-8622-4ced8aa058ed admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:52.194155 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71640abd-7971-4384-b64e-6bc78b98a110 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:52.196736 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71640abd-7971-4384-b64e-6bc78b98a110 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:52.197662 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71640abd-7971-4384-b64e-6bc78b98a110 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:52.198736 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71640abd-7971-4384-b64e-6bc78b98a110 admin admin] PATH_INFO: `/v3/roles` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:52.199697 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71640abd-7971-4384-b64e-6bc78b98a110 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:52.204491 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71640abd-7971-4384-b64e-6bc78b98a110 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:52.226847 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 905/1805] 10.222.0.58 () {58 vars in 1121 bytes} [Tue Oct 12 16:49:52 2021] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:49:52.230468 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71640abd-7971-4384-b64e-6bc78b98a110 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:52.257713 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 901/1806] 10.222.0.58 () {60 vars in 1152 bytes} [Tue Oct 12 16:49:51 2021] POST /identity/v3/projects => generated 375 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:49:52.258938 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6ff20c-0315-4b2a-8622-4ced8aa058ed admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:52.259156 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71640abd-7971-4384-b64e-6bc78b98a110 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:52.354617 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6ff20c-0315-4b2a-8622-4ced8aa058ed admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:52.361098 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ee9e47-e1b7-40c3-a67a-d16ffa3c08d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:52.362033 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ee9e47-e1b7-40c3-a67a-d16ffa3c08d8 admin admin] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:52.362421 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ee9e47-e1b7-40c3-a67a-d16ffa3c08d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:52.362849 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ee9e47-e1b7-40c3-a67a-d16ffa3c08d8 admin admin] PATH_INFO: `/v3/users` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:52.363680 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ee9e47-e1b7-40c3-a67a-d16ffa3c08d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:52.367276 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ee9e47-e1b7-40c3-a67a-d16ffa3c08d8 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:52.399342 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 902/1807] 10.222.0.58 () {60 vars in 1143 bytes} [Tue Oct 12 16:49:52 2021] POST /identity/v3/users => generated 288 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:49:52.407372 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ee9e47-e1b7-40c3-a67a-d16ffa3c08d8 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:52.421381 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c32d9e2-25c4-40a6-a08b-b5693e39c0e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:52.422353 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c32d9e2-25c4-40a6-a08b-b5693e39c0e2 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:52.422790 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c32d9e2-25c4-40a6-a08b-b5693e39c0e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:52.423213 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c32d9e2-25c4-40a6-a08b-b5693e39c0e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:52.424135 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c32d9e2-25c4-40a6-a08b-b5693e39c0e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:52.425902 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c32d9e2-25c4-40a6-a08b-b5693e39c0e2 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:52.436345 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ee9e47-e1b7-40c3-a67a-d16ffa3c08d8 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:52.448634 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 906/1808] 10.222.0.58 () {58 vars in 1121 bytes} [Tue Oct 12 16:49:52 2021] GET /identity/v3/roles => generated 1420 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 16:49:52.452601 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c32d9e2-25c4-40a6-a08b-b5693e39c0e2 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:52.474988 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3804662-9312-421b-947a-414390e48cf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:52.477655 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3804662-9312-421b-947a-414390e48cf9 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:52.477911 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c32d9e2-25c4-40a6-a08b-b5693e39c0e2 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:52.480429 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3804662-9312-421b-947a-414390e48cf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:52.480947 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3804662-9312-421b-947a-414390e48cf9 admin admin] PATH_INFO: `/v3/roles` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:52.483720 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3804662-9312-421b-947a-414390e48cf9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:52.485448 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa44ecba-d922-4e2f-98b3-23f4cea7507b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:52.486391 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa44ecba-d922-4e2f-98b3-23f4cea7507b admin admin] REQUEST_METHOD: `PUT` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:52.486681 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa44ecba-d922-4e2f-98b3-23f4cea7507b admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:52.486970 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa44ecba-d922-4e2f-98b3-23f4cea7507b admin admin] PATH_INFO: `/v3/projects/b39d904767ce45a98a285b0df9c88ecd/users/d85f8e635364491c936b30b5fe23c9bf/roles/55ba49fe29884e64b57c3ad13188d554` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:52.493410 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3804662-9312-421b-947a-414390e48cf9 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:52.522772 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa44ecba-d922-4e2f-98b3-23f4cea7507b admin admin] RBAC: Authorizing `identity:create_grant(project_id=b39d904767ce45a98a285b0df9c88ecd, user_id=d85f8e635364491c936b30b5fe23c9bf, role_id=55ba49fe29884e64b57c3ad13188d554)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:52.527982 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa44ecba-d922-4e2f-98b3-23f4cea7507b admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:52.555579 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 903/1809] 10.222.0.58 () {58 vars in 1121 bytes} [Tue Oct 12 16:49:52 2021] GET /identity/v3/roles => generated 1420 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:49:52.556756 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 907/1810] 10.222.0.58 () {60 vars in 1482 bytes} [Tue Oct 12 16:49:52 2021] PUT /identity/v3/projects/b39d904767ce45a98a285b0df9c88ecd/users/d85f8e635364491c936b30b5fe23c9bf/roles/55ba49fe29884e64b57c3ad13188d554 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:49:52.559980 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3804662-9312-421b-947a-414390e48cf9 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:52.568092 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb13943e-81c2-4465-945b-8137de4ffead None None] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:52.568457 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb13943e-81c2-4465-945b-8137de4ffead None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:52.568457 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb13943e-81c2-4465-945b-8137de4ffead None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:52.582879 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3804662-9312-421b-947a-414390e48cf9 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:52.626351 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.auth.core [None req-fb13943e-81c2-4465-945b-8137de4ffead None None] MFA Rules not processed for user `d85f8e635364491c936b30b5fe23c9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=85205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:49:52.627599 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-fb13943e-81c2-4465-945b-8137de4ffead None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:49:52.727005 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74d3262-b355-4115-8818-b083c023a37b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:52.727794 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74d3262-b355-4115-8818-b083c023a37b admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:52.728945 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74d3262-b355-4115-8818-b083c023a37b admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:52.729559 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74d3262-b355-4115-8818-b083c023a37b admin admin] PATH_INFO: `/v3/roles` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:52.730379 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74d3262-b355-4115-8818-b083c023a37b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:52.743838 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74d3262-b355-4115-8818-b083c023a37b admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:52.759537 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 908/1811] 10.222.0.58 () {58 vars in 957 bytes} [Tue Oct 12 16:49:52 2021] POST /identity/v3/auth/tokens => generated 3395 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:49:52.762786 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb13943e-81c2-4465-945b-8137de4ffead None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:52.764968 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 904/1812] 10.222.0.58 () {58 vars in 1121 bytes} [Tue Oct 12 16:49:52 2021] GET /identity/v3/roles => generated 1420 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 16:49:52.767030 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74d3262-b355-4115-8818-b083c023a37b admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:52.784419 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74d3262-b355-4115-8818-b083c023a37b admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:52.801052 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398f8a60-fcf2-44bb-b8cc-023ad3d273dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:52.802474 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398f8a60-fcf2-44bb-b8cc-023ad3d273dd admin admin] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:52.803583 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398f8a60-fcf2-44bb-b8cc-023ad3d273dd admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:52.804658 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398f8a60-fcf2-44bb-b8cc-023ad3d273dd admin admin] PATH_INFO: `/v3/projects` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:52.805544 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398f8a60-fcf2-44bb-b8cc-023ad3d273dd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:52.808019 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398f8a60-fcf2-44bb-b8cc-023ad3d273dd admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:52.837110 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 905/1813] 10.222.0.58 () {60 vars in 1152 bytes} [Tue Oct 12 16:49:52 2021] POST /identity/v3/projects => generated 377 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:49:52.837541 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398f8a60-fcf2-44bb-b8cc-023ad3d273dd admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:52.845664 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb13943e-81c2-4465-945b-8137de4ffead None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:52.912240 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398f8a60-fcf2-44bb-b8cc-023ad3d273dd admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:52.917671 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd15430-b83e-4862-85bd-1017015f64f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:52.918547 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd15430-b83e-4862-85bd-1017015f64f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:52.918826 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd15430-b83e-4862-85bd-1017015f64f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:52.919055 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50fe14d-c425-43fa-b153-5f98d6e0abad tempest-VolumeQuotaClassesTest-2107814076 tempest-VolumeQuotaClassesTest-2107814076-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c980c3afe574f15a5bfe8c75718060b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aee69bc40a54329b859a4cbb5b7a6bf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:52.919199 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd15430-b83e-4862-85bd-1017015f64f2 admin admin] PATH_INFO: `/v3/projects/01671f61d7104034bb9ea3d1db4e5fec/users/e2d1838e75474c5990b58ff7d1e1aa32/roles/55ba49fe29884e64b57c3ad13188d554` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:52.919924 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50fe14d-c425-43fa-b153-5f98d6e0abad tempest-VolumeQuotaClassesTest-2107814076 tempest-VolumeQuotaClassesTest-2107814076-project-admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:52.920352 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50fe14d-c425-43fa-b153-5f98d6e0abad tempest-VolumeQuotaClassesTest-2107814076 tempest-VolumeQuotaClassesTest-2107814076-project-admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:52.920835 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50fe14d-c425-43fa-b153-5f98d6e0abad tempest-VolumeQuotaClassesTest-2107814076 tempest-VolumeQuotaClassesTest-2107814076-project-admin] PATH_INFO: `/v3/domains` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:52.922145 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50fe14d-c425-43fa-b153-5f98d6e0abad tempest-VolumeQuotaClassesTest-2107814076 tempest-VolumeQuotaClassesTest-2107814076-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=85205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:49:52.923305 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50fe14d-c425-43fa-b153-5f98d6e0abad tempest-VolumeQuotaClassesTest-2107814076 tempest-VolumeQuotaClassesTest-2107814076-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:52.925000 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50fe14d-c425-43fa-b153-5f98d6e0abad tempest-VolumeQuotaClassesTest-2107814076 tempest-VolumeQuotaClassesTest-2107814076-project-admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:52.935203 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd15430-b83e-4862-85bd-1017015f64f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=01671f61d7104034bb9ea3d1db4e5fec, user_id=e2d1838e75474c5990b58ff7d1e1aa32, role_id=55ba49fe29884e64b57c3ad13188d554)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:52.937811 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd15430-b83e-4862-85bd-1017015f64f2 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:52.939777 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 909/1814] 10.222.0.58 () {58 vars in 1152 bytes} [Tue Oct 12 16:49:52 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:49:52.941321 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50fe14d-c425-43fa-b153-5f98d6e0abad tempest-VolumeQuotaClassesTest-2107814076 tempest-VolumeQuotaClassesTest-2107814076-project-admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:52.953690 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50fe14d-c425-43fa-b153-5f98d6e0abad tempest-VolumeQuotaClassesTest-2107814076 tempest-VolumeQuotaClassesTest-2107814076-project-admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:52.960505 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 906/1815] 10.222.0.58 () {60 vars in 1482 bytes} [Tue Oct 12 16:49:52 2021] PUT /identity/v3/projects/01671f61d7104034bb9ea3d1db4e5fec/users/e2d1838e75474c5990b58ff7d1e1aa32/roles/55ba49fe29884e64b57c3ad13188d554 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:49:52.961930 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd15430-b83e-4862-85bd-1017015f64f2 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:53.027001 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a1cd40-ad06-4fa3-b3b9-758b92a00ef4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:53.028123 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a1cd40-ad06-4fa3-b3b9-758b92a00ef4 admin admin] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:53.028845 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a1cd40-ad06-4fa3-b3b9-758b92a00ef4 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:53.029129 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a1cd40-ad06-4fa3-b3b9-758b92a00ef4 admin admin] PATH_INFO: `/v3/users` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:53.030804 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a1cd40-ad06-4fa3-b3b9-758b92a00ef4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:53.032106 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a1cd40-ad06-4fa3-b3b9-758b92a00ef4 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:53.048090 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd15430-b83e-4862-85bd-1017015f64f2 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:53.057251 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d724f29-e1cd-4d3e-a897-047cd64e3544 tempest-VolumeQuotaClassesTest-2107814076 tempest-VolumeQuotaClassesTest-2107814076-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c980c3afe574f15a5bfe8c75718060b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aee69bc40a54329b859a4cbb5b7a6bf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:53.057725 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d724f29-e1cd-4d3e-a897-047cd64e3544 tempest-VolumeQuotaClassesTest-2107814076 tempest-VolumeQuotaClassesTest-2107814076-project-admin] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:53.058181 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d724f29-e1cd-4d3e-a897-047cd64e3544 tempest-VolumeQuotaClassesTest-2107814076 tempest-VolumeQuotaClassesTest-2107814076-project-admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:53.058342 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d724f29-e1cd-4d3e-a897-047cd64e3544 tempest-VolumeQuotaClassesTest-2107814076 tempest-VolumeQuotaClassesTest-2107814076-project-admin] PATH_INFO: `/v3/projects` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:53.062175 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d724f29-e1cd-4d3e-a897-047cd64e3544 tempest-VolumeQuotaClassesTest-2107814076 tempest-VolumeQuotaClassesTest-2107814076-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:53.062278 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 910/1816] 10.222.0.58 () {60 vars in 1143 bytes} [Tue Oct 12 16:49:52 2021] POST /identity/v3/users => generated 295 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:49:53.062278 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe6880e-0ad2-4875-956b-19392233eb9f None None] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:53.062278 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe6880e-0ad2-4875-956b-19392233eb9f None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:53.062485 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d724f29-e1cd-4d3e-a897-047cd64e3544 tempest-VolumeQuotaClassesTest-2107814076 tempest-VolumeQuotaClassesTest-2107814076-project-admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:53.062553 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe6880e-0ad2-4875-956b-19392233eb9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:53.099650 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 907/1817] 10.222.0.58 () {60 vars in 1152 bytes} [Tue Oct 12 16:49:52 2021] POST /identity/v3/projects => generated 354 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:49:53.100576 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d724f29-e1cd-4d3e-a897-047cd64e3544 tempest-VolumeQuotaClassesTest-2107814076 tempest-VolumeQuotaClassesTest-2107814076-project-admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:53.118739 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.auth.core [None req-fbe6880e-0ad2-4875-956b-19392233eb9f None None] MFA Rules not processed for user `e2d1838e75474c5990b58ff7d1e1aa32`. Rule list: `[]` (Enabled: `True`). {{(pid=85205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:49:53.120237 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-fbe6880e-0ad2-4875-956b-19392233eb9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:49:53.182542 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d724f29-e1cd-4d3e-a897-047cd64e3544 tempest-VolumeQuotaClassesTest-2107814076 tempest-VolumeQuotaClassesTest-2107814076-project-admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:53.195622 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 911/1818] 10.222.0.58 () {58 vars in 957 bytes} [Tue Oct 12 16:49:53 2021] POST /identity/v3/auth/tokens => generated 3395 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:49:53.196513 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe6880e-0ad2-4875-956b-19392233eb9f None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:53.196843 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638cab6f-68a7-45be-97ac-5981f1526786 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:53.197564 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638cab6f-68a7-45be-97ac-5981f1526786 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:53.197850 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638cab6f-68a7-45be-97ac-5981f1526786 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:53.198160 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638cab6f-68a7-45be-97ac-5981f1526786 admin admin] PATH_INFO: `/v3/roles` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:53.198959 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638cab6f-68a7-45be-97ac-5981f1526786 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:53.200520 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638cab6f-68a7-45be-97ac-5981f1526786 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:53.211872 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 908/1819] 10.222.0.58 () {58 vars in 1121 bytes} [Tue Oct 12 16:49:53 2021] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:49:53.212964 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638cab6f-68a7-45be-97ac-5981f1526786 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:53.229011 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638cab6f-68a7-45be-97ac-5981f1526786 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:53.234093 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf19946-932b-44c7-998c-86b341f8c6bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:53.234758 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf19946-932b-44c7-998c-86b341f8c6bb admin admin] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:53.235072 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf19946-932b-44c7-998c-86b341f8c6bb admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:53.235431 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf19946-932b-44c7-998c-86b341f8c6bb admin admin] PATH_INFO: `/v3/projects` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:53.236063 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf19946-932b-44c7-998c-86b341f8c6bb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:53.238617 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf19946-932b-44c7-998c-86b341f8c6bb admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:53.266761 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 909/1820] 10.222.0.58 () {60 vars in 1152 bytes} [Tue Oct 12 16:49:53 2021] POST /identity/v3/projects => generated 373 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:49:53.267661 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf19946-932b-44c7-998c-86b341f8c6bb admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:53.270939 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe6880e-0ad2-4875-956b-19392233eb9f None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:53.332375 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df925fd3-66d6-4b50-8f54-fc80e6eb8c02 tempest-VolumeQuotaClassesTest-2107814076 tempest-VolumeQuotaClassesTest-2107814076-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c980c3afe574f15a5bfe8c75718060b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aee69bc40a54329b859a4cbb5b7a6bf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:53.333051 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df925fd3-66d6-4b50-8f54-fc80e6eb8c02 tempest-VolumeQuotaClassesTest-2107814076 tempest-VolumeQuotaClassesTest-2107814076-project-admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:53.333354 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df925fd3-66d6-4b50-8f54-fc80e6eb8c02 tempest-VolumeQuotaClassesTest-2107814076 tempest-VolumeQuotaClassesTest-2107814076-project-admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:53.333612 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df925fd3-66d6-4b50-8f54-fc80e6eb8c02 tempest-VolumeQuotaClassesTest-2107814076 tempest-VolumeQuotaClassesTest-2107814076-project-admin] PATH_INFO: `/v3/domains` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:53.334397 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df925fd3-66d6-4b50-8f54-fc80e6eb8c02 tempest-VolumeQuotaClassesTest-2107814076 tempest-VolumeQuotaClassesTest-2107814076-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=85205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:49:53.334708 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df925fd3-66d6-4b50-8f54-fc80e6eb8c02 tempest-VolumeQuotaClassesTest-2107814076 tempest-VolumeQuotaClassesTest-2107814076-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:53.334921 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf19946-932b-44c7-998c-86b341f8c6bb admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:53.337561 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df925fd3-66d6-4b50-8f54-fc80e6eb8c02 tempest-VolumeQuotaClassesTest-2107814076 tempest-VolumeQuotaClassesTest-2107814076-project-admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:53.341666 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b80f8e-c60e-4a23-87c0-1e34f2b270d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:53.342621 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b80f8e-c60e-4a23-87c0-1e34f2b270d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:53.342967 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b80f8e-c60e-4a23-87c0-1e34f2b270d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:53.343254 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b80f8e-c60e-4a23-87c0-1e34f2b270d7 admin admin] PATH_INFO: `/v3/projects/44727a644beb46ecb9b5ee9d7eef5f36/users/d1095c78e64e46288c0c8696e6d815dd/roles/610824e4f50f4fb8954610e98c1de784` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:53.355552 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 912/1821] 10.222.0.58 () {58 vars in 1152 bytes} [Tue Oct 12 16:49:53 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:49:53.355552 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df925fd3-66d6-4b50-8f54-fc80e6eb8c02 tempest-VolumeQuotaClassesTest-2107814076 tempest-VolumeQuotaClassesTest-2107814076-project-admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:53.360937 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b80f8e-c60e-4a23-87c0-1e34f2b270d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=44727a644beb46ecb9b5ee9d7eef5f36, user_id=d1095c78e64e46288c0c8696e6d815dd, role_id=610824e4f50f4fb8954610e98c1de784)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:53.364019 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b80f8e-c60e-4a23-87c0-1e34f2b270d7 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:53.370542 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df925fd3-66d6-4b50-8f54-fc80e6eb8c02 tempest-VolumeQuotaClassesTest-2107814076 tempest-VolumeQuotaClassesTest-2107814076-project-admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:53.377411 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce2d81a-a161-45e7-a27f-0f7d89c62b5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:53.378642 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce2d81a-a161-45e7-a27f-0f7d89c62b5e admin admin] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:53.378990 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce2d81a-a161-45e7-a27f-0f7d89c62b5e admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:53.379269 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce2d81a-a161-45e7-a27f-0f7d89c62b5e admin admin] PATH_INFO: `/v3/users` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:53.380029 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce2d81a-a161-45e7-a27f-0f7d89c62b5e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:53.381693 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 910/1822] 10.222.0.58 () {60 vars in 1482 bytes} [Tue Oct 12 16:49:53 2021] PUT /identity/v3/projects/44727a644beb46ecb9b5ee9d7eef5f36/users/d1095c78e64e46288c0c8696e6d815dd/roles/610824e4f50f4fb8954610e98c1de784 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:49:53.385470 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce2d81a-a161-45e7-a27f-0f7d89c62b5e admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:53.386268 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b80f8e-c60e-4a23-87c0-1e34f2b270d7 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:53.413598 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 913/1823] 10.222.0.58 () {60 vars in 1143 bytes} [Tue Oct 12 16:49:53 2021] POST /identity/v3/users => generated 293 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:49:53.414714 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce2d81a-a161-45e7-a27f-0f7d89c62b5e admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:53.438104 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce2d81a-a161-45e7-a27f-0f7d89c62b5e admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:53.459736 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b80f8e-c60e-4a23-87c0-1e34f2b270d7 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:53.469582 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488917f7-4b4f-453e-a03b-55a85cd69dc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:53.469582 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488917f7-4b4f-453e-a03b-55a85cd69dc9 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:53.469582 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488917f7-4b4f-453e-a03b-55a85cd69dc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:53.469582 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488917f7-4b4f-453e-a03b-55a85cd69dc9 admin admin] PATH_INFO: `/v3/roles` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:53.469931 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488917f7-4b4f-453e-a03b-55a85cd69dc9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:53.481351 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488917f7-4b4f-453e-a03b-55a85cd69dc9 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:53.493376 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 911/1824] 10.222.0.58 () {58 vars in 1121 bytes} [Tue Oct 12 16:49:53 2021] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 16:49:53.494344 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488917f7-4b4f-453e-a03b-55a85cd69dc9 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:53.505282 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488917f7-4b4f-453e-a03b-55a85cd69dc9 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:53.512163 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bdbdc5-5e82-4f38-b535-7ab5d6271f33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:53.513264 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bdbdc5-5e82-4f38-b535-7ab5d6271f33 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:53.513558 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bdbdc5-5e82-4f38-b535-7ab5d6271f33 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:53.514207 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bdbdc5-5e82-4f38-b535-7ab5d6271f33 admin admin] PATH_INFO: `/v3/roles` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:53.515243 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bdbdc5-5e82-4f38-b535-7ab5d6271f33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:53.517614 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bdbdc5-5e82-4f38-b535-7ab5d6271f33 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:53.527210 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553a4feb-340d-49dd-be88-27ccd3ad4e1f tempest-VolumeQuotaClassesTest-2107814076 tempest-VolumeQuotaClassesTest-2107814076-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c980c3afe574f15a5bfe8c75718060b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aee69bc40a54329b859a4cbb5b7a6bf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:53.528436 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553a4feb-340d-49dd-be88-27ccd3ad4e1f tempest-VolumeQuotaClassesTest-2107814076 tempest-VolumeQuotaClassesTest-2107814076-project-admin] REQUEST_METHOD: `DELETE` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:53.528436 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553a4feb-340d-49dd-be88-27ccd3ad4e1f tempest-VolumeQuotaClassesTest-2107814076 tempest-VolumeQuotaClassesTest-2107814076-project-admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:53.528705 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553a4feb-340d-49dd-be88-27ccd3ad4e1f tempest-VolumeQuotaClassesTest-2107814076 tempest-VolumeQuotaClassesTest-2107814076-project-admin] PATH_INFO: `/v3/projects/3f18ec63779c4099a4a3a9109f3753b7` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:53.532990 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553a4feb-340d-49dd-be88-27ccd3ad4e1f tempest-VolumeQuotaClassesTest-2107814076 tempest-VolumeQuotaClassesTest-2107814076-project-admin] RBAC: Authorizing `identity:delete_project(project_id=3f18ec63779c4099a4a3a9109f3753b7)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:53.533129 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 912/1825] 10.222.0.58 () {58 vars in 1121 bytes} [Tue Oct 12 16:49:53 2021] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:49:53.533129 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bdbdc5-5e82-4f38-b535-7ab5d6271f33 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:53.533293 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553a4feb-340d-49dd-be88-27ccd3ad4e1f tempest-VolumeQuotaClassesTest-2107814076 tempest-VolumeQuotaClassesTest-2107814076-project-admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:53.550572 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bdbdc5-5e82-4f38-b535-7ab5d6271f33 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:53.556737 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e0e32d-c235-44a1-b075-93bcf750fd06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:53.557714 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e0e32d-c235-44a1-b075-93bcf750fd06 admin admin] REQUEST_METHOD: `PUT` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:53.558010 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e0e32d-c235-44a1-b075-93bcf750fd06 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:53.558289 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e0e32d-c235-44a1-b075-93bcf750fd06 admin admin] PATH_INFO: `/v3/projects/44727a644beb46ecb9b5ee9d7eef5f36/users/d1095c78e64e46288c0c8696e6d815dd/roles/610824e4f50f4fb8954610e98c1de784` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:53.560375 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e0e32d-c235-44a1-b075-93bcf750fd06 admin admin] RBAC: Authorizing `identity:create_grant(project_id=44727a644beb46ecb9b5ee9d7eef5f36, user_id=d1095c78e64e46288c0c8696e6d815dd, role_id=610824e4f50f4fb8954610e98c1de784)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:53.564412 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e0e32d-c235-44a1-b075-93bcf750fd06 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:53.578383 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 913/1826] 10.222.0.58 () {60 vars in 1482 bytes} [Tue Oct 12 16:49:53 2021] PUT /identity/v3/projects/44727a644beb46ecb9b5ee9d7eef5f36/users/d1095c78e64e46288c0c8696e6d815dd/roles/610824e4f50f4fb8954610e98c1de784 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:49:53.586171 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e0e32d-c235-44a1-b075-93bcf750fd06 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:53.627244 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-553a4feb-340d-49dd-be88-27ccd3ad4e1f tempest-VolumeQuotaClassesTest-2107814076 tempest-VolumeQuotaClassesTest-2107814076-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f18ec63779c4099a4a3a9109f3753b7', 'request_id': 'req-553a4feb-340d-49dd-be88-27ccd3ad4e1f'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:53.639255 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-553a4feb-340d-49dd-be88-27ccd3ad4e1f tempest-VolumeQuotaClassesTest-2107814076 tempest-VolumeQuotaClassesTest-2107814076-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f18ec63779c4099a4a3a9109f3753b7', 'request_id': 'req-553a4feb-340d-49dd-be88-27ccd3ad4e1f'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:53.648775 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-553a4feb-340d-49dd-be88-27ccd3ad4e1f tempest-VolumeQuotaClassesTest-2107814076 tempest-VolumeQuotaClassesTest-2107814076-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f18ec63779c4099a4a3a9109f3753b7', 'request_id': 'req-553a4feb-340d-49dd-be88-27ccd3ad4e1f'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:53.662671 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e0e32d-c235-44a1-b075-93bcf750fd06 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:53.666843 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-553a4feb-340d-49dd-be88-27ccd3ad4e1f tempest-VolumeQuotaClassesTest-2107814076 tempest-VolumeQuotaClassesTest-2107814076-project-admin] The token cache is being invalidate because project 3f18ec63779c4099a4a3a9109f3753b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=85205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 16:49:53.667234 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-553a4feb-340d-49dd-be88-27ccd3ad4e1f tempest-VolumeQuotaClassesTest-2107814076 tempest-VolumeQuotaClassesTest-2107814076-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:53.668243 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-553a4feb-340d-49dd-be88-27ccd3ad4e1f tempest-VolumeQuotaClassesTest-2107814076 tempest-VolumeQuotaClassesTest-2107814076-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:53.670845 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 914/1827] 10.222.0.58 () {58 vars in 1232 bytes} [Tue Oct 12 16:49:53 2021] DELETE /identity/v3/projects/3f18ec63779c4099a4a3a9109f3753b7 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:49:53.675470 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57c4dca-9a7c-47e8-9c29-ffe1e980f107 None None] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:53.675770 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57c4dca-9a7c-47e8-9c29-ffe1e980f107 None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:53.676134 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57c4dca-9a7c-47e8-9c29-ffe1e980f107 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:53.714710 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.auth.core [None req-f57c4dca-9a7c-47e8-9c29-ffe1e980f107 None None] MFA Rules not processed for user `d1095c78e64e46288c0c8696e6d815dd`. Rule list: `[]` (Enabled: `True`). {{(pid=85205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:49:53.719619 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-f57c4dca-9a7c-47e8-9c29-ffe1e980f107 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:49:53.848959 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 915/1828] 10.222.0.58 () {58 vars in 957 bytes} [Tue Oct 12 16:49:53 2021] POST /identity/v3/auth/tokens => generated 3464 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:49:53.872720 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57c4dca-9a7c-47e8-9c29-ffe1e980f107 None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:53.873025 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-f57c4dca-9a7c-47e8-9c29-ffe1e980f107 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:49:53.903860 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dbc623-f4cd-498b-8cfd-7c9a451c66ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:53.905673 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dbc623-f4cd-498b-8cfd-7c9a451c66ce admin admin] REQUEST_METHOD: `PUT` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:53.906779 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dbc623-f4cd-498b-8cfd-7c9a451c66ce admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:53.906779 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dbc623-f4cd-498b-8cfd-7c9a451c66ce admin admin] PATH_INFO: `/v3/projects/25131265631443899dd42a730bd458e9/users/bce67bd3bb804e0a8b5e5663b0d2a638/roles/610824e4f50f4fb8954610e98c1de784` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:53.951905 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70dbc623-f4cd-498b-8cfd-7c9a451c66ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=25131265631443899dd42a730bd458e9, user_id=bce67bd3bb804e0a8b5e5663b0d2a638, role_id=610824e4f50f4fb8954610e98c1de784)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:53.954913 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57c4dca-9a7c-47e8-9c29-ffe1e980f107 None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:53.960283 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70dbc623-f4cd-498b-8cfd-7c9a451c66ce admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:53.961086 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ee6fd2-c544-4da9-893d-716bb1095f29 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04704222b3d64a33a6c092fc641ccbb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:53.963019 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ee6fd2-c544-4da9-893d-716bb1095f29 service cinder] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:53.963326 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ee6fd2-c544-4da9-893d-716bb1095f29 service cinder] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:53.963620 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ee6fd2-c544-4da9-893d-716bb1095f29 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:53.972525 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-22ee6fd2-c544-4da9-893d-716bb1095f29 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:49:54.001592 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 914/1829] 10.222.0.58 () {60 vars in 1482 bytes} [Tue Oct 12 16:49:53 2021] PUT /identity/v3/projects/25131265631443899dd42a730bd458e9/users/bce67bd3bb804e0a8b5e5663b0d2a638/roles/610824e4f50f4fb8954610e98c1de784 => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:49:54.018984 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dbc623-f4cd-498b-8cfd-7c9a451c66ce admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:54.024101 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-70dbc623-f4cd-498b-8cfd-7c9a451c66ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:49:54.073307 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ee6fd2-c544-4da9-893d-716bb1095f29 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:54.076250 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ee6fd2-c544-4da9-893d-716bb1095f29 service cinder] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:54.092102 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 916/1830] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Oct 12 16:49:53 2021] GET /identity/v3/auth/tokens => generated 3395 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:49:54.127534 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dbc623-f4cd-498b-8cfd-7c9a451c66ce admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:54.151997 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c012d4-a4fd-42de-8e04-a9a4c4bc4814 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:54.152687 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ee6fd2-c544-4da9-893d-716bb1095f29 service cinder] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:54.152962 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c012d4-a4fd-42de-8e04-a9a4c4bc4814 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:54.153299 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c012d4-a4fd-42de-8e04-a9a4c4bc4814 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:54.153505 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c012d4-a4fd-42de-8e04-a9a4c4bc4814 admin admin] PATH_INFO: `/v3/roles` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:54.154140 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-22ee6fd2-c544-4da9-893d-716bb1095f29 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:49:54.154539 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c012d4-a4fd-42de-8e04-a9a4c4bc4814 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:54.157424 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c012d4-a4fd-42de-8e04-a9a4c4bc4814 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:54.170393 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 915/1831] 10.222.0.58 () {58 vars in 1121 bytes} [Tue Oct 12 16:49:54 2021] GET /identity/v3/roles => generated 1420 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:49:54.177562 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c012d4-a4fd-42de-8e04-a9a4c4bc4814 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:54.191117 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ee6fd2-c544-4da9-893d-716bb1095f29 service cinder] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:54.201986 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c012d4-a4fd-42de-8e04-a9a4c4bc4814 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:54.202771 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb700f4-b16e-4d38-a242-78e4482278b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:54.206703 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb700f4-b16e-4d38-a242-78e4482278b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:54.207022 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb700f4-b16e-4d38-a242-78e4482278b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:54.207337 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb700f4-b16e-4d38-a242-78e4482278b3 admin admin] PATH_INFO: `/v3/users/6a0bbaf88965464f897f92965a463530` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:54.209086 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb700f4-b16e-4d38-a242-78e4482278b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a0bbaf88965464f897f92965a463530)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:54.211219 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb700f4-b16e-4d38-a242-78e4482278b3 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:54.216866 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70b936a-6973-4481-8b2b-601bf65bbb3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:54.220650 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70b936a-6973-4481-8b2b-601bf65bbb3b admin admin] REQUEST_METHOD: `PUT` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:54.220945 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70b936a-6973-4481-8b2b-601bf65bbb3b admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:54.221228 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70b936a-6973-4481-8b2b-601bf65bbb3b admin admin] PATH_INFO: `/v3/projects/25131265631443899dd42a730bd458e9/users/bce67bd3bb804e0a8b5e5663b0d2a638/roles/610824e4f50f4fb8954610e98c1de784` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:54.224769 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70b936a-6973-4481-8b2b-601bf65bbb3b admin admin] RBAC: Authorizing `identity:create_grant(project_id=25131265631443899dd42a730bd458e9, user_id=bce67bd3bb804e0a8b5e5663b0d2a638, role_id=610824e4f50f4fb8954610e98c1de784)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:54.228451 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70b936a-6973-4481-8b2b-601bf65bbb3b admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:54.246296 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 916/1832] 10.222.0.58 () {60 vars in 1482 bytes} [Tue Oct 12 16:49:54 2021] PUT /identity/v3/projects/25131265631443899dd42a730bd458e9/users/bce67bd3bb804e0a8b5e5663b0d2a638/roles/610824e4f50f4fb8954610e98c1de784 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:49:54.260227 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb103191-fa27-4434-bc41-fea6a61b8a12 None None] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:54.260625 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb103191-fa27-4434-bc41-fea6a61b8a12 None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:54.260968 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb103191-fa27-4434-bc41-fea6a61b8a12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:54.305627 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-1cb700f4-b16e-4d38-a242-78e4482278b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a0bbaf88965464f897f92965a463530'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:54.324904 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.auth.core [None req-cb103191-fa27-4434-bc41-fea6a61b8a12 None None] MFA Rules not processed for user `bce67bd3bb804e0a8b5e5663b0d2a638`. Rule list: `[]` (Enabled: `True`). {{(pid=85204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:49:54.326209 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-cb103191-fa27-4434-bc41-fea6a61b8a12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:49:54.338416 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-1cb700f4-b16e-4d38-a242-78e4482278b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a0bbaf88965464f897f92965a463530'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:54.355282 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-1cb700f4-b16e-4d38-a242-78e4482278b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a0bbaf88965464f897f92965a463530'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:54.381108 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-1cb700f4-b16e-4d38-a242-78e4482278b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a0bbaf88965464f897f92965a463530'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:54.382406 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-1cb700f4-b16e-4d38-a242-78e4482278b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a0bbaf88965464f897f92965a463530'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:54.397606 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 917/1833] 10.222.0.58 () {58 vars in 1223 bytes} [Tue Oct 12 16:49:54 2021] DELETE /identity/v3/users/6a0bbaf88965464f897f92965a463530 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:49:54.402120 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e4a15a-55d8-45ad-8016-b295efb7489b None None] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:54.402588 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e4a15a-55d8-45ad-8016-b295efb7489b None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:54.408844 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e4a15a-55d8-45ad-8016-b295efb7489b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:54.444590 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.auth.core [None req-d9e4a15a-55d8-45ad-8016-b295efb7489b None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:49:54.446049 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-d9e4a15a-55d8-45ad-8016-b295efb7489b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:49:54.524143 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 917/1834] 10.222.0.58 () {58 vars in 957 bytes} [Tue Oct 12 16:49:54 2021] POST /identity/v3/auth/tokens => generated 3460 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:49:54.548980 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb103191-fa27-4434-bc41-fea6a61b8a12 None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:54.550643 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-cb103191-fa27-4434-bc41-fea6a61b8a12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:49:54.605409 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 918/1835] 10.222.0.58 () {58 vars in 957 bytes} [Tue Oct 12 16:49:54 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:49:54.620058 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e4a15a-55d8-45ad-8016-b295efb7489b None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:54.620264 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb103191-fa27-4434-bc41-fea6a61b8a12 None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:54.621739 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-d9e4a15a-55d8-45ad-8016-b295efb7489b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:49:54.675005 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9851554-6dc4-4b97-9bd7-0d6b86af12e0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04704222b3d64a33a6c092fc641ccbb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:54.675670 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9851554-6dc4-4b97-9bd7-0d6b86af12e0 service cinder] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:54.675959 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9851554-6dc4-4b97-9bd7-0d6b86af12e0 service cinder] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:54.676238 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9851554-6dc4-4b97-9bd7-0d6b86af12e0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:54.678237 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-d9851554-6dc4-4b97-9bd7-0d6b86af12e0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:49:54.707291 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e4a15a-55d8-45ad-8016-b295efb7489b None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:54.712242 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db40d861-0c02-466f-9cc5-5a5753ef045a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e65f6d0598e4c539134292b86fb43d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:54.712915 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db40d861-0c02-466f-9cc5-5a5753ef045a service neutron] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:54.713418 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db40d861-0c02-466f-9cc5-5a5753ef045a service neutron] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:54.713687 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db40d861-0c02-466f-9cc5-5a5753ef045a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:54.724269 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db40d861-0c02-466f-9cc5-5a5753ef045a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:54.726269 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db40d861-0c02-466f-9cc5-5a5753ef045a service neutron] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:54.736129 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 919/1836] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Oct 12 16:49:54 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:49:54.739880 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9851554-6dc4-4b97-9bd7-0d6b86af12e0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:54.741708 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9851554-6dc4-4b97-9bd7-0d6b86af12e0 service cinder] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:54.758120 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 918/1837] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Oct 12 16:49:54 2021] GET /identity/v3/auth/tokens => generated 3395 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:49:55.019425 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db40d861-0c02-466f-9cc5-5a5753ef045a service neutron] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:55.022160 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-db40d861-0c02-466f-9cc5-5a5753ef045a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:49:55.055058 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db40d861-0c02-466f-9cc5-5a5753ef045a service neutron] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:55.066799 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31c4e3e-267d-490d-9cf7-944add8184a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:55.067678 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31c4e3e-267d-490d-9cf7-944add8184a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:55.067968 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31c4e3e-267d-490d-9cf7-944add8184a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:55.068254 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31c4e3e-267d-490d-9cf7-944add8184a6 admin admin] PATH_INFO: `/v3/projects/2ab070d081a2475896a55d3175de2b70` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:55.069494 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31c4e3e-267d-490d-9cf7-944add8184a6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ab070d081a2475896a55d3175de2b70)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:55.071439 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31c4e3e-267d-490d-9cf7-944add8184a6 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:55.118909 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-a31c4e3e-267d-490d-9cf7-944add8184a6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ab070d081a2475896a55d3175de2b70', 'request_id': 'req-a31c4e3e-267d-490d-9cf7-944add8184a6'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:55.124328 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-a31c4e3e-267d-490d-9cf7-944add8184a6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ab070d081a2475896a55d3175de2b70', 'request_id': 'req-a31c4e3e-267d-490d-9cf7-944add8184a6'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:55.130426 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-a31c4e3e-267d-490d-9cf7-944add8184a6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ab070d081a2475896a55d3175de2b70', 'request_id': 'req-a31c4e3e-267d-490d-9cf7-944add8184a6'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:55.143766 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-a31c4e3e-267d-490d-9cf7-944add8184a6 admin admin] The token cache is being invalidate because project 2ab070d081a2475896a55d3175de2b70 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=85205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 16:49:55.144344 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-a31c4e3e-267d-490d-9cf7-944add8184a6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:55.144701 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-a31c4e3e-267d-490d-9cf7-944add8184a6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:55.147203 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 920/1838] 10.222.0.58 () {58 vars in 1232 bytes} [Tue Oct 12 16:49:55 2021] DELETE /identity/v3/projects/2ab070d081a2475896a55d3175de2b70 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:49:55.151351 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9851554-6dc4-4b97-9bd7-0d6b86af12e0 service cinder] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:55.164166 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9851554-6dc4-4b97-9bd7-0d6b86af12e0 service cinder] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:55.226341 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8009fa56-e09a-44d7-93b1-cae7aa85b2ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:55.227294 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8009fa56-e09a-44d7-93b1-cae7aa85b2ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:55.227707 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8009fa56-e09a-44d7-93b1-cae7aa85b2ec admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:55.227826 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8009fa56-e09a-44d7-93b1-cae7aa85b2ec admin admin] PATH_INFO: `/v3/users/3c980c3afe574f15a5bfe8c75718060b` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:55.229003 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8009fa56-e09a-44d7-93b1-cae7aa85b2ec admin admin] RBAC: Authorizing `identity:delete_user(user_id=3c980c3afe574f15a5bfe8c75718060b)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:55.230962 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8009fa56-e09a-44d7-93b1-cae7aa85b2ec admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:55.291883 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-8009fa56-e09a-44d7-93b1-cae7aa85b2ec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3c980c3afe574f15a5bfe8c75718060b'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:55.305094 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-8009fa56-e09a-44d7-93b1-cae7aa85b2ec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3c980c3afe574f15a5bfe8c75718060b'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:55.312225 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-8009fa56-e09a-44d7-93b1-cae7aa85b2ec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3c980c3afe574f15a5bfe8c75718060b'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:55.320738 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-8009fa56-e09a-44d7-93b1-cae7aa85b2ec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3c980c3afe574f15a5bfe8c75718060b'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:55.321355 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-8009fa56-e09a-44d7-93b1-cae7aa85b2ec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3c980c3afe574f15a5bfe8c75718060b'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:55.328503 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 919/1839] 10.222.0.58 () {58 vars in 1223 bytes} [Tue Oct 12 16:49:55 2021] DELETE /identity/v3/users/3c980c3afe574f15a5bfe8c75718060b => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:49:55.769390 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31c4e3e-267d-490d-9cf7-944add8184a6 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:55.770898 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-a31c4e3e-267d-490d-9cf7-944add8184a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:49:55.789843 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31c4e3e-267d-490d-9cf7-944add8184a6 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:55.884748 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4681b1a-ae1a-4aff-9250-6c00bad7be65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:55.886180 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4681b1a-ae1a-4aff-9250-6c00bad7be65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:55.886656 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4681b1a-ae1a-4aff-9250-6c00bad7be65 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:55.887228 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4681b1a-ae1a-4aff-9250-6c00bad7be65 admin admin] PATH_INFO: `/v3/projects/0aee69bc40a54329b859a4cbb5b7a6bf` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:55.888825 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4681b1a-ae1a-4aff-9250-6c00bad7be65 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0aee69bc40a54329b859a4cbb5b7a6bf)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:55.891207 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4681b1a-ae1a-4aff-9250-6c00bad7be65 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:55.954081 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-e4681b1a-ae1a-4aff-9250-6c00bad7be65 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0aee69bc40a54329b859a4cbb5b7a6bf', 'request_id': 'req-e4681b1a-ae1a-4aff-9250-6c00bad7be65'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:55.965229 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-e4681b1a-ae1a-4aff-9250-6c00bad7be65 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0aee69bc40a54329b859a4cbb5b7a6bf', 'request_id': 'req-e4681b1a-ae1a-4aff-9250-6c00bad7be65'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:55.979418 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-e4681b1a-ae1a-4aff-9250-6c00bad7be65 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0aee69bc40a54329b859a4cbb5b7a6bf', 'request_id': 'req-e4681b1a-ae1a-4aff-9250-6c00bad7be65'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:56.008718 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-e4681b1a-ae1a-4aff-9250-6c00bad7be65 admin admin] The token cache is being invalidate because project 0aee69bc40a54329b859a4cbb5b7a6bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=85205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 16:49:56.009054 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-e4681b1a-ae1a-4aff-9250-6c00bad7be65 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:56.009868 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-e4681b1a-ae1a-4aff-9250-6c00bad7be65 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:56.011688 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 921/1840] 10.222.0.58 () {58 vars in 1232 bytes} [Tue Oct 12 16:49:55 2021] DELETE /identity/v3/projects/0aee69bc40a54329b859a4cbb5b7a6bf => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:49:56.017530 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701c91c9-f1b2-43fc-930b-26f3d2f09f11 None None] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:56.018242 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701c91c9-f1b2-43fc-930b-26f3d2f09f11 None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:56.018535 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701c91c9-f1b2-43fc-930b-26f3d2f09f11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:56.039530 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.auth.core [None req-701c91c9-f1b2-43fc-930b-26f3d2f09f11 None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:49:56.040791 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-701c91c9-f1b2-43fc-930b-26f3d2f09f11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:49:56.113040 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 920/1841] 10.222.0.58 () {58 vars in 957 bytes} [Tue Oct 12 16:49:56 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:49:56.121251 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f475f9e-0f02-4b3a-aaa5-daa6cccc9723 None None] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:56.121545 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f475f9e-0f02-4b3a-aaa5-daa6cccc9723 None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:56.121853 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f475f9e-0f02-4b3a-aaa5-daa6cccc9723 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:56.145234 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.auth.core [None req-8f475f9e-0f02-4b3a-aaa5-daa6cccc9723 None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:49:56.146515 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-8f475f9e-0f02-4b3a-aaa5-daa6cccc9723 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:49:56.155280 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 922/1842] 10.222.0.58 () {58 vars in 957 bytes} [Tue Oct 12 16:49:56 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:49:56.159622 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701c91c9-f1b2-43fc-930b-26f3d2f09f11 None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:56.170418 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701c91c9-f1b2-43fc-930b-26f3d2f09f11 None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:56.175112 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643a523f-404d-45d2-89d5-a0295684a169 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:56.175774 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643a523f-404d-45d2-89d5-a0295684a169 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:56.176062 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643a523f-404d-45d2-89d5-a0295684a169 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:56.176337 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643a523f-404d-45d2-89d5-a0295684a169 admin admin] PATH_INFO: `/v3/domains` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:56.177076 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643a523f-404d-45d2-89d5-a0295684a169 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:49:56.177386 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643a523f-404d-45d2-89d5-a0295684a169 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:56.179114 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643a523f-404d-45d2-89d5-a0295684a169 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:56.192265 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 921/1843] 10.222.0.58 () {58 vars in 1152 bytes} [Tue Oct 12 16:49:56 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:49:56.196849 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f475f9e-0f02-4b3a-aaa5-daa6cccc9723 None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:56.206333 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f475f9e-0f02-4b3a-aaa5-daa6cccc9723 None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:56.212706 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bbc3b0-17fa-4599-9376-c78375670f15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:56.213332 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bbc3b0-17fa-4599-9376-c78375670f15 admin admin] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:56.214022 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bbc3b0-17fa-4599-9376-c78375670f15 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:56.214527 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bbc3b0-17fa-4599-9376-c78375670f15 admin admin] PATH_INFO: `/v3/projects` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:56.215343 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bbc3b0-17fa-4599-9376-c78375670f15 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:56.217384 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bbc3b0-17fa-4599-9376-c78375670f15 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:56.247331 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 923/1844] 10.222.0.58 () {60 vars in 1152 bytes} [Tue Oct 12 16:49:56 2021] POST /identity/v3/projects => generated 387 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:49:56.252848 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643a523f-404d-45d2-89d5-a0295684a169 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:56.266274 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643a523f-404d-45d2-89d5-a0295684a169 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:56.326311 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d42b140-154f-49e7-a987-1a63968ebb85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:56.326996 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d42b140-154f-49e7-a987-1a63968ebb85 admin admin] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:56.327285 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d42b140-154f-49e7-a987-1a63968ebb85 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:56.327566 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d42b140-154f-49e7-a987-1a63968ebb85 admin admin] PATH_INFO: `/v3/users` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:56.328276 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d42b140-154f-49e7-a987-1a63968ebb85 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:56.330380 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d42b140-154f-49e7-a987-1a63968ebb85 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:56.354803 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 922/1845] 10.222.0.58 () {60 vars in 1143 bytes} [Tue Oct 12 16:49:56 2021] POST /identity/v3/users => generated 294 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:49:56.356013 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bbc3b0-17fa-4599-9376-c78375670f15 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:56.366228 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bbc3b0-17fa-4599-9376-c78375670f15 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:56.371192 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63caa7f7-2474-48f1-bcb7-c44a354def84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:56.371854 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63caa7f7-2474-48f1-bcb7-c44a354def84 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:56.372136 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63caa7f7-2474-48f1-bcb7-c44a354def84 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:56.372746 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63caa7f7-2474-48f1-bcb7-c44a354def84 admin admin] PATH_INFO: `/v3/roles` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:56.373134 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63caa7f7-2474-48f1-bcb7-c44a354def84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:56.374724 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63caa7f7-2474-48f1-bcb7-c44a354def84 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:56.389452 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 924/1846] 10.222.0.58 () {58 vars in 1121 bytes} [Tue Oct 12 16:49:56 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:49:56.390708 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d42b140-154f-49e7-a987-1a63968ebb85 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:56.401585 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d42b140-154f-49e7-a987-1a63968ebb85 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:56.406647 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41094302-bba0-4834-86ba-e690963eb240 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:56.407312 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41094302-bba0-4834-86ba-e690963eb240 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:56.407596 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41094302-bba0-4834-86ba-e690963eb240 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:56.407867 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41094302-bba0-4834-86ba-e690963eb240 admin admin] PATH_INFO: `/v3/roles` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:56.408603 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41094302-bba0-4834-86ba-e690963eb240 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:56.410218 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41094302-bba0-4834-86ba-e690963eb240 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:56.423434 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 923/1847] 10.222.0.58 () {58 vars in 1121 bytes} [Tue Oct 12 16:49:56 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:49:56.424646 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63caa7f7-2474-48f1-bcb7-c44a354def84 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:56.435021 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63caa7f7-2474-48f1-bcb7-c44a354def84 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:56.440171 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2659e4-ff19-4126-ae19-715191ba7a32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:56.441109 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2659e4-ff19-4126-ae19-715191ba7a32 admin admin] REQUEST_METHOD: `PUT` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:56.441389 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2659e4-ff19-4126-ae19-715191ba7a32 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:56.441664 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2659e4-ff19-4126-ae19-715191ba7a32 admin admin] PATH_INFO: `/v3/projects/6072ad99404a417899492cc8063172e3/users/585b92a5b9a14b4d852e8b4eb9341d75/roles/55ba49fe29884e64b57c3ad13188d554` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:56.458246 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2659e4-ff19-4126-ae19-715191ba7a32 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6072ad99404a417899492cc8063172e3, user_id=585b92a5b9a14b4d852e8b4eb9341d75, role_id=55ba49fe29884e64b57c3ad13188d554)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:56.461549 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2659e4-ff19-4126-ae19-715191ba7a32 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:56.474322 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 925/1848] 10.222.0.58 () {60 vars in 1482 bytes} [Tue Oct 12 16:49:56 2021] PUT /identity/v3/projects/6072ad99404a417899492cc8063172e3/users/585b92a5b9a14b4d852e8b4eb9341d75/roles/55ba49fe29884e64b57c3ad13188d554 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:49:56.485860 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7c2632-df9e-4e78-9123-12e0c6336902 None None] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:56.486177 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7c2632-df9e-4e78-9123-12e0c6336902 None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:56.486768 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7c2632-df9e-4e78-9123-12e0c6336902 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:56.519998 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.auth.core [None req-3c7c2632-df9e-4e78-9123-12e0c6336902 None None] MFA Rules not processed for user `585b92a5b9a14b4d852e8b4eb9341d75`. Rule list: `[]` (Enabled: `True`). {{(pid=85204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:49:56.521200 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-3c7c2632-df9e-4e78-9123-12e0c6336902 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:49:56.588523 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 924/1849] 10.222.0.58 () {58 vars in 957 bytes} [Tue Oct 12 16:49:56 2021] POST /identity/v3/auth/tokens => generated 3407 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:49:56.593100 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2659e4-ff19-4126-ae19-715191ba7a32 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:56.654318 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2659e4-ff19-4126-ae19-715191ba7a32 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:56.658981 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d7f4d9-4148-423c-8731-d291de2bdf38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:56.659638 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d7f4d9-4148-423c-8731-d291de2bdf38 admin admin] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:56.659920 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d7f4d9-4148-423c-8731-d291de2bdf38 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:56.660191 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d7f4d9-4148-423c-8731-d291de2bdf38 admin admin] PATH_INFO: `/v3/projects` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:56.660895 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d7f4d9-4148-423c-8731-d291de2bdf38 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:56.662839 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d7f4d9-4148-423c-8731-d291de2bdf38 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:56.687246 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 926/1850] 10.222.0.58 () {60 vars in 1152 bytes} [Tue Oct 12 16:49:56 2021] POST /identity/v3/projects => generated 387 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 16:49:56.691212 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7c2632-df9e-4e78-9123-12e0c6336902 None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:56.702062 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7c2632-df9e-4e78-9123-12e0c6336902 None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:56.754841 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5fd746-69ab-4132-bc28-71e9e4c9c085 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:56.755439 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5fd746-69ab-4132-bc28-71e9e4c9c085 admin admin] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:56.755721 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5fd746-69ab-4132-bc28-71e9e4c9c085 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:56.755995 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5fd746-69ab-4132-bc28-71e9e4c9c085 admin admin] PATH_INFO: `/v3/users` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:56.756758 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5fd746-69ab-4132-bc28-71e9e4c9c085 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:56.759248 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5fd746-69ab-4132-bc28-71e9e4c9c085 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:56.778346 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 925/1851] 10.222.0.58 () {60 vars in 1143 bytes} [Tue Oct 12 16:49:56 2021] POST /identity/v3/users => generated 294 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 16:49:56.782115 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d7f4d9-4148-423c-8731-d291de2bdf38 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:56.791931 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d7f4d9-4148-423c-8731-d291de2bdf38 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:56.796479 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481c4466-b878-4be7-8ce3-a2989d0f8ccc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:56.797145 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481c4466-b878-4be7-8ce3-a2989d0f8ccc admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:56.797429 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481c4466-b878-4be7-8ce3-a2989d0f8ccc admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:56.797705 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481c4466-b878-4be7-8ce3-a2989d0f8ccc admin admin] PATH_INFO: `/v3/roles` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:56.798470 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481c4466-b878-4be7-8ce3-a2989d0f8ccc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:56.800031 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481c4466-b878-4be7-8ce3-a2989d0f8ccc admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:56.811084 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 927/1852] 10.222.0.58 () {58 vars in 1121 bytes} [Tue Oct 12 16:49:56 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:49:56.815284 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5fd746-69ab-4132-bc28-71e9e4c9c085 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:56.825558 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5fd746-69ab-4132-bc28-71e9e4c9c085 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:56.830221 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a1a2f1-3044-44cd-865d-919631b7e2b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:56.830884 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a1a2f1-3044-44cd-865d-919631b7e2b6 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:56.831171 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a1a2f1-3044-44cd-865d-919631b7e2b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:56.831454 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a1a2f1-3044-44cd-865d-919631b7e2b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:56.832314 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a1a2f1-3044-44cd-865d-919631b7e2b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:56.834091 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a1a2f1-3044-44cd-865d-919631b7e2b6 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:56.844060 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 926/1853] 10.222.0.58 () {58 vars in 1121 bytes} [Tue Oct 12 16:49:56 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:49:56.848176 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481c4466-b878-4be7-8ce3-a2989d0f8ccc admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:56.857981 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481c4466-b878-4be7-8ce3-a2989d0f8ccc admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:56.862855 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2a6ec6-1924-4407-92e8-6a3e4ef5406f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:56.863740 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2a6ec6-1924-4407-92e8-6a3e4ef5406f admin admin] REQUEST_METHOD: `PUT` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:56.864027 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2a6ec6-1924-4407-92e8-6a3e4ef5406f admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:56.864306 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2a6ec6-1924-4407-92e8-6a3e4ef5406f admin admin] PATH_INFO: `/v3/projects/ca90605746d14c81835185a0f27023c9/users/bfd3014796044d3aa031ede4d3eeb6d8/roles/55ba49fe29884e64b57c3ad13188d554` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:56.880092 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2a6ec6-1924-4407-92e8-6a3e4ef5406f admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca90605746d14c81835185a0f27023c9, user_id=bfd3014796044d3aa031ede4d3eeb6d8, role_id=55ba49fe29884e64b57c3ad13188d554)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:56.883817 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2a6ec6-1924-4407-92e8-6a3e4ef5406f admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:56.897834 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 928/1854] 10.222.0.58 () {60 vars in 1482 bytes} [Tue Oct 12 16:49:56 2021] PUT /identity/v3/projects/ca90605746d14c81835185a0f27023c9/users/bfd3014796044d3aa031ede4d3eeb6d8/roles/55ba49fe29884e64b57c3ad13188d554 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:49:56.911125 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f666fc41-6ce9-4ba2-98ae-e2ec303a5d4f None None] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:56.911648 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f666fc41-6ce9-4ba2-98ae-e2ec303a5d4f None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:56.912209 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f666fc41-6ce9-4ba2-98ae-e2ec303a5d4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:56.942387 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.auth.core [None req-f666fc41-6ce9-4ba2-98ae-e2ec303a5d4f None None] MFA Rules not processed for user `bfd3014796044d3aa031ede4d3eeb6d8`. Rule list: `[]` (Enabled: `True`). {{(pid=85204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:49:56.943607 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-f666fc41-6ce9-4ba2-98ae-e2ec303a5d4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:49:57.006228 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 927/1855] 10.222.0.58 () {58 vars in 957 bytes} [Tue Oct 12 16:49:56 2021] POST /identity/v3/auth/tokens => generated 3407 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:49:57.011250 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2a6ec6-1924-4407-92e8-6a3e4ef5406f admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:57.086222 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2a6ec6-1924-4407-92e8-6a3e4ef5406f admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:57.093679 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d144da58-a53f-4abc-9f8f-b85cb90808ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:57.094394 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d144da58-a53f-4abc-9f8f-b85cb90808ca admin admin] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:57.094685 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d144da58-a53f-4abc-9f8f-b85cb90808ca admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:57.095201 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d144da58-a53f-4abc-9f8f-b85cb90808ca admin admin] PATH_INFO: `/v3/projects` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:57.096029 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d144da58-a53f-4abc-9f8f-b85cb90808ca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:57.097944 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d144da58-a53f-4abc-9f8f-b85cb90808ca admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:57.130162 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 929/1856] 10.222.0.58 () {60 vars in 1152 bytes} [Tue Oct 12 16:49:57 2021] POST /identity/v3/projects => generated 385 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:49:57.131330 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f666fc41-6ce9-4ba2-98ae-e2ec303a5d4f None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:57.144607 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f666fc41-6ce9-4ba2-98ae-e2ec303a5d4f None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:57.206052 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3479afb-8ca7-4646-a5a6-0c04c22ac4cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:57.206815 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3479afb-8ca7-4646-a5a6-0c04c22ac4cb admin admin] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:57.207327 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3479afb-8ca7-4646-a5a6-0c04c22ac4cb admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:57.207622 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3479afb-8ca7-4646-a5a6-0c04c22ac4cb admin admin] PATH_INFO: `/v3/users` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:57.208368 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3479afb-8ca7-4646-a5a6-0c04c22ac4cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:57.210323 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3479afb-8ca7-4646-a5a6-0c04c22ac4cb admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:57.233085 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 928/1857] 10.222.0.58 () {60 vars in 1143 bytes} [Tue Oct 12 16:49:57 2021] POST /identity/v3/users => generated 299 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 16:49:57.237988 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d144da58-a53f-4abc-9f8f-b85cb90808ca admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:57.250659 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d144da58-a53f-4abc-9f8f-b85cb90808ca admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:57.255175 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15720e80-eb85-4f7b-9e15-0679b8f982a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:57.255841 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15720e80-eb85-4f7b-9e15-0679b8f982a8 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:57.256126 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15720e80-eb85-4f7b-9e15-0679b8f982a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:57.256454 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15720e80-eb85-4f7b-9e15-0679b8f982a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:57.257214 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15720e80-eb85-4f7b-9e15-0679b8f982a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:57.258932 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15720e80-eb85-4f7b-9e15-0679b8f982a8 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:57.269807 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 930/1858] 10.222.0.58 () {58 vars in 1121 bytes} [Tue Oct 12 16:49:57 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:49:57.274545 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3479afb-8ca7-4646-a5a6-0c04c22ac4cb admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:57.285752 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3479afb-8ca7-4646-a5a6-0c04c22ac4cb admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:57.294080 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96771cad-5362-44ee-9d38-587bdd9ff062 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:57.295253 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96771cad-5362-44ee-9d38-587bdd9ff062 admin admin] REQUEST_METHOD: `PUT` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:57.295845 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96771cad-5362-44ee-9d38-587bdd9ff062 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:57.296425 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96771cad-5362-44ee-9d38-587bdd9ff062 admin admin] PATH_INFO: `/v3/projects/0e3c9abe184f43f988e77e2e16ee1357/users/f2f01d1fc5394c508e3f54b8a947cf8b/roles/610824e4f50f4fb8954610e98c1de784` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:57.318224 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96771cad-5362-44ee-9d38-587bdd9ff062 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e3c9abe184f43f988e77e2e16ee1357, user_id=f2f01d1fc5394c508e3f54b8a947cf8b, role_id=610824e4f50f4fb8954610e98c1de784)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:57.321191 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96771cad-5362-44ee-9d38-587bdd9ff062 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:57.336144 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 929/1859] 10.222.0.58 () {60 vars in 1482 bytes} [Tue Oct 12 16:49:57 2021] PUT /identity/v3/projects/0e3c9abe184f43f988e77e2e16ee1357/users/f2f01d1fc5394c508e3f54b8a947cf8b/roles/610824e4f50f4fb8954610e98c1de784 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:49:57.340778 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15720e80-eb85-4f7b-9e15-0679b8f982a8 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:57.355599 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15720e80-eb85-4f7b-9e15-0679b8f982a8 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:57.424188 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727bad87-a1ab-4a31-a73e-97f0f61d6452 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:57.424972 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727bad87-a1ab-4a31-a73e-97f0f61d6452 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:57.425270 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727bad87-a1ab-4a31-a73e-97f0f61d6452 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:57.425544 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727bad87-a1ab-4a31-a73e-97f0f61d6452 admin admin] PATH_INFO: `/v3/roles` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:57.426338 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727bad87-a1ab-4a31-a73e-97f0f61d6452 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:57.427929 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727bad87-a1ab-4a31-a73e-97f0f61d6452 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:57.438683 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 931/1860] 10.222.0.58 () {58 vars in 1121 bytes} [Tue Oct 12 16:49:57 2021] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:49:57.444026 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96771cad-5362-44ee-9d38-587bdd9ff062 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:57.455924 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96771cad-5362-44ee-9d38-587bdd9ff062 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:57.461749 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd5831a-8e8e-4f7c-bcfb-3512206ebda4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:57.462682 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd5831a-8e8e-4f7c-bcfb-3512206ebda4 admin admin] REQUEST_METHOD: `PUT` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:57.462971 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd5831a-8e8e-4f7c-bcfb-3512206ebda4 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:57.463254 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd5831a-8e8e-4f7c-bcfb-3512206ebda4 admin admin] PATH_INFO: `/v3/projects/0e3c9abe184f43f988e77e2e16ee1357/users/f2f01d1fc5394c508e3f54b8a947cf8b/roles/610824e4f50f4fb8954610e98c1de784` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:57.465304 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd5831a-8e8e-4f7c-bcfb-3512206ebda4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e3c9abe184f43f988e77e2e16ee1357, user_id=f2f01d1fc5394c508e3f54b8a947cf8b, role_id=610824e4f50f4fb8954610e98c1de784)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:57.468013 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd5831a-8e8e-4f7c-bcfb-3512206ebda4 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:57.478851 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 930/1861] 10.222.0.58 () {60 vars in 1482 bytes} [Tue Oct 12 16:49:57 2021] PUT /identity/v3/projects/0e3c9abe184f43f988e77e2e16ee1357/users/f2f01d1fc5394c508e3f54b8a947cf8b/roles/610824e4f50f4fb8954610e98c1de784 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:49:57.488913 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b74e3bf-b4c6-4e90-a3a6-a6edf9662bdd None None] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:57.489203 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b74e3bf-b4c6-4e90-a3a6-a6edf9662bdd None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:57.489482 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b74e3bf-b4c6-4e90-a3a6-a6edf9662bdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:57.516686 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.auth.core [None req-6b74e3bf-b4c6-4e90-a3a6-a6edf9662bdd None None] MFA Rules not processed for user `f2f01d1fc5394c508e3f54b8a947cf8b`. Rule list: `[]` (Enabled: `True`). {{(pid=85205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:49:57.517810 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-6b74e3bf-b4c6-4e90-a3a6-a6edf9662bdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:49:57.588630 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 932/1862] 10.222.0.58 () {58 vars in 957 bytes} [Tue Oct 12 16:49:57 2021] POST /identity/v3/auth/tokens => generated 3472 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:49:57.599352 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd5831a-8e8e-4f7c-bcfb-3512206ebda4 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:57.601771 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-cbd5831a-8e8e-4f7c-bcfb-3512206ebda4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:49:57.665942 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd5831a-8e8e-4f7c-bcfb-3512206ebda4 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:57.669670 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01522790-8853-40bb-bd95-b0d58c91fd15 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04704222b3d64a33a6c092fc641ccbb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:57.670244 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01522790-8853-40bb-bd95-b0d58c91fd15 service cinder] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:57.670530 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01522790-8853-40bb-bd95-b0d58c91fd15 service cinder] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:57.670805 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01522790-8853-40bb-bd95-b0d58c91fd15 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:57.680237 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01522790-8853-40bb-bd95-b0d58c91fd15 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:57.681674 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01522790-8853-40bb-bd95-b0d58c91fd15 service cinder] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:57.691342 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 931/1863] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Oct 12 16:49:57 2021] GET /identity/v3/auth/tokens => generated 3472 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:49:58.140524 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b74e3bf-b4c6-4e90-a3a6-a6edf9662bdd None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:58.150572 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b74e3bf-b4c6-4e90-a3a6-a6edf9662bdd None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:58.154278 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7add1c2a-33ec-45a5-85bf-9ad96e2f99f4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04704222b3d64a33a6c092fc641ccbb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:58.155068 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7add1c2a-33ec-45a5-85bf-9ad96e2f99f4 service cinder] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:58.155420 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7add1c2a-33ec-45a5-85bf-9ad96e2f99f4 service cinder] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:58.155765 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7add1c2a-33ec-45a5-85bf-9ad96e2f99f4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:58.210666 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7add1c2a-33ec-45a5-85bf-9ad96e2f99f4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:58.212101 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7add1c2a-33ec-45a5-85bf-9ad96e2f99f4 service cinder] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:58.220836 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 933/1864] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Oct 12 16:49:58 2021] GET /identity/v3/auth/tokens => generated 3407 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:50:00.158959 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01522790-8853-40bb-bd95-b0d58c91fd15 service cinder] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:50:00.167549 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01522790-8853-40bb-bd95-b0d58c91fd15 service cinder] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:50:00.171260 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c661ca1-11a9-4334-944b-944510682cd6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04704222b3d64a33a6c092fc641ccbb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:50:00.171897 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c661ca1-11a9-4334-944b-944510682cd6 service cinder] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:50:00.172178 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c661ca1-11a9-4334-944b-944510682cd6 service cinder] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:50:00.172453 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c661ca1-11a9-4334-944b-944510682cd6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:50:00.174244 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-2c661ca1-11a9-4334-944b-944510682cd6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:50:00.235828 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c661ca1-11a9-4334-944b-944510682cd6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:50:00.237257 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c661ca1-11a9-4334-944b-944510682cd6 service cinder] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:50:00.246811 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 932/1865] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Oct 12 16:50:00 2021] GET /identity/v3/auth/tokens => generated 3464 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:50:00.542231 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7add1c2a-33ec-45a5-85bf-9ad96e2f99f4 service cinder] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:50:00.543588 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-7add1c2a-33ec-45a5-85bf-9ad96e2f99f4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:50:00.622984 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7add1c2a-33ec-45a5-85bf-9ad96e2f99f4 service cinder] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:50:00.627862 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8186d6-65d9-4402-a2ae-7797705b5a7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:50:00.628657 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8186d6-65d9-4402-a2ae-7797705b5a7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:50:00.628919 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8186d6-65d9-4402-a2ae-7797705b5a7a admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:50:00.629309 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8186d6-65d9-4402-a2ae-7797705b5a7a admin admin] PATH_INFO: `/v3/users/e2d1838e75474c5990b58ff7d1e1aa32` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:50:00.630525 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8186d6-65d9-4402-a2ae-7797705b5a7a admin admin] RBAC: Authorizing `identity:delete_user(user_id=e2d1838e75474c5990b58ff7d1e1aa32)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:50:00.633036 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8186d6-65d9-4402-a2ae-7797705b5a7a admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:50:00.681393 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-da8186d6-65d9-4402-a2ae-7797705b5a7a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e2d1838e75474c5990b58ff7d1e1aa32'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:50:00.696336 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-da8186d6-65d9-4402-a2ae-7797705b5a7a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e2d1838e75474c5990b58ff7d1e1aa32'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:50:00.701329 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-da8186d6-65d9-4402-a2ae-7797705b5a7a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e2d1838e75474c5990b58ff7d1e1aa32'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:50:00.708469 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-da8186d6-65d9-4402-a2ae-7797705b5a7a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e2d1838e75474c5990b58ff7d1e1aa32'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:50:00.709132 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-da8186d6-65d9-4402-a2ae-7797705b5a7a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e2d1838e75474c5990b58ff7d1e1aa32'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:50:00.715317 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 934/1866] 10.222.0.58 () {58 vars in 1223 bytes} [Tue Oct 12 16:50:00 2021] DELETE /identity/v3/users/e2d1838e75474c5990b58ff7d1e1aa32 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:50:00.719852 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2fca2f-b5de-47ec-83a0-1bc75dd16071 None None] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:50:00.720148 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2fca2f-b5de-47ec-83a0-1bc75dd16071 None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:50:00.720604 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2fca2f-b5de-47ec-83a0-1bc75dd16071 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:50:00.738191 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.auth.core [None req-2c2fca2f-b5de-47ec-83a0-1bc75dd16071 None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:50:00.739499 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-2c2fca2f-b5de-47ec-83a0-1bc75dd16071 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:50:00.802839 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 933/1867] 10.222.0.58 () {58 vars in 957 bytes} [Tue Oct 12 16:50:00 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:50:00.814882 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8186d6-65d9-4402-a2ae-7797705b5a7a admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:50:00.816312 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-da8186d6-65d9-4402-a2ae-7797705b5a7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:50:00.871716 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8186d6-65d9-4402-a2ae-7797705b5a7a admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:50:00.875403 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb25fd35-53db-45a4-9caa-4c970c9bfc45 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e65f6d0598e4c539134292b86fb43d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:50:00.876056 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb25fd35-53db-45a4-9caa-4c970c9bfc45 service neutron] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:50:00.876341 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb25fd35-53db-45a4-9caa-4c970c9bfc45 service neutron] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:50:00.876622 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb25fd35-53db-45a4-9caa-4c970c9bfc45 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:50:00.886341 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb25fd35-53db-45a4-9caa-4c970c9bfc45 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:50:00.887760 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb25fd35-53db-45a4-9caa-4c970c9bfc45 service neutron] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:50:00.897327 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 935/1868] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Oct 12 16:50:00 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:50:01.192191 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2fca2f-b5de-47ec-83a0-1bc75dd16071 None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:50:01.194108 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-2c2fca2f-b5de-47ec-83a0-1bc75dd16071 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:50:01.214511 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2fca2f-b5de-47ec-83a0-1bc75dd16071 None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:50:01.219224 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318a6207-7b5b-4a42-b068-f98ecf5553f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:50:01.220102 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318a6207-7b5b-4a42-b068-f98ecf5553f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:50:01.220542 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318a6207-7b5b-4a42-b068-f98ecf5553f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:50:01.221006 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318a6207-7b5b-4a42-b068-f98ecf5553f5 admin admin] PATH_INFO: `/v3/projects/01671f61d7104034bb9ea3d1db4e5fec` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:50:01.222760 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318a6207-7b5b-4a42-b068-f98ecf5553f5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=01671f61d7104034bb9ea3d1db4e5fec)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:50:01.224823 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318a6207-7b5b-4a42-b068-f98ecf5553f5 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:50:01.281566 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-318a6207-7b5b-4a42-b068-f98ecf5553f5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '01671f61d7104034bb9ea3d1db4e5fec', 'request_id': 'req-318a6207-7b5b-4a42-b068-f98ecf5553f5'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:50:01.286860 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-318a6207-7b5b-4a42-b068-f98ecf5553f5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '01671f61d7104034bb9ea3d1db4e5fec', 'request_id': 'req-318a6207-7b5b-4a42-b068-f98ecf5553f5'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:50:01.293349 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-318a6207-7b5b-4a42-b068-f98ecf5553f5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '01671f61d7104034bb9ea3d1db4e5fec', 'request_id': 'req-318a6207-7b5b-4a42-b068-f98ecf5553f5'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:50:01.305016 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-318a6207-7b5b-4a42-b068-f98ecf5553f5 admin admin] The token cache is being invalidate because project 01671f61d7104034bb9ea3d1db4e5fec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=85204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 16:50:01.305303 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-318a6207-7b5b-4a42-b068-f98ecf5553f5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:50:01.305946 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-318a6207-7b5b-4a42-b068-f98ecf5553f5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:50:01.307600 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 934/1869] 10.222.0.58 () {58 vars in 1232 bytes} [Tue Oct 12 16:50:01 2021] DELETE /identity/v3/projects/01671f61d7104034bb9ea3d1db4e5fec => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:50:01.311519 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb25fd35-53db-45a4-9caa-4c970c9bfc45 service neutron] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:50:01.320902 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb25fd35-53db-45a4-9caa-4c970c9bfc45 service neutron] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:50:01.373587 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acc4fad-57d5-4876-99fa-fc57d194c5b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:50:01.374480 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acc4fad-57d5-4876-99fa-fc57d194c5b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:50:01.374763 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acc4fad-57d5-4876-99fa-fc57d194c5b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:50:01.375036 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acc4fad-57d5-4876-99fa-fc57d194c5b2 admin admin] PATH_INFO: `/v3/users/bce67bd3bb804e0a8b5e5663b0d2a638` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:50:01.376223 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acc4fad-57d5-4876-99fa-fc57d194c5b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bce67bd3bb804e0a8b5e5663b0d2a638)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:50:01.378131 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acc4fad-57d5-4876-99fa-fc57d194c5b2 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:50:01.420175 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-4acc4fad-57d5-4876-99fa-fc57d194c5b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bce67bd3bb804e0a8b5e5663b0d2a638'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:50:01.431467 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-4acc4fad-57d5-4876-99fa-fc57d194c5b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bce67bd3bb804e0a8b5e5663b0d2a638'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:50:01.438115 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-4acc4fad-57d5-4876-99fa-fc57d194c5b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bce67bd3bb804e0a8b5e5663b0d2a638'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:50:01.444508 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-4acc4fad-57d5-4876-99fa-fc57d194c5b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bce67bd3bb804e0a8b5e5663b0d2a638'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:50:01.445189 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-4acc4fad-57d5-4876-99fa-fc57d194c5b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bce67bd3bb804e0a8b5e5663b0d2a638'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:50:01.450926 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 936/1870] 10.222.0.58 () {58 vars in 1223 bytes} [Tue Oct 12 16:50:01 2021] DELETE /identity/v3/users/bce67bd3bb804e0a8b5e5663b0d2a638 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:50:01.718881 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318a6207-7b5b-4a42-b068-f98ecf5553f5 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:50:01.720336 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-318a6207-7b5b-4a42-b068-f98ecf5553f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:50:01.734683 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318a6207-7b5b-4a42-b068-f98ecf5553f5 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:50:01.790377 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d23bce1-c92c-4fb7-8deb-d3b8dd6ae5b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:50:01.791238 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d23bce1-c92c-4fb7-8deb-d3b8dd6ae5b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:50:01.791527 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d23bce1-c92c-4fb7-8deb-d3b8dd6ae5b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:50:01.791805 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d23bce1-c92c-4fb7-8deb-d3b8dd6ae5b4 admin admin] PATH_INFO: `/v3/projects/25131265631443899dd42a730bd458e9` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:50:01.792991 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d23bce1-c92c-4fb7-8deb-d3b8dd6ae5b4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=25131265631443899dd42a730bd458e9)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:50:01.794922 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d23bce1-c92c-4fb7-8deb-d3b8dd6ae5b4 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:50:01.840892 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-9d23bce1-c92c-4fb7-8deb-d3b8dd6ae5b4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '25131265631443899dd42a730bd458e9', 'request_id': 'req-9d23bce1-c92c-4fb7-8deb-d3b8dd6ae5b4'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:50:01.846049 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-9d23bce1-c92c-4fb7-8deb-d3b8dd6ae5b4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '25131265631443899dd42a730bd458e9', 'request_id': 'req-9d23bce1-c92c-4fb7-8deb-d3b8dd6ae5b4'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:50:01.852421 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-9d23bce1-c92c-4fb7-8deb-d3b8dd6ae5b4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '25131265631443899dd42a730bd458e9', 'request_id': 'req-9d23bce1-c92c-4fb7-8deb-d3b8dd6ae5b4'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:50:01.863759 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-9d23bce1-c92c-4fb7-8deb-d3b8dd6ae5b4 admin admin] The token cache is being invalidate because project 25131265631443899dd42a730bd458e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=85204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 16:50:01.864045 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-9d23bce1-c92c-4fb7-8deb-d3b8dd6ae5b4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:50:01.864660 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-9d23bce1-c92c-4fb7-8deb-d3b8dd6ae5b4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:50:01.867100 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 935/1871] 10.222.0.58 () {58 vars in 1232 bytes} [Tue Oct 12 16:50:01 2021] DELETE /identity/v3/projects/25131265631443899dd42a730bd458e9 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:50:01.874411 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d75e90a-404a-469a-9520-fb297382e963 None None] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:50:01.874891 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d75e90a-404a-469a-9520-fb297382e963 None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:50:01.875000 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d75e90a-404a-469a-9520-fb297382e963 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:50:01.891970 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.auth.core [None req-3d75e90a-404a-469a-9520-fb297382e963 None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:50:01.893204 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-3d75e90a-404a-469a-9520-fb297382e963 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:50:01.949549 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 937/1872] 10.222.0.58 () {58 vars in 957 bytes} [Tue Oct 12 16:50:01 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:50:01.957287 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a150825-dde9-42bc-baba-57a3c55698d8 None None] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:50:01.957653 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a150825-dde9-42bc-baba-57a3c55698d8 None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:50:01.958075 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a150825-dde9-42bc-baba-57a3c55698d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:50:01.976594 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.auth.core [None req-5a150825-dde9-42bc-baba-57a3c55698d8 None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:50:01.977918 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-5a150825-dde9-42bc-baba-57a3c55698d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:50:01.986136 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 936/1873] 10.222.0.58 () {58 vars in 957 bytes} [Tue Oct 12 16:50:01 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:50:01.990197 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d75e90a-404a-469a-9520-fb297382e963 None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:50:02.000626 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d75e90a-404a-469a-9520-fb297382e963 None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:50:02.005388 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a807d857-3433-48a0-87b3-2325cf504bc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:50:02.006077 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a807d857-3433-48a0-87b3-2325cf504bc3 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:50:02.006372 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a807d857-3433-48a0-87b3-2325cf504bc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:50:02.006647 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a807d857-3433-48a0-87b3-2325cf504bc3 admin admin] PATH_INFO: `/v3/domains` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:50:02.007428 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a807d857-3433-48a0-87b3-2325cf504bc3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:50:02.007933 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a807d857-3433-48a0-87b3-2325cf504bc3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:50:02.010873 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a807d857-3433-48a0-87b3-2325cf504bc3 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:50:02.029593 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 938/1874] 10.222.0.58 () {58 vars in 1152 bytes} [Tue Oct 12 16:50:01 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:50:02.030750 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a150825-dde9-42bc-baba-57a3c55698d8 None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:50:02.040312 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a150825-dde9-42bc-baba-57a3c55698d8 None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:50:02.045131 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc122af-4127-4863-971d-d2b4db561ea2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:50:02.045794 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc122af-4127-4863-971d-d2b4db561ea2 admin admin] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:50:02.046119 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc122af-4127-4863-971d-d2b4db561ea2 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:50:02.046399 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc122af-4127-4863-971d-d2b4db561ea2 admin admin] PATH_INFO: `/v3/projects` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:50:02.047118 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc122af-4127-4863-971d-d2b4db561ea2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:50:02.048995 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc122af-4127-4863-971d-d2b4db561ea2 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:50:02.075797 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 937/1875] 10.222.0.58 () {60 vars in 1152 bytes} [Tue Oct 12 16:50:02 2021] POST /identity/v3/projects => generated 385 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:50:02.083080 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a807d857-3433-48a0-87b3-2325cf504bc3 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:50:02.093578 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a807d857-3433-48a0-87b3-2325cf504bc3 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:50:02.146651 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4f2e86-6ad7-4087-acb2-d0fb1be0a8d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:50:02.147881 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4f2e86-6ad7-4087-acb2-d0fb1be0a8d8 admin admin] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:50:02.148167 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4f2e86-6ad7-4087-acb2-d0fb1be0a8d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:50:02.148445 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4f2e86-6ad7-4087-acb2-d0fb1be0a8d8 admin admin] PATH_INFO: `/v3/users` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:50:02.149145 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4f2e86-6ad7-4087-acb2-d0fb1be0a8d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:50:02.151078 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4f2e86-6ad7-4087-acb2-d0fb1be0a8d8 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:50:02.170367 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 939/1876] 10.222.0.58 () {60 vars in 1143 bytes} [Tue Oct 12 16:50:02 2021] POST /identity/v3/users => generated 293 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:50:02.174361 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc122af-4127-4863-971d-d2b4db561ea2 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:50:02.184113 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc122af-4127-4863-971d-d2b4db561ea2 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:50:02.188600 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae82917d-7888-432b-87e7-b5ba933b96ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:50:02.189249 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae82917d-7888-432b-87e7-b5ba933b96ce admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:50:02.189533 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae82917d-7888-432b-87e7-b5ba933b96ce admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:50:02.189808 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae82917d-7888-432b-87e7-b5ba933b96ce admin admin] PATH_INFO: `/v3/roles` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:50:02.190646 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae82917d-7888-432b-87e7-b5ba933b96ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:50:02.192204 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae82917d-7888-432b-87e7-b5ba933b96ce admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:50:02.202090 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 938/1877] 10.222.0.58 () {58 vars in 1121 bytes} [Tue Oct 12 16:50:02 2021] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:50:02.205579 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4f2e86-6ad7-4087-acb2-d0fb1be0a8d8 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:50:02.216085 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4f2e86-6ad7-4087-acb2-d0fb1be0a8d8 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:50:02.221134 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d5d1cd-99bd-41a0-853b-25f90a5182f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:50:02.221799 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d5d1cd-99bd-41a0-853b-25f90a5182f8 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:50:02.222118 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d5d1cd-99bd-41a0-853b-25f90a5182f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:50:02.222396 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d5d1cd-99bd-41a0-853b-25f90a5182f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:50:02.223134 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d5d1cd-99bd-41a0-853b-25f90a5182f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:50:02.224764 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d5d1cd-99bd-41a0-853b-25f90a5182f8 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:50:02.235338 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 940/1878] 10.222.0.58 () {58 vars in 1121 bytes} [Tue Oct 12 16:50:02 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:50:02.239478 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae82917d-7888-432b-87e7-b5ba933b96ce admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:50:02.256559 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae82917d-7888-432b-87e7-b5ba933b96ce admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:50:02.261231 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c18ba0-b257-473f-8cf4-f8ee26f15b76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:50:02.262145 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c18ba0-b257-473f-8cf4-f8ee26f15b76 admin admin] REQUEST_METHOD: `PUT` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:50:02.262435 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c18ba0-b257-473f-8cf4-f8ee26f15b76 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:50:02.262707 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c18ba0-b257-473f-8cf4-f8ee26f15b76 admin admin] PATH_INFO: `/v3/projects/9e0a40598be94a88b81928fcb0794748/users/3a4ae49ea77d4955b8269c278b90c895/roles/55ba49fe29884e64b57c3ad13188d554` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:50:02.277166 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c18ba0-b257-473f-8cf4-f8ee26f15b76 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e0a40598be94a88b81928fcb0794748, user_id=3a4ae49ea77d4955b8269c278b90c895, role_id=55ba49fe29884e64b57c3ad13188d554)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:50:02.279788 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c18ba0-b257-473f-8cf4-f8ee26f15b76 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:50:02.293616 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 939/1879] 10.222.0.58 () {60 vars in 1482 bytes} [Tue Oct 12 16:50:02 2021] PUT /identity/v3/projects/9e0a40598be94a88b81928fcb0794748/users/3a4ae49ea77d4955b8269c278b90c895/roles/55ba49fe29884e64b57c3ad13188d554 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 16:50:02.303822 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b1aa0b-2983-4f53-82b8-5dae4b8a5669 None None] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:50:02.304111 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b1aa0b-2983-4f53-82b8-5dae4b8a5669 None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:50:02.304447 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b1aa0b-2983-4f53-82b8-5dae4b8a5669 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:50:02.330286 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.auth.core [None req-31b1aa0b-2983-4f53-82b8-5dae4b8a5669 None None] MFA Rules not processed for user `3a4ae49ea77d4955b8269c278b90c895`. Rule list: `[]` (Enabled: `True`). {{(pid=85205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:50:02.331484 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-31b1aa0b-2983-4f53-82b8-5dae4b8a5669 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:50:02.394872 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 941/1880] 10.222.0.58 () {58 vars in 957 bytes} [Tue Oct 12 16:50:02 2021] POST /identity/v3/auth/tokens => generated 3405 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:50:02.405578 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c18ba0-b257-473f-8cf4-f8ee26f15b76 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:50:02.407334 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-11c18ba0-b257-473f-8cf4-f8ee26f15b76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:50:02.461285 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c18ba0-b257-473f-8cf4-f8ee26f15b76 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:50:02.465030 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f590a26a-c3e5-4b57-bcf7-e644447a45a1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04704222b3d64a33a6c092fc641ccbb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:50:02.465706 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f590a26a-c3e5-4b57-bcf7-e644447a45a1 service cinder] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:50:02.466005 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f590a26a-c3e5-4b57-bcf7-e644447a45a1 service cinder] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:50:02.466285 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f590a26a-c3e5-4b57-bcf7-e644447a45a1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:50:02.474603 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f590a26a-c3e5-4b57-bcf7-e644447a45a1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:50:02.476040 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f590a26a-c3e5-4b57-bcf7-e644447a45a1 service cinder] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:50:02.484584 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 940/1881] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Oct 12 16:50:02 2021] GET /identity/v3/auth/tokens => generated 3405 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:50:06.076620 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b1aa0b-2983-4f53-82b8-5dae4b8a5669 None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:50:06.148676 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b1aa0b-2983-4f53-82b8-5dae4b8a5669 None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:50:06.154348 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59251779-4261-4b53-955e-5313e54d1b33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:50:06.155619 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59251779-4261-4b53-955e-5313e54d1b33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:50:06.156047 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59251779-4261-4b53-955e-5313e54d1b33 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:50:06.156462 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59251779-4261-4b53-955e-5313e54d1b33 admin admin] PATH_INFO: `/v3/users/3a4ae49ea77d4955b8269c278b90c895` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:50:06.157841 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59251779-4261-4b53-955e-5313e54d1b33 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3a4ae49ea77d4955b8269c278b90c895)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:50:06.160390 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59251779-4261-4b53-955e-5313e54d1b33 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:50:06.233925 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-59251779-4261-4b53-955e-5313e54d1b33 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3a4ae49ea77d4955b8269c278b90c895'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:50:06.245900 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-59251779-4261-4b53-955e-5313e54d1b33 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3a4ae49ea77d4955b8269c278b90c895'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:50:06.254588 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-59251779-4261-4b53-955e-5313e54d1b33 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3a4ae49ea77d4955b8269c278b90c895'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:50:06.264660 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-59251779-4261-4b53-955e-5313e54d1b33 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3a4ae49ea77d4955b8269c278b90c895'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:50:06.265444 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-59251779-4261-4b53-955e-5313e54d1b33 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3a4ae49ea77d4955b8269c278b90c895'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:50:06.271824 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 942/1882] 10.222.0.58 () {58 vars in 1223 bytes} [Tue Oct 12 16:50:06 2021] DELETE /identity/v3/users/3a4ae49ea77d4955b8269c278b90c895 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:50:06.276321 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c7367b-cbb9-4b39-9344-e66b4b10d2ba None None] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:50:06.276782 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c7367b-cbb9-4b39-9344-e66b4b10d2ba None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:50:06.276881 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c7367b-cbb9-4b39-9344-e66b4b10d2ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:50:06.294654 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.auth.core [None req-09c7367b-cbb9-4b39-9344-e66b4b10d2ba None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:50:06.295856 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-09c7367b-cbb9-4b39-9344-e66b4b10d2ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:50:06.364987 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 941/1883] 10.222.0.58 () {58 vars in 957 bytes} [Tue Oct 12 16:50:06 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:50:06.376553 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59251779-4261-4b53-955e-5313e54d1b33 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:50:06.378110 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-59251779-4261-4b53-955e-5313e54d1b33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:50:06.435711 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59251779-4261-4b53-955e-5313e54d1b33 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:50:06.439508 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ef2b25-3dbb-4d77-a4bc-e3caa0791522 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e65f6d0598e4c539134292b86fb43d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:50:06.440210 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ef2b25-3dbb-4d77-a4bc-e3caa0791522 service neutron] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:50:06.440461 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ef2b25-3dbb-4d77-a4bc-e3caa0791522 service neutron] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:50:06.440728 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ef2b25-3dbb-4d77-a4bc-e3caa0791522 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:50:06.451430 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ef2b25-3dbb-4d77-a4bc-e3caa0791522 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:50:06.455530 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ef2b25-3dbb-4d77-a4bc-e3caa0791522 service neutron] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:50:06.458408 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c7367b-cbb9-4b39-9344-e66b4b10d2ba None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:50:06.459865 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-09c7367b-cbb9-4b39-9344-e66b4b10d2ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:50:06.466661 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 943/1884] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Oct 12 16:50:06 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:50:06.531631 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c7367b-cbb9-4b39-9344-e66b4b10d2ba None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:50:06.540944 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd34322-5c07-4bd3-a49f-9a1d81e847b2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04704222b3d64a33a6c092fc641ccbb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:50:06.541812 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd34322-5c07-4bd3-a49f-9a1d81e847b2 service cinder] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:50:06.542234 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd34322-5c07-4bd3-a49f-9a1d81e847b2 service cinder] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:50:06.542904 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd34322-5c07-4bd3-a49f-9a1d81e847b2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:50:06.547595 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-2fd34322-5c07-4bd3-a49f-9a1d81e847b2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:50:06.633203 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd34322-5c07-4bd3-a49f-9a1d81e847b2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:50:06.634785 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd34322-5c07-4bd3-a49f-9a1d81e847b2 service cinder] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:50:06.646089 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 942/1885] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Oct 12 16:50:06 2021] GET /identity/v3/auth/tokens => generated 3407 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 12 16:50:06.853482 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ef2b25-3dbb-4d77-a4bc-e3caa0791522 service neutron] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:50:06.856761 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-00ef2b25-3dbb-4d77-a4bc-e3caa0791522 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:50:06.892364 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ef2b25-3dbb-4d77-a4bc-e3caa0791522 service neutron] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:50:06.904875 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41812bbb-6475-4061-8938-cbec8a3283e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:50:06.905982 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41812bbb-6475-4061-8938-cbec8a3283e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:50:06.907306 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41812bbb-6475-4061-8938-cbec8a3283e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:50:06.907592 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41812bbb-6475-4061-8938-cbec8a3283e4 admin admin] PATH_INFO: `/v3/projects/9e0a40598be94a88b81928fcb0794748` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:50:06.910747 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41812bbb-6475-4061-8938-cbec8a3283e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9e0a40598be94a88b81928fcb0794748)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:50:06.912668 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41812bbb-6475-4061-8938-cbec8a3283e4 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:50:06.978929 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-41812bbb-6475-4061-8938-cbec8a3283e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9e0a40598be94a88b81928fcb0794748', 'request_id': 'req-41812bbb-6475-4061-8938-cbec8a3283e4'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:50:06.986125 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-41812bbb-6475-4061-8938-cbec8a3283e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9e0a40598be94a88b81928fcb0794748', 'request_id': 'req-41812bbb-6475-4061-8938-cbec8a3283e4'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:50:06.994990 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-41812bbb-6475-4061-8938-cbec8a3283e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9e0a40598be94a88b81928fcb0794748', 'request_id': 'req-41812bbb-6475-4061-8938-cbec8a3283e4'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:50:07.009141 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-41812bbb-6475-4061-8938-cbec8a3283e4 admin admin] The token cache is being invalidate because project 9e0a40598be94a88b81928fcb0794748 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=85205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 16:50:07.009550 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-41812bbb-6475-4061-8938-cbec8a3283e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:50:07.010196 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-41812bbb-6475-4061-8938-cbec8a3283e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:50:07.011835 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 944/1886] 10.222.0.58 () {58 vars in 1232 bytes} [Tue Oct 12 16:50:06 2021] DELETE /identity/v3/projects/9e0a40598be94a88b81928fcb0794748 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:50:07.018501 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6589b2a-966a-4e3d-a4a5-7392e98b1976 None None] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:50:07.019161 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6589b2a-966a-4e3d-a4a5-7392e98b1976 None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:50:07.019446 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6589b2a-966a-4e3d-a4a5-7392e98b1976 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:50:07.037688 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.auth.core [None req-b6589b2a-966a-4e3d-a4a5-7392e98b1976 None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:50:07.038963 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-b6589b2a-966a-4e3d-a4a5-7392e98b1976 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:50:07.097066 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 943/1887] 10.222.0.58 () {58 vars in 957 bytes} [Tue Oct 12 16:50:07 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:50:07.105832 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1f7b88-8c53-4b47-bbb9-8cbccd63cadc None None] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:50:07.106359 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1f7b88-8c53-4b47-bbb9-8cbccd63cadc None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:50:07.106455 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1f7b88-8c53-4b47-bbb9-8cbccd63cadc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:50:07.124497 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.auth.core [None req-4a1f7b88-8c53-4b47-bbb9-8cbccd63cadc None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:50:07.125728 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-4a1f7b88-8c53-4b47-bbb9-8cbccd63cadc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:50:07.134909 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 945/1888] 10.222.0.58 () {58 vars in 957 bytes} [Tue Oct 12 16:50:07 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:50:07.140097 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6589b2a-966a-4e3d-a4a5-7392e98b1976 None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:50:07.151054 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6589b2a-966a-4e3d-a4a5-7392e98b1976 None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:50:07.156128 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05b96ba-e272-4047-bdbe-f0999d60d481 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:50:07.156791 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05b96ba-e272-4047-bdbe-f0999d60d481 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:50:07.157071 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05b96ba-e272-4047-bdbe-f0999d60d481 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:50:07.157339 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05b96ba-e272-4047-bdbe-f0999d60d481 admin admin] PATH_INFO: `/v3/domains` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:50:07.158255 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05b96ba-e272-4047-bdbe-f0999d60d481 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:50:07.158718 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05b96ba-e272-4047-bdbe-f0999d60d481 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:50:07.160310 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05b96ba-e272-4047-bdbe-f0999d60d481 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:50:07.173103 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 944/1889] 10.222.0.58 () {58 vars in 1152 bytes} [Tue Oct 12 16:50:07 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:50:07.177214 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1f7b88-8c53-4b47-bbb9-8cbccd63cadc None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:50:07.186755 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1f7b88-8c53-4b47-bbb9-8cbccd63cadc None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:50:07.198735 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766d9ec1-f4be-4c37-96d9-2ae9ad75063c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:50:07.198735 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766d9ec1-f4be-4c37-96d9-2ae9ad75063c admin admin] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:50:07.198735 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766d9ec1-f4be-4c37-96d9-2ae9ad75063c admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:50:07.198985 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766d9ec1-f4be-4c37-96d9-2ae9ad75063c admin admin] PATH_INFO: `/v3/projects` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:50:07.199566 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766d9ec1-f4be-4c37-96d9-2ae9ad75063c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:50:07.201739 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766d9ec1-f4be-4c37-96d9-2ae9ad75063c admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:50:07.227361 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 946/1890] 10.222.0.58 () {60 vars in 1152 bytes} [Tue Oct 12 16:50:07 2021] POST /identity/v3/projects => generated 373 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:50:07.236128 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05b96ba-e272-4047-bdbe-f0999d60d481 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:50:07.247412 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05b96ba-e272-4047-bdbe-f0999d60d481 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:50:07.294678 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766d9ec1-f4be-4c37-96d9-2ae9ad75063c admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:50:07.297504 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-766d9ec1-f4be-4c37-96d9-2ae9ad75063c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:50:07.310713 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fad860-eb6b-4573-8a2b-5c4e74a59a21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:50:07.311511 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fad860-eb6b-4573-8a2b-5c4e74a59a21 admin admin] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:50:07.311868 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fad860-eb6b-4573-8a2b-5c4e74a59a21 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:50:07.312214 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fad860-eb6b-4573-8a2b-5c4e74a59a21 admin admin] PATH_INFO: `/v3/users` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:50:07.313025 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fad860-eb6b-4573-8a2b-5c4e74a59a21 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:50:07.315454 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fad860-eb6b-4573-8a2b-5c4e74a59a21 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:50:07.339310 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 945/1891] 10.222.0.58 () {60 vars in 1143 bytes} [Tue Oct 12 16:50:07 2021] POST /identity/v3/users => generated 287 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 16:50:07.344399 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fad860-eb6b-4573-8a2b-5c4e74a59a21 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:50:07.355539 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fad860-eb6b-4573-8a2b-5c4e74a59a21 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:50:07.361550 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd26ad92-22d5-4d31-872e-7ade0c693fe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:50:07.362356 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd26ad92-22d5-4d31-872e-7ade0c693fe2 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:50:07.362795 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd26ad92-22d5-4d31-872e-7ade0c693fe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:50:07.363117 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd26ad92-22d5-4d31-872e-7ade0c693fe2 admin admin] PATH_INFO: `/v3/roles` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:50:07.363961 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd26ad92-22d5-4d31-872e-7ade0c693fe2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:50:07.366535 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd26ad92-22d5-4d31-872e-7ade0c693fe2 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:50:07.376700 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 946/1892] 10.222.0.58 () {58 vars in 1121 bytes} [Tue Oct 12 16:50:07 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:50:07.377387 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766d9ec1-f4be-4c37-96d9-2ae9ad75063c admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:50:07.380587 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd26ad92-22d5-4d31-872e-7ade0c693fe2 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:50:07.383082 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c92fc91-8c50-4bb7-b61b-a8a9c21aba41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:50:07.383963 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c92fc91-8c50-4bb7-b61b-a8a9c21aba41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:50:07.384248 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c92fc91-8c50-4bb7-b61b-a8a9c21aba41 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:50:07.384525 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c92fc91-8c50-4bb7-b61b-a8a9c21aba41 admin admin] PATH_INFO: `/v3/users/ec884ca51e9243c6a660dd494d49d17b` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:50:07.385963 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c92fc91-8c50-4bb7-b61b-a8a9c21aba41 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ec884ca51e9243c6a660dd494d49d17b)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:50:07.388732 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c92fc91-8c50-4bb7-b61b-a8a9c21aba41 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:50:07.390331 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd26ad92-22d5-4d31-872e-7ade0c693fe2 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:50:07.394983 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae12f63-5320-4317-a6c7-ae90f5eb9b94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:50:07.395629 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae12f63-5320-4317-a6c7-ae90f5eb9b94 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:50:07.395916 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae12f63-5320-4317-a6c7-ae90f5eb9b94 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:50:07.396188 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae12f63-5320-4317-a6c7-ae90f5eb9b94 admin admin] PATH_INFO: `/v3/roles` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:50:07.396923 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae12f63-5320-4317-a6c7-ae90f5eb9b94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:50:07.398549 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae12f63-5320-4317-a6c7-ae90f5eb9b94 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:50:07.409090 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 947/1893] 10.222.0.58 () {58 vars in 1121 bytes} [Tue Oct 12 16:50:07 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 16:50:07.413550 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae12f63-5320-4317-a6c7-ae90f5eb9b94 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:50:07.425973 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae12f63-5320-4317-a6c7-ae90f5eb9b94 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:50:07.431351 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989cf843-7adb-4b46-aff3-e60b341a5254 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:50:07.432306 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989cf843-7adb-4b46-aff3-e60b341a5254 admin admin] REQUEST_METHOD: `PUT` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:50:07.432593 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989cf843-7adb-4b46-aff3-e60b341a5254 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:50:07.432868 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989cf843-7adb-4b46-aff3-e60b341a5254 admin admin] PATH_INFO: `/v3/projects/d2aadbdd3b804779a925d727e9c5027f/users/88525575d4254733b5b70f5b631bc840/roles/55ba49fe29884e64b57c3ad13188d554` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:50:07.440443 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-5c92fc91-8c50-4bb7-b61b-a8a9c21aba41 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ec884ca51e9243c6a660dd494d49d17b'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:50:07.448105 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989cf843-7adb-4b46-aff3-e60b341a5254 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2aadbdd3b804779a925d727e9c5027f, user_id=88525575d4254733b5b70f5b631bc840, role_id=55ba49fe29884e64b57c3ad13188d554)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:50:07.450955 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989cf843-7adb-4b46-aff3-e60b341a5254 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:50:07.453130 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-5c92fc91-8c50-4bb7-b61b-a8a9c21aba41 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ec884ca51e9243c6a660dd494d49d17b'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:50:07.460876 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-5c92fc91-8c50-4bb7-b61b-a8a9c21aba41 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ec884ca51e9243c6a660dd494d49d17b'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:50:07.466260 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 948/1894] 10.222.0.58 () {60 vars in 1482 bytes} [Tue Oct 12 16:50:07 2021] PUT /identity/v3/projects/d2aadbdd3b804779a925d727e9c5027f/users/88525575d4254733b5b70f5b631bc840/roles/55ba49fe29884e64b57c3ad13188d554 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 16:50:07.468091 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-5c92fc91-8c50-4bb7-b61b-a8a9c21aba41 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ec884ca51e9243c6a660dd494d49d17b'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:50:07.468827 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-5c92fc91-8c50-4bb7-b61b-a8a9c21aba41 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ec884ca51e9243c6a660dd494d49d17b'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:50:07.475688 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 947/1895] 10.222.0.58 () {58 vars in 1223 bytes} [Tue Oct 12 16:50:07 2021] DELETE /identity/v3/users/ec884ca51e9243c6a660dd494d49d17b => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 16:50:07.476110 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902b905b-6bee-42d7-8efd-72343eee637a None None] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:50:07.476489 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902b905b-6bee-42d7-8efd-72343eee637a None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:50:07.476775 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902b905b-6bee-42d7-8efd-72343eee637a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:50:07.506117 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.auth.core [None req-902b905b-6bee-42d7-8efd-72343eee637a None None] MFA Rules not processed for user `88525575d4254733b5b70f5b631bc840`. Rule list: `[]` (Enabled: `True`). {{(pid=85204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:50:07.507906 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-902b905b-6bee-42d7-8efd-72343eee637a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:50:07.571432 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 949/1896] 10.222.0.58 () {58 vars in 957 bytes} [Tue Oct 12 16:50:07 2021] POST /identity/v3/auth/tokens => generated 3393 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:50:07.581958 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c92fc91-8c50-4bb7-b61b-a8a9c21aba41 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:50:07.583624 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-5c92fc91-8c50-4bb7-b61b-a8a9c21aba41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:50:07.640300 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c92fc91-8c50-4bb7-b61b-a8a9c21aba41 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:50:07.643856 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ea56c0-5afd-45c5-90c3-edbfa90560d6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04704222b3d64a33a6c092fc641ccbb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:50:07.644533 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ea56c0-5afd-45c5-90c3-edbfa90560d6 service cinder] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:50:07.644813 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ea56c0-5afd-45c5-90c3-edbfa90560d6 service cinder] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:50:07.645086 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ea56c0-5afd-45c5-90c3-edbfa90560d6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:50:07.653290 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ea56c0-5afd-45c5-90c3-edbfa90560d6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:50:07.654731 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ea56c0-5afd-45c5-90c3-edbfa90560d6 service cinder] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:50:07.663996 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 948/1897] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Oct 12 16:50:07 2021] GET /identity/v3/auth/tokens => generated 3393 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:50:07.688779 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902b905b-6bee-42d7-8efd-72343eee637a None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:50:07.690335 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-902b905b-6bee-42d7-8efd-72343eee637a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:50:07.760615 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902b905b-6bee-42d7-8efd-72343eee637a None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:50:07.765243 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fa82a2-58fc-4010-bb49-ab122c13d435 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:50:07.766156 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fa82a2-58fc-4010-bb49-ab122c13d435 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:50:07.766423 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fa82a2-58fc-4010-bb49-ab122c13d435 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:50:07.766726 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fa82a2-58fc-4010-bb49-ab122c13d435 admin admin] PATH_INFO: `/v3/users/88525575d4254733b5b70f5b631bc840` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:50:07.768239 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fa82a2-58fc-4010-bb49-ab122c13d435 admin admin] RBAC: Authorizing `identity:delete_user(user_id=88525575d4254733b5b70f5b631bc840)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:50:07.770202 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fa82a2-58fc-4010-bb49-ab122c13d435 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:50:07.817966 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-a1fa82a2-58fc-4010-bb49-ab122c13d435 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '88525575d4254733b5b70f5b631bc840'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:50:07.838004 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-a1fa82a2-58fc-4010-bb49-ab122c13d435 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '88525575d4254733b5b70f5b631bc840'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:50:07.848874 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-a1fa82a2-58fc-4010-bb49-ab122c13d435 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '88525575d4254733b5b70f5b631bc840'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:50:07.857563 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-a1fa82a2-58fc-4010-bb49-ab122c13d435 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '88525575d4254733b5b70f5b631bc840'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:50:07.858339 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-a1fa82a2-58fc-4010-bb49-ab122c13d435 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '88525575d4254733b5b70f5b631bc840'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:50:07.864834 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 950/1898] 10.222.0.58 () {58 vars in 1223 bytes} [Tue Oct 12 16:50:07 2021] DELETE /identity/v3/users/88525575d4254733b5b70f5b631bc840 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:50:07.870123 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965f3c5e-abde-475f-8d88-4f96ec7784b2 None None] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:50:07.870421 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965f3c5e-abde-475f-8d88-4f96ec7784b2 None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:50:07.870707 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965f3c5e-abde-475f-8d88-4f96ec7784b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:50:07.887650 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.auth.core [None req-965f3c5e-abde-475f-8d88-4f96ec7784b2 None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:50:07.888862 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-965f3c5e-abde-475f-8d88-4f96ec7784b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:50:07.947725 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 949/1899] 10.222.0.58 () {58 vars in 957 bytes} [Tue Oct 12 16:50:07 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:50:07.958953 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fa82a2-58fc-4010-bb49-ab122c13d435 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:50:07.960471 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-a1fa82a2-58fc-4010-bb49-ab122c13d435 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:50:08.018682 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fa82a2-58fc-4010-bb49-ab122c13d435 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:50:08.023121 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b29b739-1d98-4231-bc05-fd9d1e23adca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e65f6d0598e4c539134292b86fb43d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:50:08.023767 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b29b739-1d98-4231-bc05-fd9d1e23adca service neutron] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:50:08.024050 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b29b739-1d98-4231-bc05-fd9d1e23adca service neutron] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:50:08.024324 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b29b739-1d98-4231-bc05-fd9d1e23adca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:50:08.033795 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b29b739-1d98-4231-bc05-fd9d1e23adca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:50:08.035249 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b29b739-1d98-4231-bc05-fd9d1e23adca service neutron] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:50:08.046497 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 951/1900] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Oct 12 16:50:07 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:50:08.230463 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965f3c5e-abde-475f-8d88-4f96ec7784b2 None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:50:08.231919 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-965f3c5e-abde-475f-8d88-4f96ec7784b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:50:08.244359 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965f3c5e-abde-475f-8d88-4f96ec7784b2 None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:50:08.249399 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a71ac1-c3d4-407c-9ab5-df577b548730 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:50:08.250471 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a71ac1-c3d4-407c-9ab5-df577b548730 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:50:08.250902 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a71ac1-c3d4-407c-9ab5-df577b548730 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:50:08.251324 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a71ac1-c3d4-407c-9ab5-df577b548730 admin admin] PATH_INFO: `/v3/projects/1c794f0e91f4416d8d822d8ed1f970fb` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:50:08.252684 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a71ac1-c3d4-407c-9ab5-df577b548730 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c794f0e91f4416d8d822d8ed1f970fb)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:50:08.254942 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a71ac1-c3d4-407c-9ab5-df577b548730 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:50:08.322969 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-c5a71ac1-c3d4-407c-9ab5-df577b548730 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c794f0e91f4416d8d822d8ed1f970fb', 'request_id': 'req-c5a71ac1-c3d4-407c-9ab5-df577b548730'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:50:08.329499 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-c5a71ac1-c3d4-407c-9ab5-df577b548730 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c794f0e91f4416d8d822d8ed1f970fb', 'request_id': 'req-c5a71ac1-c3d4-407c-9ab5-df577b548730'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:50:08.337348 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b29b739-1d98-4231-bc05-fd9d1e23adca service neutron] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:50:08.339033 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-5b29b739-1d98-4231-bc05-fd9d1e23adca service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:50:08.339312 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-c5a71ac1-c3d4-407c-9ab5-df577b548730 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c794f0e91f4416d8d822d8ed1f970fb', 'request_id': 'req-c5a71ac1-c3d4-407c-9ab5-df577b548730'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:50:08.356842 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b29b739-1d98-4231-bc05-fd9d1e23adca service neutron] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:50:08.359421 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-c5a71ac1-c3d4-407c-9ab5-df577b548730 admin admin] The token cache is being invalidate because project 1c794f0e91f4416d8d822d8ed1f970fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=85205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 16:50:08.359767 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-c5a71ac1-c3d4-407c-9ab5-df577b548730 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:50:08.360939 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-c5a71ac1-c3d4-407c-9ab5-df577b548730 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:50:08.362844 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 950/1901] 10.222.0.58 () {58 vars in 1232 bytes} [Tue Oct 12 16:50:08 2021] DELETE /identity/v3/projects/1c794f0e91f4416d8d822d8ed1f970fb => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:50:08.367531 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a71ac1-c3d4-407c-9ab5-df577b548730 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:50:08.369712 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-c5a71ac1-c3d4-407c-9ab5-df577b548730 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:50:08.416184 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32832c44-0180-4948-ab96-7ff754dccabd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:50:08.417047 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32832c44-0180-4948-ab96-7ff754dccabd admin admin] REQUEST_METHOD: `DELETE` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:50:08.417337 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32832c44-0180-4948-ab96-7ff754dccabd admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:50:08.417607 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32832c44-0180-4948-ab96-7ff754dccabd admin admin] PATH_INFO: `/v3/projects/d2aadbdd3b804779a925d727e9c5027f` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:50:08.419007 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32832c44-0180-4948-ab96-7ff754dccabd admin admin] RBAC: Authorizing `identity:delete_project(project_id=d2aadbdd3b804779a925d727e9c5027f)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:50:08.421128 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32832c44-0180-4948-ab96-7ff754dccabd admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:50:08.439299 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a71ac1-c3d4-407c-9ab5-df577b548730 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:50:08.445245 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f5b024-fd8a-4d6e-b694-8674b92370eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:50:08.446146 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f5b024-fd8a-4d6e-b694-8674b92370eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:50:08.446511 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f5b024-fd8a-4d6e-b694-8674b92370eb admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:50:08.446706 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f5b024-fd8a-4d6e-b694-8674b92370eb admin admin] PATH_INFO: `/v3/users/dc2c7c95c0c24f05834490aa8a47870a` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:50:08.448029 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f5b024-fd8a-4d6e-b694-8674b92370eb admin admin] RBAC: Authorizing `identity:delete_user(user_id=dc2c7c95c0c24f05834490aa8a47870a)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:50:08.450225 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f5b024-fd8a-4d6e-b694-8674b92370eb admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:50:08.469824 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-32832c44-0180-4948-ab96-7ff754dccabd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd2aadbdd3b804779a925d727e9c5027f', 'request_id': 'req-32832c44-0180-4948-ab96-7ff754dccabd'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:50:08.475501 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-32832c44-0180-4948-ab96-7ff754dccabd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd2aadbdd3b804779a925d727e9c5027f', 'request_id': 'req-32832c44-0180-4948-ab96-7ff754dccabd'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:50:08.482411 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-32832c44-0180-4948-ab96-7ff754dccabd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd2aadbdd3b804779a925d727e9c5027f', 'request_id': 'req-32832c44-0180-4948-ab96-7ff754dccabd'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:50:08.498913 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-32832c44-0180-4948-ab96-7ff754dccabd admin admin] The token cache is being invalidate because project d2aadbdd3b804779a925d727e9c5027f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=85204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 16:50:08.499215 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-32832c44-0180-4948-ab96-7ff754dccabd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:50:08.499854 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-32832c44-0180-4948-ab96-7ff754dccabd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:50:08.501617 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 952/1902] 10.222.0.58 () {58 vars in 1232 bytes} [Tue Oct 12 16:50:08 2021] DELETE /identity/v3/projects/d2aadbdd3b804779a925d727e9c5027f => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:50:08.501729 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-72f5b024-fd8a-4d6e-b694-8674b92370eb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dc2c7c95c0c24f05834490aa8a47870a'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:50:08.507383 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76797f57-fab4-4032-8e14-6ddf611484e0 None None] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:50:08.507674 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76797f57-fab4-4032-8e14-6ddf611484e0 None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:50:08.507953 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76797f57-fab4-4032-8e14-6ddf611484e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:50:08.514708 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-72f5b024-fd8a-4d6e-b694-8674b92370eb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dc2c7c95c0c24f05834490aa8a47870a'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:50:08.524103 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-72f5b024-fd8a-4d6e-b694-8674b92370eb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dc2c7c95c0c24f05834490aa8a47870a'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:50:08.527635 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.auth.core [None req-76797f57-fab4-4032-8e14-6ddf611484e0 None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:50:08.528853 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-76797f57-fab4-4032-8e14-6ddf611484e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:50:08.531996 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-72f5b024-fd8a-4d6e-b694-8674b92370eb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dc2c7c95c0c24f05834490aa8a47870a'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:50:08.532586 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-72f5b024-fd8a-4d6e-b694-8674b92370eb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dc2c7c95c0c24f05834490aa8a47870a'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:50:08.538911 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 951/1903] 10.222.0.58 () {58 vars in 1223 bytes} [Tue Oct 12 16:50:08 2021] DELETE /identity/v3/users/dc2c7c95c0c24f05834490aa8a47870a => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:50:08.598922 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 953/1904] 10.222.0.58 () {58 vars in 957 bytes} [Tue Oct 12 16:50:08 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:50:08.607682 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a079d3-59c3-470b-83fa-0bf143438d32 None None] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:50:08.607965 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a079d3-59c3-470b-83fa-0bf143438d32 None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:50:08.608242 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a079d3-59c3-470b-83fa-0bf143438d32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:50:08.626359 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.auth.core [None req-a1a079d3-59c3-470b-83fa-0bf143438d32 None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:50:08.627584 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-a1a079d3-59c3-470b-83fa-0bf143438d32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:50:08.694478 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 952/1905] 10.222.0.58 () {58 vars in 957 bytes} [Tue Oct 12 16:50:08 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:50:08.695852 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76797f57-fab4-4032-8e14-6ddf611484e0 None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:50:08.705476 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76797f57-fab4-4032-8e14-6ddf611484e0 None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:50:08.712893 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df20c05-1e50-471b-85b9-b838a0ab2868 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:50:08.713642 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df20c05-1e50-471b-85b9-b838a0ab2868 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:50:08.713957 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df20c05-1e50-471b-85b9-b838a0ab2868 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:50:08.714237 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df20c05-1e50-471b-85b9-b838a0ab2868 admin admin] PATH_INFO: `/v3/domains` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:50:08.716015 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a079d3-59c3-470b-83fa-0bf143438d32 None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:50:08.717434 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-a1a079d3-59c3-470b-83fa-0bf143438d32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:50:08.718079 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df20c05-1e50-471b-85b9-b838a0ab2868 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:50:08.718614 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df20c05-1e50-471b-85b9-b838a0ab2868 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:50:08.721190 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df20c05-1e50-471b-85b9-b838a0ab2868 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:50:08.736576 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a079d3-59c3-470b-83fa-0bf143438d32 None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:50:08.739620 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 954/1906] 10.222.0.58 () {58 vars in 1152 bytes} [Tue Oct 12 16:50:08 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:50:08.742362 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df20c05-1e50-471b-85b9-b838a0ab2868 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:50:08.756442 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd97d053-a93c-4068-a478-fad2ff9b8fb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:50:08.757843 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd97d053-a93c-4068-a478-fad2ff9b8fb7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:50:08.758298 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd97d053-a93c-4068-a478-fad2ff9b8fb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:50:08.758667 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd97d053-a93c-4068-a478-fad2ff9b8fb7 admin admin] PATH_INFO: `/v3/projects/10ffc3749dea4c4bb03f685b13e04077` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:50:08.760312 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd97d053-a93c-4068-a478-fad2ff9b8fb7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=10ffc3749dea4c4bb03f685b13e04077)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:50:08.762431 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd97d053-a93c-4068-a478-fad2ff9b8fb7 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:50:08.763141 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df20c05-1e50-471b-85b9-b838a0ab2868 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:50:08.768558 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcaa256-9d65-4613-858b-1db9194e093d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:50:08.769416 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcaa256-9d65-4613-858b-1db9194e093d admin admin] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:50:08.770011 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcaa256-9d65-4613-858b-1db9194e093d admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:50:08.770482 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcaa256-9d65-4613-858b-1db9194e093d admin admin] PATH_INFO: `/v3/projects` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:50:08.771292 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcaa256-9d65-4613-858b-1db9194e093d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:50:08.773299 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcaa256-9d65-4613-858b-1db9194e093d admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:50:08.804039 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 955/1907] 10.222.0.58 () {60 vars in 1152 bytes} [Tue Oct 12 16:50:08 2021] POST /identity/v3/projects => generated 383 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:50:08.805500 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcaa256-9d65-4613-858b-1db9194e093d admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:50:08.810163 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-bd97d053-a93c-4068-a478-fad2ff9b8fb7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '10ffc3749dea4c4bb03f685b13e04077', 'request_id': 'req-bd97d053-a93c-4068-a478-fad2ff9b8fb7'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:50:08.815748 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-bd97d053-a93c-4068-a478-fad2ff9b8fb7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '10ffc3749dea4c4bb03f685b13e04077', 'request_id': 'req-bd97d053-a93c-4068-a478-fad2ff9b8fb7'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:50:08.822777 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-bd97d053-a93c-4068-a478-fad2ff9b8fb7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '10ffc3749dea4c4bb03f685b13e04077', 'request_id': 'req-bd97d053-a93c-4068-a478-fad2ff9b8fb7'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:50:08.835855 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-bd97d053-a93c-4068-a478-fad2ff9b8fb7 admin admin] The token cache is being invalidate because project 10ffc3749dea4c4bb03f685b13e04077 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=85205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 16:50:08.836145 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-bd97d053-a93c-4068-a478-fad2ff9b8fb7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:50:08.836783 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-bd97d053-a93c-4068-a478-fad2ff9b8fb7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:50:08.842334 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 953/1908] 10.222.0.58 () {58 vars in 1232 bytes} [Tue Oct 12 16:50:08 2021] DELETE /identity/v3/projects/10ffc3749dea4c4bb03f685b13e04077 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 16:50:08.845301 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fe99bb-7401-4688-b8b7-6ab7187aca61 None None] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:50:08.845585 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fe99bb-7401-4688-b8b7-6ab7187aca61 None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:50:08.845933 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fe99bb-7401-4688-b8b7-6ab7187aca61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:50:08.868802 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.auth.core [None req-55fe99bb-7401-4688-b8b7-6ab7187aca61 None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:50:08.870053 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-55fe99bb-7401-4688-b8b7-6ab7187aca61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:50:08.881523 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcaa256-9d65-4613-858b-1db9194e093d admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:50:08.887750 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72390db-b7d8-4261-a045-ffe18b76cfa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:50:08.888451 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72390db-b7d8-4261-a045-ffe18b76cfa0 admin admin] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:50:08.888739 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72390db-b7d8-4261-a045-ffe18b76cfa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:50:08.889039 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72390db-b7d8-4261-a045-ffe18b76cfa0 admin admin] PATH_INFO: `/v3/users` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:50:08.889744 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72390db-b7d8-4261-a045-ffe18b76cfa0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:50:08.891729 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72390db-b7d8-4261-a045-ffe18b76cfa0 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:50:08.913778 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 956/1909] 10.222.0.58 () {60 vars in 1143 bytes} [Tue Oct 12 16:50:08 2021] POST /identity/v3/users => generated 292 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:50:08.917708 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72390db-b7d8-4261-a045-ffe18b76cfa0 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:50:08.919559 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-a72390db-b7d8-4261-a045-ffe18b76cfa0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:50:08.940472 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 954/1910] 10.222.0.58 () {58 vars in 957 bytes} [Tue Oct 12 16:50:08 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:50:08.942239 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09b867e-d227-42e4-a7b1-32827bba476a None None] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:50:08.942696 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09b867e-d227-42e4-a7b1-32827bba476a None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:50:08.942980 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09b867e-d227-42e4-a7b1-32827bba476a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:50:08.943982 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72390db-b7d8-4261-a045-ffe18b76cfa0 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:50:08.950282 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9b78d6-bfd6-4e94-b35b-00eff62c4d92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:50:08.951263 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9b78d6-bfd6-4e94-b35b-00eff62c4d92 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:50:08.951769 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9b78d6-bfd6-4e94-b35b-00eff62c4d92 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:50:08.952250 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9b78d6-bfd6-4e94-b35b-00eff62c4d92 admin admin] PATH_INFO: `/v3/roles` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:50:08.953205 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9b78d6-bfd6-4e94-b35b-00eff62c4d92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:50:08.955041 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9b78d6-bfd6-4e94-b35b-00eff62c4d92 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:50:08.965832 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.auth.core [None req-d09b867e-d227-42e4-a7b1-32827bba476a None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:50:08.967099 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-d09b867e-d227-42e4-a7b1-32827bba476a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:50:08.970259 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 957/1911] 10.222.0.58 () {58 vars in 1121 bytes} [Tue Oct 12 16:50:08 2021] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 16:50:08.976327 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9b78d6-bfd6-4e94-b35b-00eff62c4d92 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:50:08.976736 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 955/1912] 10.222.0.58 () {58 vars in 957 bytes} [Tue Oct 12 16:50:08 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:50:08.988513 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09b867e-d227-42e4-a7b1-32827bba476a None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:50:08.993006 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9b78d6-bfd6-4e94-b35b-00eff62c4d92 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:50:09.004102 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2f10bd-3cb1-4cb0-9dba-6999d0271400 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:50:09.007650 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09b867e-d227-42e4-a7b1-32827bba476a None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:50:09.008411 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2f10bd-3cb1-4cb0-9dba-6999d0271400 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:50:09.008842 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2f10bd-3cb1-4cb0-9dba-6999d0271400 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:50:09.009208 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2f10bd-3cb1-4cb0-9dba-6999d0271400 admin admin] PATH_INFO: `/v3/roles` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:50:09.010225 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2f10bd-3cb1-4cb0-9dba-6999d0271400 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:50:09.012983 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2f10bd-3cb1-4cb0-9dba-6999d0271400 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:50:09.024545 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc887893-a257-45e7-acac-f21afa2f9891 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:50:09.025364 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc887893-a257-45e7-acac-f21afa2f9891 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:50:09.025740 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc887893-a257-45e7-acac-f21afa2f9891 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:50:09.026132 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc887893-a257-45e7-acac-f21afa2f9891 admin admin] PATH_INFO: `/v3/domains` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:50:09.026970 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc887893-a257-45e7-acac-f21afa2f9891 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:50:09.028356 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc887893-a257-45e7-acac-f21afa2f9891 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:50:09.030996 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc887893-a257-45e7-acac-f21afa2f9891 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:50:09.042942 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 958/1913] 10.222.0.58 () {58 vars in 1121 bytes} [Tue Oct 12 16:50:08 2021] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:50:09.043874 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2f10bd-3cb1-4cb0-9dba-6999d0271400 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:50:09.045511 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 956/1914] 10.222.0.58 () {58 vars in 1152 bytes} [Tue Oct 12 16:50:08 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:50:09.049417 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc887893-a257-45e7-acac-f21afa2f9891 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:50:09.061249 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc887893-a257-45e7-acac-f21afa2f9891 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:50:09.066945 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50d02cb-12be-4fe2-887b-6ca73528d1bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:50:09.067867 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50d02cb-12be-4fe2-887b-6ca73528d1bb admin admin] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:50:09.068267 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50d02cb-12be-4fe2-887b-6ca73528d1bb admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:50:09.068974 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50d02cb-12be-4fe2-887b-6ca73528d1bb admin admin] PATH_INFO: `/v3/projects` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:50:09.070149 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2f10bd-3cb1-4cb0-9dba-6999d0271400 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:50:09.070418 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50d02cb-12be-4fe2-887b-6ca73528d1bb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:50:09.072874 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50d02cb-12be-4fe2-887b-6ca73528d1bb admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:50:09.075922 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afb23c5-c2f5-424d-9b30-8ba868bf5cf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:50:09.076977 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afb23c5-c2f5-424d-9b30-8ba868bf5cf7 admin admin] REQUEST_METHOD: `PUT` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:50:09.077420 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afb23c5-c2f5-424d-9b30-8ba868bf5cf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:50:09.077698 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afb23c5-c2f5-424d-9b30-8ba868bf5cf7 admin admin] PATH_INFO: `/v3/projects/a4090b819f2c43da9e9bbae08ade9a79/users/7b7a1c26e06f45e68291dd72d3f5d5ba/roles/55ba49fe29884e64b57c3ad13188d554` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:50:09.094181 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afb23c5-c2f5-424d-9b30-8ba868bf5cf7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a4090b819f2c43da9e9bbae08ade9a79, user_id=7b7a1c26e06f45e68291dd72d3f5d5ba, role_id=55ba49fe29884e64b57c3ad13188d554)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:50:09.097433 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afb23c5-c2f5-424d-9b30-8ba868bf5cf7 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:50:09.105989 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 957/1915] 10.222.0.58 () {60 vars in 1152 bytes} [Tue Oct 12 16:50:09 2021] POST /identity/v3/projects => generated 371 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:50:09.108731 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50d02cb-12be-4fe2-887b-6ca73528d1bb admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:50:09.115287 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 959/1916] 10.222.0.58 () {60 vars in 1482 bytes} [Tue Oct 12 16:50:09 2021] PUT /identity/v3/projects/a4090b819f2c43da9e9bbae08ade9a79/users/7b7a1c26e06f45e68291dd72d3f5d5ba/roles/55ba49fe29884e64b57c3ad13188d554 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:50:09.121383 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b02ee36-79ea-4f14-b91d-295eb9ff0a8b None None] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:50:09.121804 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b02ee36-79ea-4f14-b91d-295eb9ff0a8b None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:50:09.122172 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b02ee36-79ea-4f14-b91d-295eb9ff0a8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:50:09.152769 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.auth.core [None req-9b02ee36-79ea-4f14-b91d-295eb9ff0a8b None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:50:09.154110 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-9b02ee36-79ea-4f14-b91d-295eb9ff0a8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:50:09.181095 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50d02cb-12be-4fe2-887b-6ca73528d1bb admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:50:09.220182 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 960/1917] 10.222.0.58 () {58 vars in 957 bytes} [Tue Oct 12 16:50:09 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:50:09.230988 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b02ee36-79ea-4f14-b91d-295eb9ff0a8b None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:50:09.232797 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-9b02ee36-79ea-4f14-b91d-295eb9ff0a8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:50:09.246287 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6973bcb-b27e-4097-ac4c-502889c14494 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:50:09.247066 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6973bcb-b27e-4097-ac4c-502889c14494 admin admin] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:50:09.247430 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6973bcb-b27e-4097-ac4c-502889c14494 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:50:09.247781 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6973bcb-b27e-4097-ac4c-502889c14494 admin admin] PATH_INFO: `/v3/users` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:50:09.248562 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6973bcb-b27e-4097-ac4c-502889c14494 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:50:09.250565 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6973bcb-b27e-4097-ac4c-502889c14494 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:50:09.278612 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 958/1918] 10.222.0.58 () {60 vars in 1143 bytes} [Tue Oct 12 16:50:09 2021] POST /identity/v3/users => generated 286 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:50:09.282704 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6973bcb-b27e-4097-ac4c-502889c14494 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:50:09.303036 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b02ee36-79ea-4f14-b91d-295eb9ff0a8b None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:50:09.310366 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43798d38-4540-4935-a8aa-20f47153201e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e65f6d0598e4c539134292b86fb43d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:50:09.311009 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43798d38-4540-4935-a8aa-20f47153201e service neutron] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:50:09.311525 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43798d38-4540-4935-a8aa-20f47153201e service neutron] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:50:09.312018 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43798d38-4540-4935-a8aa-20f47153201e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:50:09.314538 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6973bcb-b27e-4097-ac4c-502889c14494 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:50:09.323785 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae386423-8b32-4d19-99e3-7e8fcabcbc11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:50:09.325140 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae386423-8b32-4d19-99e3-7e8fcabcbc11 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:50:09.325571 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae386423-8b32-4d19-99e3-7e8fcabcbc11 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:50:09.326129 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae386423-8b32-4d19-99e3-7e8fcabcbc11 admin admin] PATH_INFO: `/v3/roles` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:50:09.326675 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43798d38-4540-4935-a8aa-20f47153201e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:50:09.327578 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae386423-8b32-4d19-99e3-7e8fcabcbc11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:50:09.328984 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43798d38-4540-4935-a8aa-20f47153201e service neutron] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:50:09.329604 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae386423-8b32-4d19-99e3-7e8fcabcbc11 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:50:09.343148 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 959/1919] 10.222.0.58 () {58 vars in 1121 bytes} [Tue Oct 12 16:50:09 2021] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:50:09.347676 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae386423-8b32-4d19-99e3-7e8fcabcbc11 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:50:09.354533 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 961/1920] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Oct 12 16:50:09 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 12 16:50:09.367900 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae386423-8b32-4d19-99e3-7e8fcabcbc11 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:50:09.374255 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9367a7b-96ae-47cb-93b7-a25d3a8d1e00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:50:09.375108 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9367a7b-96ae-47cb-93b7-a25d3a8d1e00 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:50:09.375748 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9367a7b-96ae-47cb-93b7-a25d3a8d1e00 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:50:09.376151 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9367a7b-96ae-47cb-93b7-a25d3a8d1e00 admin admin] PATH_INFO: `/v3/roles` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:50:09.376891 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9367a7b-96ae-47cb-93b7-a25d3a8d1e00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:50:09.378582 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9367a7b-96ae-47cb-93b7-a25d3a8d1e00 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:50:09.389915 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 960/1921] 10.222.0.58 () {58 vars in 1121 bytes} [Tue Oct 12 16:50:09 2021] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:50:09.393732 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43798d38-4540-4935-a8aa-20f47153201e service neutron] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:50:09.408407 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43798d38-4540-4935-a8aa-20f47153201e service neutron] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:50:09.414122 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd5bd40-30bf-49da-b459-f377130eb13b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:50:09.415323 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd5bd40-30bf-49da-b459-f377130eb13b admin admin] REQUEST_METHOD: `PUT` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:50:09.415789 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd5bd40-30bf-49da-b459-f377130eb13b admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:50:09.416276 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd5bd40-30bf-49da-b459-f377130eb13b admin admin] PATH_INFO: `/v3/projects/9eecf5f736d944d6bb4d373efa9d16db/users/a4b2efcb30314209a8c0366c9168836e/roles/55ba49fe29884e64b57c3ad13188d554` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:50:09.434076 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd5bd40-30bf-49da-b459-f377130eb13b admin admin] RBAC: Authorizing `identity:create_grant(project_id=9eecf5f736d944d6bb4d373efa9d16db, user_id=a4b2efcb30314209a8c0366c9168836e, role_id=55ba49fe29884e64b57c3ad13188d554)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:50:09.438303 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd5bd40-30bf-49da-b459-f377130eb13b admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:50:09.467824 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 962/1922] 10.222.0.58 () {60 vars in 1482 bytes} [Tue Oct 12 16:50:09 2021] PUT /identity/v3/projects/9eecf5f736d944d6bb4d373efa9d16db/users/a4b2efcb30314209a8c0366c9168836e/roles/55ba49fe29884e64b57c3ad13188d554 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:50:09.473456 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b17afe-681c-48e4-87fb-7a3fae35713d None None] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:50:09.474085 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b17afe-681c-48e4-87fb-7a3fae35713d None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:50:09.474543 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b17afe-681c-48e4-87fb-7a3fae35713d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:50:09.493935 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.auth.core [None req-01b17afe-681c-48e4-87fb-7a3fae35713d None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:50:09.495271 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-01b17afe-681c-48e4-87fb-7a3fae35713d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:50:09.590640 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 961/1923] 10.222.0.58 () {58 vars in 957 bytes} [Tue Oct 12 16:50:09 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:50:09.601418 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd5bd40-30bf-49da-b459-f377130eb13b admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:50:09.604273 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-abd5bd40-30bf-49da-b459-f377130eb13b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:50:09.665284 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd5bd40-30bf-49da-b459-f377130eb13b admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:50:09.669447 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d05c41e-3e0a-4314-8e8f-8d1c8649b190 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e65f6d0598e4c539134292b86fb43d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:50:09.670154 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d05c41e-3e0a-4314-8e8f-8d1c8649b190 service neutron] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:50:09.670435 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d05c41e-3e0a-4314-8e8f-8d1c8649b190 service neutron] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:50:09.670714 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d05c41e-3e0a-4314-8e8f-8d1c8649b190 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:50:09.684185 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d05c41e-3e0a-4314-8e8f-8d1c8649b190 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:50:09.685951 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d05c41e-3e0a-4314-8e8f-8d1c8649b190 service neutron] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:50:09.699918 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 963/1924] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Oct 12 16:50:09 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 12 16:50:10.347108 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addb4a51-3c67-4d30-a14a-3c4ff41cc989 None None] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:50:10.347603 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addb4a51-3c67-4d30-a14a-3c4ff41cc989 None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:50:10.347739 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addb4a51-3c67-4d30-a14a-3c4ff41cc989 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:50:10.394525 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.auth.core [None req-addb4a51-3c67-4d30-a14a-3c4ff41cc989 None None] MFA Rules not processed for user `7b7a1c26e06f45e68291dd72d3f5d5ba`. Rule list: `[]` (Enabled: `True`). {{(pid=85205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:50:10.396084 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-addb4a51-3c67-4d30-a14a-3c4ff41cc989 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:50:10.526733 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 962/1925] 10.222.0.58 () {58 vars in 957 bytes} [Tue Oct 12 16:50:10 2021] POST /identity/v3/auth/tokens => generated 3403 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:50:10.532512 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d05c41e-3e0a-4314-8e8f-8d1c8649b190 service neutron] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:50:10.535111 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-2d05c41e-3e0a-4314-8e8f-8d1c8649b190 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:50:10.698155 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d05c41e-3e0a-4314-8e8f-8d1c8649b190 service neutron] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:50:10.703036 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6925221-6fe3-454b-bef8-2c91e18f6011 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04704222b3d64a33a6c092fc641ccbb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:50:10.704343 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6925221-6fe3-454b-bef8-2c91e18f6011 service cinder] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:50:10.704785 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6925221-6fe3-454b-bef8-2c91e18f6011 service cinder] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:50:10.705164 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6925221-6fe3-454b-bef8-2c91e18f6011 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:50:10.728104 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6925221-6fe3-454b-bef8-2c91e18f6011 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:50:10.731357 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6925221-6fe3-454b-bef8-2c91e18f6011 service cinder] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:50:10.750856 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 964/1926] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Oct 12 16:50:10 2021] GET /identity/v3/auth/tokens => generated 3403 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 12 16:50:11.318014 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c605a0c-edfc-4b1e-96c1-d971d8d743b3 None None] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:50:11.318313 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c605a0c-edfc-4b1e-96c1-d971d8d743b3 None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:50:11.319585 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c605a0c-edfc-4b1e-96c1-d971d8d743b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:50:11.358790 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.auth.core [None req-9c605a0c-edfc-4b1e-96c1-d971d8d743b3 None None] MFA Rules not processed for user `a4b2efcb30314209a8c0366c9168836e`. Rule list: `[]` (Enabled: `True`). {{(pid=85205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:50:11.361247 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-9c605a0c-edfc-4b1e-96c1-d971d8d743b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:50:11.453177 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 963/1927] 10.222.0.58 () {58 vars in 957 bytes} [Tue Oct 12 16:50:11 2021] POST /identity/v3/auth/tokens => generated 3391 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:50:11.465362 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6925221-6fe3-454b-bef8-2c91e18f6011 service cinder] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:50:11.475882 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6925221-6fe3-454b-bef8-2c91e18f6011 service cinder] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:50:11.484063 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51def7c-33a9-43af-a35e-6f6b7ea922f2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04704222b3d64a33a6c092fc641ccbb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:50:11.485196 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51def7c-33a9-43af-a35e-6f6b7ea922f2 service cinder] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:50:11.485587 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51def7c-33a9-43af-a35e-6f6b7ea922f2 service cinder] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:50:11.486043 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51def7c-33a9-43af-a35e-6f6b7ea922f2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:50:11.499446 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51def7c-33a9-43af-a35e-6f6b7ea922f2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:50:11.501309 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51def7c-33a9-43af-a35e-6f6b7ea922f2 service cinder] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:50:11.513980 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 965/1928] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Oct 12 16:50:11 2021] GET /identity/v3/auth/tokens => generated 3391 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:50:11.890558 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c605a0c-edfc-4b1e-96c1-d971d8d743b3 None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:50:11.892035 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-9c605a0c-edfc-4b1e-96c1-d971d8d743b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:50:11.912248 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c605a0c-edfc-4b1e-96c1-d971d8d743b3 None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:50:11.916753 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c405504-fcbc-45d6-9857-7293d9ef561e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:50:11.917625 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c405504-fcbc-45d6-9857-7293d9ef561e admin admin] REQUEST_METHOD: `DELETE` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:50:11.917934 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c405504-fcbc-45d6-9857-7293d9ef561e admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:50:11.918399 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c405504-fcbc-45d6-9857-7293d9ef561e admin admin] PATH_INFO: `/v3/users/585b92a5b9a14b4d852e8b4eb9341d75` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:50:11.919813 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c405504-fcbc-45d6-9857-7293d9ef561e admin admin] RBAC: Authorizing `identity:delete_user(user_id=585b92a5b9a14b4d852e8b4eb9341d75)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:50:11.921700 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c405504-fcbc-45d6-9857-7293d9ef561e admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:50:11.972990 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-0c405504-fcbc-45d6-9857-7293d9ef561e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '585b92a5b9a14b4d852e8b4eb9341d75'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:50:11.992077 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-0c405504-fcbc-45d6-9857-7293d9ef561e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '585b92a5b9a14b4d852e8b4eb9341d75'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:50:12.003731 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-0c405504-fcbc-45d6-9857-7293d9ef561e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '585b92a5b9a14b4d852e8b4eb9341d75'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:50:12.013186 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-0c405504-fcbc-45d6-9857-7293d9ef561e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '585b92a5b9a14b4d852e8b4eb9341d75'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:50:12.014522 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-0c405504-fcbc-45d6-9857-7293d9ef561e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '585b92a5b9a14b4d852e8b4eb9341d75'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:50:12.021739 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 964/1929] 10.222.0.58 () {58 vars in 1223 bytes} [Tue Oct 12 16:50:11 2021] DELETE /identity/v3/users/585b92a5b9a14b4d852e8b4eb9341d75 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:50:12.026589 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69859b5b-e7f6-4644-8087-d5c5fe573e22 None None] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:50:12.027609 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69859b5b-e7f6-4644-8087-d5c5fe573e22 None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:50:12.029712 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69859b5b-e7f6-4644-8087-d5c5fe573e22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:50:12.063635 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.auth.core [None req-69859b5b-e7f6-4644-8087-d5c5fe573e22 None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:50:12.065945 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-69859b5b-e7f6-4644-8087-d5c5fe573e22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:50:12.161910 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 966/1930] 10.222.0.58 () {58 vars in 957 bytes} [Tue Oct 12 16:50:12 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:50:12.173064 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c405504-fcbc-45d6-9857-7293d9ef561e admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:50:12.174770 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-0c405504-fcbc-45d6-9857-7293d9ef561e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:50:12.264326 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85190e9d-5b67-4338-8d5d-bf116682a635 None None] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:50:12.265189 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85190e9d-5b67-4338-8d5d-bf116682a635 None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:50:12.265574 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85190e9d-5b67-4338-8d5d-bf116682a635 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:50:12.272405 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c405504-fcbc-45d6-9857-7293d9ef561e admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:50:12.277127 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037a9973-8eae-4a70-a4c5-ec8843ed2e09 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e65f6d0598e4c539134292b86fb43d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:50:12.278043 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037a9973-8eae-4a70-a4c5-ec8843ed2e09 service neutron] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:50:12.278628 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037a9973-8eae-4a70-a4c5-ec8843ed2e09 service neutron] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:50:12.279053 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037a9973-8eae-4a70-a4c5-ec8843ed2e09 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:50:12.298511 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037a9973-8eae-4a70-a4c5-ec8843ed2e09 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:50:12.300143 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037a9973-8eae-4a70-a4c5-ec8843ed2e09 service neutron] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:50:12.311706 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 965/1931] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Oct 12 16:50:12 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:50:12.317506 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.auth.core [None req-85190e9d-5b67-4338-8d5d-bf116682a635 None None] MFA Rules not processed for user `7b7a1c26e06f45e68291dd72d3f5d5ba`. Rule list: `[]` (Enabled: `True`). {{(pid=85204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:50:12.321706 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-85190e9d-5b67-4338-8d5d-bf116682a635 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:50:12.457996 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 967/1932] 10.222.0.58 () {58 vars in 957 bytes} [Tue Oct 12 16:50:12 2021] POST /identity/v3/auth/tokens => generated 3403 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:50:12.919721 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc3d022-6ebb-4f7f-a9d1-4840beb65fa5 None None] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:50:12.920774 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc3d022-6ebb-4f7f-a9d1-4840beb65fa5 None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:50:12.921201 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc3d022-6ebb-4f7f-a9d1-4840beb65fa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:50:12.940102 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.auth.core [None req-ccc3d022-6ebb-4f7f-a9d1-4840beb65fa5 None None] MFA Rules not processed for user `a4b2efcb30314209a8c0366c9168836e`. Rule list: `[]` (Enabled: `True`). {{(pid=85205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:50:12.941316 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-ccc3d022-6ebb-4f7f-a9d1-4840beb65fa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:50:12.993515 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85190e9d-5b67-4338-8d5d-bf116682a635 None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:50:12.995035 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-85190e9d-5b67-4338-8d5d-bf116682a635 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:50:13.000257 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 966/1933] 10.222.0.58 () {58 vars in 957 bytes} [Tue Oct 12 16:50:12 2021] POST /identity/v3/auth/tokens => generated 3391 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:50:13.021419 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85190e9d-5b67-4338-8d5d-bf116682a635 None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:50:13.027564 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8975bfde-0f3d-42be-8bef-dff89b60660a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:50:13.028490 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8975bfde-0f3d-42be-8bef-dff89b60660a admin admin] REQUEST_METHOD: `DELETE` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:50:13.028731 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8975bfde-0f3d-42be-8bef-dff89b60660a admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:50:13.029051 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8975bfde-0f3d-42be-8bef-dff89b60660a admin admin] PATH_INFO: `/v3/projects/6072ad99404a417899492cc8063172e3` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:50:13.030298 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8975bfde-0f3d-42be-8bef-dff89b60660a admin admin] RBAC: Authorizing `identity:delete_project(project_id=6072ad99404a417899492cc8063172e3)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:50:13.032783 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8975bfde-0f3d-42be-8bef-dff89b60660a admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:50:13.106329 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-8975bfde-0f3d-42be-8bef-dff89b60660a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6072ad99404a417899492cc8063172e3', 'request_id': 'req-8975bfde-0f3d-42be-8bef-dff89b60660a'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:50:13.113381 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-8975bfde-0f3d-42be-8bef-dff89b60660a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6072ad99404a417899492cc8063172e3', 'request_id': 'req-8975bfde-0f3d-42be-8bef-dff89b60660a'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:50:13.122373 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-8975bfde-0f3d-42be-8bef-dff89b60660a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6072ad99404a417899492cc8063172e3', 'request_id': 'req-8975bfde-0f3d-42be-8bef-dff89b60660a'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:50:13.139987 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-8975bfde-0f3d-42be-8bef-dff89b60660a admin admin] The token cache is being invalidate because project 6072ad99404a417899492cc8063172e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=85204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 16:50:13.140338 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-8975bfde-0f3d-42be-8bef-dff89b60660a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:50:13.140979 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-8975bfde-0f3d-42be-8bef-dff89b60660a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:50:13.145791 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 968/1934] 10.222.0.58 () {58 vars in 1232 bytes} [Tue Oct 12 16:50:12 2021] DELETE /identity/v3/projects/6072ad99404a417899492cc8063172e3 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 16:50:13.146886 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc3d022-6ebb-4f7f-a9d1-4840beb65fa5 None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:50:13.158538 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc3d022-6ebb-4f7f-a9d1-4840beb65fa5 None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:50:13.234304 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f324add7-9ff4-4e38-9a42-943963763c27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:50:13.235200 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f324add7-9ff4-4e38-9a42-943963763c27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:50:13.235486 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f324add7-9ff4-4e38-9a42-943963763c27 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:50:13.235808 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f324add7-9ff4-4e38-9a42-943963763c27 admin admin] PATH_INFO: `/v3/users/bfd3014796044d3aa031ede4d3eeb6d8` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:50:13.237294 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f324add7-9ff4-4e38-9a42-943963763c27 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bfd3014796044d3aa031ede4d3eeb6d8)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:50:13.239343 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f324add7-9ff4-4e38-9a42-943963763c27 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:50:13.307592 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-f324add7-9ff4-4e38-9a42-943963763c27 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bfd3014796044d3aa031ede4d3eeb6d8'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:50:13.331355 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-f324add7-9ff4-4e38-9a42-943963763c27 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bfd3014796044d3aa031ede4d3eeb6d8'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:50:13.346876 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-f324add7-9ff4-4e38-9a42-943963763c27 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bfd3014796044d3aa031ede4d3eeb6d8'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:50:13.356967 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-f324add7-9ff4-4e38-9a42-943963763c27 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bfd3014796044d3aa031ede4d3eeb6d8'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:50:13.357712 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-f324add7-9ff4-4e38-9a42-943963763c27 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bfd3014796044d3aa031ede4d3eeb6d8'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:50:13.384286 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 967/1935] 10.222.0.58 () {58 vars in 1223 bytes} [Tue Oct 12 16:50:13 2021] DELETE /identity/v3/users/bfd3014796044d3aa031ede4d3eeb6d8 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:50:13.709434 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8975bfde-0f3d-42be-8bef-dff89b60660a admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:50:13.711637 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-8975bfde-0f3d-42be-8bef-dff89b60660a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:50:13.726961 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8975bfde-0f3d-42be-8bef-dff89b60660a admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:50:13.810432 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8600f442-f986-4c97-83ee-bf2fd41f2187 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:50:13.811326 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8600f442-f986-4c97-83ee-bf2fd41f2187 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:50:13.811611 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8600f442-f986-4c97-83ee-bf2fd41f2187 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:50:13.811890 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8600f442-f986-4c97-83ee-bf2fd41f2187 admin admin] PATH_INFO: `/v3/projects/ca90605746d14c81835185a0f27023c9` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:50:13.813905 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8600f442-f986-4c97-83ee-bf2fd41f2187 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ca90605746d14c81835185a0f27023c9)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:50:13.816113 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8600f442-f986-4c97-83ee-bf2fd41f2187 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:50:13.880972 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-8600f442-f986-4c97-83ee-bf2fd41f2187 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca90605746d14c81835185a0f27023c9', 'request_id': 'req-8600f442-f986-4c97-83ee-bf2fd41f2187'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:50:13.887165 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-8600f442-f986-4c97-83ee-bf2fd41f2187 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca90605746d14c81835185a0f27023c9', 'request_id': 'req-8600f442-f986-4c97-83ee-bf2fd41f2187'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:50:13.893586 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-8600f442-f986-4c97-83ee-bf2fd41f2187 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca90605746d14c81835185a0f27023c9', 'request_id': 'req-8600f442-f986-4c97-83ee-bf2fd41f2187'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:50:13.910645 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-8600f442-f986-4c97-83ee-bf2fd41f2187 admin admin] The token cache is being invalidate because project ca90605746d14c81835185a0f27023c9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=85204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 16:50:13.911032 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-8600f442-f986-4c97-83ee-bf2fd41f2187 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:50:13.912058 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-8600f442-f986-4c97-83ee-bf2fd41f2187 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:50:13.917371 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 969/1936] 10.222.0.58 () {58 vars in 1232 bytes} [Tue Oct 12 16:50:13 2021] DELETE /identity/v3/projects/ca90605746d14c81835185a0f27023c9 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:50:13.919284 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f324add7-9ff4-4e38-9a42-943963763c27 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:50:13.923618 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-f324add7-9ff4-4e38-9a42-943963763c27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:50:13.943575 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f324add7-9ff4-4e38-9a42-943963763c27 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:50:14.011059 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48952984-c931-4e93-9624-f93294be6d3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:50:14.011939 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48952984-c931-4e93-9624-f93294be6d3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:50:14.012230 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48952984-c931-4e93-9624-f93294be6d3b admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:50:14.012508 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48952984-c931-4e93-9624-f93294be6d3b admin admin] PATH_INFO: `/v3/users/f2f01d1fc5394c508e3f54b8a947cf8b` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:50:14.013716 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48952984-c931-4e93-9624-f93294be6d3b admin admin] RBAC: Authorizing `identity:delete_user(user_id=f2f01d1fc5394c508e3f54b8a947cf8b)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:50:14.015832 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48952984-c931-4e93-9624-f93294be6d3b admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:50:14.066989 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-48952984-c931-4e93-9624-f93294be6d3b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f2f01d1fc5394c508e3f54b8a947cf8b'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:50:14.079470 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-48952984-c931-4e93-9624-f93294be6d3b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f2f01d1fc5394c508e3f54b8a947cf8b'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:50:14.087228 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-48952984-c931-4e93-9624-f93294be6d3b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f2f01d1fc5394c508e3f54b8a947cf8b'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:50:14.093941 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-48952984-c931-4e93-9624-f93294be6d3b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f2f01d1fc5394c508e3f54b8a947cf8b'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:50:14.094611 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-48952984-c931-4e93-9624-f93294be6d3b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f2f01d1fc5394c508e3f54b8a947cf8b'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:50:14.100818 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 968/1937] 10.222.0.58 () {58 vars in 1223 bytes} [Tue Oct 12 16:50:13 2021] DELETE /identity/v3/users/f2f01d1fc5394c508e3f54b8a947cf8b => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:50:14.368653 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8600f442-f986-4c97-83ee-bf2fd41f2187 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:50:14.370162 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-8600f442-f986-4c97-83ee-bf2fd41f2187 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:50:14.383986 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8600f442-f986-4c97-83ee-bf2fd41f2187 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:50:14.444993 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8d0498-7ac4-49c2-b185-81e85286da97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:50:14.445855 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8d0498-7ac4-49c2-b185-81e85286da97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:50:14.446174 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8d0498-7ac4-49c2-b185-81e85286da97 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:50:14.446453 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8d0498-7ac4-49c2-b185-81e85286da97 admin admin] PATH_INFO: `/v3/projects/0e3c9abe184f43f988e77e2e16ee1357` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:50:14.447649 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8d0498-7ac4-49c2-b185-81e85286da97 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e3c9abe184f43f988e77e2e16ee1357)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:50:14.449537 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8d0498-7ac4-49c2-b185-81e85286da97 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:50:14.493620 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-0c8d0498-7ac4-49c2-b185-81e85286da97 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e3c9abe184f43f988e77e2e16ee1357', 'request_id': 'req-0c8d0498-7ac4-49c2-b185-81e85286da97'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:50:14.498778 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-0c8d0498-7ac4-49c2-b185-81e85286da97 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e3c9abe184f43f988e77e2e16ee1357', 'request_id': 'req-0c8d0498-7ac4-49c2-b185-81e85286da97'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:50:14.504518 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-0c8d0498-7ac4-49c2-b185-81e85286da97 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e3c9abe184f43f988e77e2e16ee1357', 'request_id': 'req-0c8d0498-7ac4-49c2-b185-81e85286da97'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:50:14.516303 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-0c8d0498-7ac4-49c2-b185-81e85286da97 admin admin] The token cache is being invalidate because project 0e3c9abe184f43f988e77e2e16ee1357 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=85204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 16:50:14.516596 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-0c8d0498-7ac4-49c2-b185-81e85286da97 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:50:14.517216 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-0c8d0498-7ac4-49c2-b185-81e85286da97 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:50:14.518768 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 970/1938] 10.222.0.58 () {58 vars in 1232 bytes} [Tue Oct 12 16:50:14 2021] DELETE /identity/v3/projects/0e3c9abe184f43f988e77e2e16ee1357 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:50:14.525996 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30abb4ac-fafc-4896-b937-05a6b1e0aa49 None None] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:50:14.526289 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30abb4ac-fafc-4896-b937-05a6b1e0aa49 None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:50:14.526569 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30abb4ac-fafc-4896-b937-05a6b1e0aa49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:50:14.543511 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.auth.core [None req-30abb4ac-fafc-4896-b937-05a6b1e0aa49 None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:50:14.544716 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-30abb4ac-fafc-4896-b937-05a6b1e0aa49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:50:14.608330 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 969/1939] 10.222.0.58 () {58 vars in 957 bytes} [Tue Oct 12 16:50:14 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:50:14.618216 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7cb5b3-b9a8-4ac9-898a-ad4a6cd87928 None None] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:50:14.618442 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7cb5b3-b9a8-4ac9-898a-ad4a6cd87928 None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:50:14.618722 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7cb5b3-b9a8-4ac9-898a-ad4a6cd87928 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:50:14.636828 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.auth.core [None req-3d7cb5b3-b9a8-4ac9-898a-ad4a6cd87928 None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:50:14.638158 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-3d7cb5b3-b9a8-4ac9-898a-ad4a6cd87928 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:50:14.645789 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 971/1940] 10.222.0.58 () {58 vars in 957 bytes} [Tue Oct 12 16:50:14 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:50:14.650377 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30abb4ac-fafc-4896-b937-05a6b1e0aa49 None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:50:14.659603 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30abb4ac-fafc-4896-b937-05a6b1e0aa49 None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:50:14.664075 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f625045-41e6-4917-92c2-5bf6528310b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:50:14.664717 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f625045-41e6-4917-92c2-5bf6528310b2 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:50:14.665001 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f625045-41e6-4917-92c2-5bf6528310b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:50:14.665275 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f625045-41e6-4917-92c2-5bf6528310b2 admin admin] PATH_INFO: `/v3/domains` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:50:14.666035 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f625045-41e6-4917-92c2-5bf6528310b2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:50:14.666344 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f625045-41e6-4917-92c2-5bf6528310b2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:50:14.667910 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f625045-41e6-4917-92c2-5bf6528310b2 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:50:14.678973 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 970/1941] 10.222.0.58 () {58 vars in 1152 bytes} [Tue Oct 12 16:50:14 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 16:50:14.683158 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7cb5b3-b9a8-4ac9-898a-ad4a6cd87928 None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:50:14.692254 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7cb5b3-b9a8-4ac9-898a-ad4a6cd87928 None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:50:14.697396 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c89ed2-967f-456a-8639-b3d03b4eaeff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:50:14.698081 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c89ed2-967f-456a-8639-b3d03b4eaeff admin admin] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:50:14.698365 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c89ed2-967f-456a-8639-b3d03b4eaeff admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:50:14.698638 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c89ed2-967f-456a-8639-b3d03b4eaeff admin admin] PATH_INFO: `/v3/projects` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:50:14.699349 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c89ed2-967f-456a-8639-b3d03b4eaeff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:50:14.701214 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c89ed2-967f-456a-8639-b3d03b4eaeff admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:50:14.725858 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 972/1942] 10.222.0.58 () {60 vars in 1152 bytes} [Tue Oct 12 16:50:14 2021] POST /identity/v3/projects => generated 365 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 16:50:14.730214 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f625045-41e6-4917-92c2-5bf6528310b2 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:50:14.740241 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f625045-41e6-4917-92c2-5bf6528310b2 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:50:14.794579 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e800fe-b148-461b-82e1-9a23b13bb469 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:50:14.795243 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e800fe-b148-461b-82e1-9a23b13bb469 admin admin] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:50:14.795530 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e800fe-b148-461b-82e1-9a23b13bb469 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:50:14.795808 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e800fe-b148-461b-82e1-9a23b13bb469 admin admin] PATH_INFO: `/v3/users` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:50:14.796510 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e800fe-b148-461b-82e1-9a23b13bb469 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:50:14.798426 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e800fe-b148-461b-82e1-9a23b13bb469 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:50:14.819870 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 971/1943] 10.222.0.58 () {60 vars in 1143 bytes} [Tue Oct 12 16:50:14 2021] POST /identity/v3/users => generated 283 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:50:14.824001 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c89ed2-967f-456a-8639-b3d03b4eaeff admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:50:14.834193 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c89ed2-967f-456a-8639-b3d03b4eaeff admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:50:14.838807 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9e1e23-fd21-4d7e-b630-7f427a73d3d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:50:14.839466 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9e1e23-fd21-4d7e-b630-7f427a73d3d1 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:50:14.839757 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9e1e23-fd21-4d7e-b630-7f427a73d3d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:50:14.840031 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9e1e23-fd21-4d7e-b630-7f427a73d3d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:50:14.840769 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9e1e23-fd21-4d7e-b630-7f427a73d3d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:50:14.842388 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9e1e23-fd21-4d7e-b630-7f427a73d3d1 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:50:14.852669 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 973/1944] 10.222.0.58 () {58 vars in 1121 bytes} [Tue Oct 12 16:50:14 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 16:50:14.856143 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e800fe-b148-461b-82e1-9a23b13bb469 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:50:14.866431 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e800fe-b148-461b-82e1-9a23b13bb469 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:50:14.871081 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22888115-e693-48a0-83a5-d3d3d1dd0c98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:50:14.871672 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22888115-e693-48a0-83a5-d3d3d1dd0c98 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:50:14.871960 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22888115-e693-48a0-83a5-d3d3d1dd0c98 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:50:14.872244 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22888115-e693-48a0-83a5-d3d3d1dd0c98 admin admin] PATH_INFO: `/v3/roles` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:50:14.872979 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22888115-e693-48a0-83a5-d3d3d1dd0c98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:50:14.874600 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22888115-e693-48a0-83a5-d3d3d1dd0c98 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:50:14.884614 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 972/1945] 10.222.0.58 () {58 vars in 1121 bytes} [Tue Oct 12 16:50:14 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:50:14.888383 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9e1e23-fd21-4d7e-b630-7f427a73d3d1 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:50:14.898097 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9e1e23-fd21-4d7e-b630-7f427a73d3d1 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:50:14.902640 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11acd2e4-2104-4763-b038-cbc175c922b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:50:14.903502 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11acd2e4-2104-4763-b038-cbc175c922b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:50:14.903790 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11acd2e4-2104-4763-b038-cbc175c922b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:50:14.904068 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11acd2e4-2104-4763-b038-cbc175c922b7 admin admin] PATH_INFO: `/v3/projects/2d4d9a7149a24886af84026c39e1b49a/users/6e04ee80a997492586998de7ca36a147/roles/55ba49fe29884e64b57c3ad13188d554` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:50:14.917821 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11acd2e4-2104-4763-b038-cbc175c922b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d4d9a7149a24886af84026c39e1b49a, user_id=6e04ee80a997492586998de7ca36a147, role_id=55ba49fe29884e64b57c3ad13188d554)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:50:14.920463 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11acd2e4-2104-4763-b038-cbc175c922b7 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:50:14.933711 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 974/1946] 10.222.0.58 () {60 vars in 1482 bytes} [Tue Oct 12 16:50:14 2021] PUT /identity/v3/projects/2d4d9a7149a24886af84026c39e1b49a/users/6e04ee80a997492586998de7ca36a147/roles/55ba49fe29884e64b57c3ad13188d554 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:50:14.945128 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447211a8-e3f2-4e3d-aabc-c9a30c7421e2 None None] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:50:14.945598 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447211a8-e3f2-4e3d-aabc-c9a30c7421e2 None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:50:14.945687 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447211a8-e3f2-4e3d-aabc-c9a30c7421e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:50:14.970883 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.auth.core [None req-447211a8-e3f2-4e3d-aabc-c9a30c7421e2 None None] MFA Rules not processed for user `6e04ee80a997492586998de7ca36a147`. Rule list: `[]` (Enabled: `True`). {{(pid=85205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:50:14.972086 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-447211a8-e3f2-4e3d-aabc-c9a30c7421e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:50:15.032721 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 973/1947] 10.222.0.58 () {58 vars in 957 bytes} [Tue Oct 12 16:50:14 2021] POST /identity/v3/auth/tokens => generated 3385 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:50:15.037073 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11acd2e4-2104-4763-b038-cbc175c922b7 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:50:15.094372 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11acd2e4-2104-4763-b038-cbc175c922b7 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:50:15.099105 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1656cc-5c40-4c53-accd-16c43493cdf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:50:15.099818 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1656cc-5c40-4c53-accd-16c43493cdf3 admin admin] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:50:15.100160 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1656cc-5c40-4c53-accd-16c43493cdf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:50:15.100437 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1656cc-5c40-4c53-accd-16c43493cdf3 admin admin] PATH_INFO: `/v3/projects` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:50:15.101130 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1656cc-5c40-4c53-accd-16c43493cdf3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:50:15.103062 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1656cc-5c40-4c53-accd-16c43493cdf3 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:50:15.128739 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 975/1948] 10.222.0.58 () {60 vars in 1152 bytes} [Tue Oct 12 16:50:15 2021] POST /identity/v3/projects => generated 365 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:50:15.132569 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447211a8-e3f2-4e3d-aabc-c9a30c7421e2 None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:50:15.142961 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447211a8-e3f2-4e3d-aabc-c9a30c7421e2 None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:50:15.197191 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8667ff9a-49b4-4dc0-bc64-db9100f2c6e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:50:15.197858 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8667ff9a-49b4-4dc0-bc64-db9100f2c6e0 admin admin] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:50:15.198179 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8667ff9a-49b4-4dc0-bc64-db9100f2c6e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:50:15.198459 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8667ff9a-49b4-4dc0-bc64-db9100f2c6e0 admin admin] PATH_INFO: `/v3/users` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:50:15.199170 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8667ff9a-49b4-4dc0-bc64-db9100f2c6e0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:50:15.201051 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8667ff9a-49b4-4dc0-bc64-db9100f2c6e0 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:50:15.225783 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 974/1949] 10.222.0.58 () {60 vars in 1143 bytes} [Tue Oct 12 16:50:15 2021] POST /identity/v3/users => generated 289 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:50:15.229701 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1656cc-5c40-4c53-accd-16c43493cdf3 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:50:15.239787 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1656cc-5c40-4c53-accd-16c43493cdf3 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:50:15.245187 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d058a9ec-eb9f-457f-8a7c-a979139985fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:50:15.245833 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d058a9ec-eb9f-457f-8a7c-a979139985fe admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:50:15.246145 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d058a9ec-eb9f-457f-8a7c-a979139985fe admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:50:15.246419 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d058a9ec-eb9f-457f-8a7c-a979139985fe admin admin] PATH_INFO: `/v3/roles` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:50:15.247151 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d058a9ec-eb9f-457f-8a7c-a979139985fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:50:15.248717 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d058a9ec-eb9f-457f-8a7c-a979139985fe admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:50:15.258805 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 976/1950] 10.222.0.58 () {58 vars in 1121 bytes} [Tue Oct 12 16:50:15 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:50:15.262630 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8667ff9a-49b4-4dc0-bc64-db9100f2c6e0 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:50:15.272051 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8667ff9a-49b4-4dc0-bc64-db9100f2c6e0 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:50:15.276634 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d68b0fd-ae15-410b-8795-142afe7ed547 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:50:15.277492 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d68b0fd-ae15-410b-8795-142afe7ed547 admin admin] REQUEST_METHOD: `PUT` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:50:15.277775 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d68b0fd-ae15-410b-8795-142afe7ed547 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:50:15.278094 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d68b0fd-ae15-410b-8795-142afe7ed547 admin admin] PATH_INFO: `/v3/projects/e59c304a50d3426bbcfbbfdc7e7161af/users/4f4ea63662dd41e2b64b9e50fe793224/roles/610824e4f50f4fb8954610e98c1de784` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:50:15.293166 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d68b0fd-ae15-410b-8795-142afe7ed547 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e59c304a50d3426bbcfbbfdc7e7161af, user_id=4f4ea63662dd41e2b64b9e50fe793224, role_id=610824e4f50f4fb8954610e98c1de784)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:50:15.298507 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d68b0fd-ae15-410b-8795-142afe7ed547 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:50:15.313772 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 975/1951] 10.222.0.58 () {60 vars in 1482 bytes} [Tue Oct 12 16:50:15 2021] PUT /identity/v3/projects/e59c304a50d3426bbcfbbfdc7e7161af/users/4f4ea63662dd41e2b64b9e50fe793224/roles/610824e4f50f4fb8954610e98c1de784 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 16:50:15.317683 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d058a9ec-eb9f-457f-8a7c-a979139985fe admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:50:15.328182 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d058a9ec-eb9f-457f-8a7c-a979139985fe admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:50:15.382527 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992fe1bd-3d9b-472c-b669-d4cdb72ab5b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:50:15.383198 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992fe1bd-3d9b-472c-b669-d4cdb72ab5b2 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:50:15.383381 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992fe1bd-3d9b-472c-b669-d4cdb72ab5b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:50:15.383654 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992fe1bd-3d9b-472c-b669-d4cdb72ab5b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:50:15.384417 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992fe1bd-3d9b-472c-b669-d4cdb72ab5b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:50:15.386018 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992fe1bd-3d9b-472c-b669-d4cdb72ab5b2 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:50:15.395385 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 977/1952] 10.222.0.58 () {58 vars in 1121 bytes} [Tue Oct 12 16:50:15 2021] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 16:50:15.399702 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d68b0fd-ae15-410b-8795-142afe7ed547 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:50:15.409651 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d68b0fd-ae15-410b-8795-142afe7ed547 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:50:15.414915 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ece67c-0199-45ac-ad34-af8dd8be08d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:50:15.415794 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ece67c-0199-45ac-ad34-af8dd8be08d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:50:15.416081 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ece67c-0199-45ac-ad34-af8dd8be08d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:50:15.416389 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ece67c-0199-45ac-ad34-af8dd8be08d2 admin admin] PATH_INFO: `/v3/projects/e59c304a50d3426bbcfbbfdc7e7161af/users/4f4ea63662dd41e2b64b9e50fe793224/roles/610824e4f50f4fb8954610e98c1de784` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:50:15.418465 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ece67c-0199-45ac-ad34-af8dd8be08d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e59c304a50d3426bbcfbbfdc7e7161af, user_id=4f4ea63662dd41e2b64b9e50fe793224, role_id=610824e4f50f4fb8954610e98c1de784)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:50:15.421110 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ece67c-0199-45ac-ad34-af8dd8be08d2 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:50:15.431988 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 976/1953] 10.222.0.58 () {60 vars in 1482 bytes} [Tue Oct 12 16:50:15 2021] PUT /identity/v3/projects/e59c304a50d3426bbcfbbfdc7e7161af/users/4f4ea63662dd41e2b64b9e50fe793224/roles/610824e4f50f4fb8954610e98c1de784 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:50:15.442950 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ea6f61-e61e-4918-9d0f-93f93683d248 None None] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:50:15.443241 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ea6f61-e61e-4918-9d0f-93f93683d248 None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:50:15.443519 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ea6f61-e61e-4918-9d0f-93f93683d248 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:50:15.468485 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.auth.core [None req-63ea6f61-e61e-4918-9d0f-93f93683d248 None None] MFA Rules not processed for user `4f4ea63662dd41e2b64b9e50fe793224`. Rule list: `[]` (Enabled: `True`). {{(pid=85204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:50:15.469666 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-63ea6f61-e61e-4918-9d0f-93f93683d248 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:50:15.534343 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 978/1954] 10.222.0.58 () {58 vars in 957 bytes} [Tue Oct 12 16:50:15 2021] POST /identity/v3/auth/tokens => generated 3452 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:50:15.545311 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ece67c-0199-45ac-ad34-af8dd8be08d2 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:50:15.547042 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-37ece67c-0199-45ac-ad34-af8dd8be08d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:50:15.605397 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ece67c-0199-45ac-ad34-af8dd8be08d2 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:50:15.609542 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1138988-8857-4c6f-9284-dac0267cb990 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04704222b3d64a33a6c092fc641ccbb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:50:15.610230 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1138988-8857-4c6f-9284-dac0267cb990 service cinder] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:50:15.610514 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1138988-8857-4c6f-9284-dac0267cb990 service cinder] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:50:15.610790 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1138988-8857-4c6f-9284-dac0267cb990 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:50:15.621227 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1138988-8857-4c6f-9284-dac0267cb990 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:50:15.623814 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1138988-8857-4c6f-9284-dac0267cb990 service cinder] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:50:15.634419 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 977/1955] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Oct 12 16:50:15 2021] GET /identity/v3/auth/tokens => generated 3452 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:50:15.712114 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ea6f61-e61e-4918-9d0f-93f93683d248 None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:50:15.721257 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ea6f61-e61e-4918-9d0f-93f93683d248 None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:50:15.724884 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a220cf76-43e2-470b-90aa-633b304c3140 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04704222b3d64a33a6c092fc641ccbb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:50:15.726130 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a220cf76-43e2-470b-90aa-633b304c3140 service cinder] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:50:15.726415 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a220cf76-43e2-470b-90aa-633b304c3140 service cinder] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:50:15.726694 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a220cf76-43e2-470b-90aa-633b304c3140 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:50:15.781991 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a220cf76-43e2-470b-90aa-633b304c3140 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:50:15.783425 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a220cf76-43e2-470b-90aa-633b304c3140 service cinder] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:50:15.792791 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 979/1956] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Oct 12 16:50:15 2021] GET /identity/v3/auth/tokens => generated 3385 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:50:23.884103 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1138988-8857-4c6f-9284-dac0267cb990 service cinder] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:50:23.969677 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1138988-8857-4c6f-9284-dac0267cb990 service cinder] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:50:23.975182 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ff2c0c-6239-4fff-ad3b-ac06b0db5f7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:50:23.976234 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ff2c0c-6239-4fff-ad3b-ac06b0db5f7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:50:23.976648 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ff2c0c-6239-4fff-ad3b-ac06b0db5f7d admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:50:23.977013 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ff2c0c-6239-4fff-ad3b-ac06b0db5f7d admin admin] PATH_INFO: `/v3/users/6e04ee80a997492586998de7ca36a147` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:50:23.993816 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ff2c0c-6239-4fff-ad3b-ac06b0db5f7d admin admin] RBAC: Authorizing `identity:delete_user(user_id=6e04ee80a997492586998de7ca36a147)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:50:23.996028 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ff2c0c-6239-4fff-ad3b-ac06b0db5f7d admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:50:24.078082 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-61ff2c0c-6239-4fff-ad3b-ac06b0db5f7d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6e04ee80a997492586998de7ca36a147'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:50:24.098273 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-61ff2c0c-6239-4fff-ad3b-ac06b0db5f7d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6e04ee80a997492586998de7ca36a147'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:50:24.112742 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-61ff2c0c-6239-4fff-ad3b-ac06b0db5f7d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6e04ee80a997492586998de7ca36a147'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:50:24.123029 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-61ff2c0c-6239-4fff-ad3b-ac06b0db5f7d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6e04ee80a997492586998de7ca36a147'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:50:24.123874 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-61ff2c0c-6239-4fff-ad3b-ac06b0db5f7d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6e04ee80a997492586998de7ca36a147'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:50:24.131905 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 978/1957] 10.222.0.58 () {58 vars in 1223 bytes} [Tue Oct 12 16:50:23 2021] DELETE /identity/v3/users/6e04ee80a997492586998de7ca36a147 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:50:24.136366 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ceaa4f-f4ee-4c64-bb8f-424159917f87 None None] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:50:24.136857 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ceaa4f-f4ee-4c64-bb8f-424159917f87 None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:50:24.137214 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ceaa4f-f4ee-4c64-bb8f-424159917f87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:50:24.172910 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.auth.core [None req-b6ceaa4f-f4ee-4c64-bb8f-424159917f87 None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:50:24.174401 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-b6ceaa4f-f4ee-4c64-bb8f-424159917f87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:50:24.312251 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 980/1958] 10.222.0.58 () {58 vars in 957 bytes} [Tue Oct 12 16:50:24 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:50:24.322594 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ff2c0c-6239-4fff-ad3b-ac06b0db5f7d admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:50:24.324088 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-61ff2c0c-6239-4fff-ad3b-ac06b0db5f7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:50:24.401345 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ff2c0c-6239-4fff-ad3b-ac06b0db5f7d admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:50:24.404972 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e857216f-ad19-44ad-94d4-30768587fa5e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e65f6d0598e4c539134292b86fb43d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:50:24.405637 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e857216f-ad19-44ad-94d4-30768587fa5e service neutron] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:50:24.405933 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e857216f-ad19-44ad-94d4-30768587fa5e service neutron] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:50:24.406291 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e857216f-ad19-44ad-94d4-30768587fa5e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:50:24.416359 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e857216f-ad19-44ad-94d4-30768587fa5e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:50:24.417845 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e857216f-ad19-44ad-94d4-30768587fa5e service neutron] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:50:24.427693 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 979/1959] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Oct 12 16:50:24 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:50:25.159404 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ceaa4f-f4ee-4c64-bb8f-424159917f87 None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:50:25.161109 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-b6ceaa4f-f4ee-4c64-bb8f-424159917f87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:50:25.174101 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ceaa4f-f4ee-4c64-bb8f-424159917f87 None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:50:25.178764 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826fd246-e0ab-48a4-97a3-e9569ac2db68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:50:25.179625 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826fd246-e0ab-48a4-97a3-e9569ac2db68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:50:25.179923 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826fd246-e0ab-48a4-97a3-e9569ac2db68 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:50:25.180202 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826fd246-e0ab-48a4-97a3-e9569ac2db68 admin admin] PATH_INFO: `/v3/projects/2d4d9a7149a24886af84026c39e1b49a` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:50:25.181723 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826fd246-e0ab-48a4-97a3-e9569ac2db68 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d4d9a7149a24886af84026c39e1b49a)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:50:25.183653 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826fd246-e0ab-48a4-97a3-e9569ac2db68 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:50:25.232318 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-826fd246-e0ab-48a4-97a3-e9569ac2db68 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d4d9a7149a24886af84026c39e1b49a', 'request_id': 'req-826fd246-e0ab-48a4-97a3-e9569ac2db68'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:50:25.239530 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-826fd246-e0ab-48a4-97a3-e9569ac2db68 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d4d9a7149a24886af84026c39e1b49a', 'request_id': 'req-826fd246-e0ab-48a4-97a3-e9569ac2db68'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:50:25.246556 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-826fd246-e0ab-48a4-97a3-e9569ac2db68 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d4d9a7149a24886af84026c39e1b49a', 'request_id': 'req-826fd246-e0ab-48a4-97a3-e9569ac2db68'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:50:25.259804 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-826fd246-e0ab-48a4-97a3-e9569ac2db68 admin admin] The token cache is being invalidate because project 2d4d9a7149a24886af84026c39e1b49a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=85204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 16:50:25.260100 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-826fd246-e0ab-48a4-97a3-e9569ac2db68 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:50:25.260730 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-826fd246-e0ab-48a4-97a3-e9569ac2db68 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:50:25.262441 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 981/1960] 10.222.0.58 () {58 vars in 1232 bytes} [Tue Oct 12 16:50:25 2021] DELETE /identity/v3/projects/2d4d9a7149a24886af84026c39e1b49a => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:50:25.266215 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e857216f-ad19-44ad-94d4-30768587fa5e service neutron] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:50:25.280253 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e857216f-ad19-44ad-94d4-30768587fa5e service neutron] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:50:25.343449 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930e5cf7-e880-44b0-bbe8-1452a8160da2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:50:25.344391 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930e5cf7-e880-44b0-bbe8-1452a8160da2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:50:25.344784 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930e5cf7-e880-44b0-bbe8-1452a8160da2 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:50:25.345239 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930e5cf7-e880-44b0-bbe8-1452a8160da2 admin admin] PATH_INFO: `/v3/users/4f4ea63662dd41e2b64b9e50fe793224` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:50:25.346892 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930e5cf7-e880-44b0-bbe8-1452a8160da2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f4ea63662dd41e2b64b9e50fe793224)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:50:25.348898 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930e5cf7-e880-44b0-bbe8-1452a8160da2 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:50:25.406106 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-930e5cf7-e880-44b0-bbe8-1452a8160da2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f4ea63662dd41e2b64b9e50fe793224'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:50:25.419006 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-930e5cf7-e880-44b0-bbe8-1452a8160da2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f4ea63662dd41e2b64b9e50fe793224'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:50:25.433692 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-930e5cf7-e880-44b0-bbe8-1452a8160da2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f4ea63662dd41e2b64b9e50fe793224'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:50:25.443006 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-930e5cf7-e880-44b0-bbe8-1452a8160da2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f4ea63662dd41e2b64b9e50fe793224'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:50:25.444394 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-930e5cf7-e880-44b0-bbe8-1452a8160da2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f4ea63662dd41e2b64b9e50fe793224'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:50:25.456364 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 980/1961] 10.222.0.58 () {58 vars in 1223 bytes} [Tue Oct 12 16:50:25 2021] DELETE /identity/v3/users/4f4ea63662dd41e2b64b9e50fe793224 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:50:25.761402 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826fd246-e0ab-48a4-97a3-e9569ac2db68 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:50:25.763041 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-826fd246-e0ab-48a4-97a3-e9569ac2db68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:50:25.780785 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826fd246-e0ab-48a4-97a3-e9569ac2db68 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:50:25.837054 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c247ba86-2907-47ae-9ebb-a4893f5ef982 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:50:25.837948 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c247ba86-2907-47ae-9ebb-a4893f5ef982 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:50:25.838232 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c247ba86-2907-47ae-9ebb-a4893f5ef982 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:50:25.838507 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c247ba86-2907-47ae-9ebb-a4893f5ef982 admin admin] PATH_INFO: `/v3/projects/e59c304a50d3426bbcfbbfdc7e7161af` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:50:25.839692 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c247ba86-2907-47ae-9ebb-a4893f5ef982 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e59c304a50d3426bbcfbbfdc7e7161af)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:50:25.841579 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c247ba86-2907-47ae-9ebb-a4893f5ef982 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:50:25.888786 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-c247ba86-2907-47ae-9ebb-a4893f5ef982 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e59c304a50d3426bbcfbbfdc7e7161af', 'request_id': 'req-c247ba86-2907-47ae-9ebb-a4893f5ef982'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:50:25.893884 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-c247ba86-2907-47ae-9ebb-a4893f5ef982 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e59c304a50d3426bbcfbbfdc7e7161af', 'request_id': 'req-c247ba86-2907-47ae-9ebb-a4893f5ef982'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:50:25.899795 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-c247ba86-2907-47ae-9ebb-a4893f5ef982 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e59c304a50d3426bbcfbbfdc7e7161af', 'request_id': 'req-c247ba86-2907-47ae-9ebb-a4893f5ef982'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:50:25.911797 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-c247ba86-2907-47ae-9ebb-a4893f5ef982 admin admin] The token cache is being invalidate because project e59c304a50d3426bbcfbbfdc7e7161af was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=85204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 16:50:25.912057 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-c247ba86-2907-47ae-9ebb-a4893f5ef982 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:50:25.913190 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-c247ba86-2907-47ae-9ebb-a4893f5ef982 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:50:25.914769 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 982/1962] 10.222.0.58 () {58 vars in 1232 bytes} [Tue Oct 12 16:50:25 2021] DELETE /identity/v3/projects/e59c304a50d3426bbcfbbfdc7e7161af => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:50:25.920464 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99759e6-3849-4755-ae43-c9326715fc69 None None] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:50:25.920748 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99759e6-3849-4755-ae43-c9326715fc69 None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:50:25.921024 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99759e6-3849-4755-ae43-c9326715fc69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:50:25.939308 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.auth.core [None req-d99759e6-3849-4755-ae43-c9326715fc69 None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:50:25.940537 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-d99759e6-3849-4755-ae43-c9326715fc69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:50:26.001582 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 981/1963] 10.222.0.58 () {58 vars in 957 bytes} [Tue Oct 12 16:50:25 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:50:26.010217 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c12741-1466-4651-99db-e53a13f823a4 None None] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:50:26.010495 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c12741-1466-4651-99db-e53a13f823a4 None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:50:26.010824 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c12741-1466-4651-99db-e53a13f823a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:50:26.030439 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.auth.core [None req-87c12741-1466-4651-99db-e53a13f823a4 None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:50:26.031650 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-87c12741-1466-4651-99db-e53a13f823a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:50:26.041362 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 983/1964] 10.222.0.58 () {58 vars in 957 bytes} [Tue Oct 12 16:50:26 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:50:26.045377 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99759e6-3849-4755-ae43-c9326715fc69 None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:50:26.060821 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99759e6-3849-4755-ae43-c9326715fc69 None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:50:26.066047 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dd1ea5-ff04-49a3-b28f-1cf0b4fc4c29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:50:26.066944 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dd1ea5-ff04-49a3-b28f-1cf0b4fc4c29 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:50:26.067156 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dd1ea5-ff04-49a3-b28f-1cf0b4fc4c29 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:50:26.067508 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dd1ea5-ff04-49a3-b28f-1cf0b4fc4c29 admin admin] PATH_INFO: `/v3/domains` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:50:26.071559 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84dd1ea5-ff04-49a3-b28f-1cf0b4fc4c29 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:50:26.071559 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84dd1ea5-ff04-49a3-b28f-1cf0b4fc4c29 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:50:26.071559 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84dd1ea5-ff04-49a3-b28f-1cf0b4fc4c29 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:50:26.085333 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 982/1965] 10.222.0.58 () {58 vars in 1152 bytes} [Tue Oct 12 16:50:26 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:50:26.087324 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c12741-1466-4651-99db-e53a13f823a4 None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:50:26.096844 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c12741-1466-4651-99db-e53a13f823a4 None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:50:26.102357 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e0ded0-e202-444d-9da0-c23a0afba100 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:50:26.103090 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e0ded0-e202-444d-9da0-c23a0afba100 admin admin] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:50:26.103299 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e0ded0-e202-444d-9da0-c23a0afba100 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:50:26.103714 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e0ded0-e202-444d-9da0-c23a0afba100 admin admin] PATH_INFO: `/v3/projects` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:50:26.104502 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e0ded0-e202-444d-9da0-c23a0afba100 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:50:26.106382 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e0ded0-e202-444d-9da0-c23a0afba100 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:50:26.140181 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 984/1966] 10.222.0.58 () {60 vars in 1152 bytes} [Tue Oct 12 16:50:26 2021] POST /identity/v3/projects => generated 385 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:50:26.142070 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dd1ea5-ff04-49a3-b28f-1cf0b4fc4c29 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:50:26.153018 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dd1ea5-ff04-49a3-b28f-1cf0b4fc4c29 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:50:26.227843 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f3b670-baa9-4d15-a2fe-4df84eaa2496 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:50:26.228519 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f3b670-baa9-4d15-a2fe-4df84eaa2496 admin admin] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:50:26.228800 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f3b670-baa9-4d15-a2fe-4df84eaa2496 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:50:26.229076 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f3b670-baa9-4d15-a2fe-4df84eaa2496 admin admin] PATH_INFO: `/v3/users` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:50:26.229899 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f3b670-baa9-4d15-a2fe-4df84eaa2496 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:50:26.231685 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f3b670-baa9-4d15-a2fe-4df84eaa2496 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:50:26.257308 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 983/1967] 10.222.0.58 () {60 vars in 1143 bytes} [Tue Oct 12 16:50:26 2021] POST /identity/v3/users => generated 293 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:50:26.259916 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e0ded0-e202-444d-9da0-c23a0afba100 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:50:26.284709 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e0ded0-e202-444d-9da0-c23a0afba100 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:50:26.291729 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc49975a-deb3-49ee-a573-4ebae1e76f62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:50:26.292379 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc49975a-deb3-49ee-a573-4ebae1e76f62 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:50:26.292816 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc49975a-deb3-49ee-a573-4ebae1e76f62 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:50:26.293128 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc49975a-deb3-49ee-a573-4ebae1e76f62 admin admin] PATH_INFO: `/v3/roles` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:50:26.293835 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc49975a-deb3-49ee-a573-4ebae1e76f62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:50:26.295499 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc49975a-deb3-49ee-a573-4ebae1e76f62 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:50:26.314453 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 985/1968] 10.222.0.58 () {58 vars in 1121 bytes} [Tue Oct 12 16:50:26 2021] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:50:26.319485 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f3b670-baa9-4d15-a2fe-4df84eaa2496 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:50:26.329784 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f3b670-baa9-4d15-a2fe-4df84eaa2496 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:50:26.334519 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf87044-8760-4a26-b74a-c4f066560d8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:50:26.335109 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf87044-8760-4a26-b74a-c4f066560d8e admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:50:26.335372 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf87044-8760-4a26-b74a-c4f066560d8e admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:50:26.335659 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf87044-8760-4a26-b74a-c4f066560d8e admin admin] PATH_INFO: `/v3/roles` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:50:26.336403 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf87044-8760-4a26-b74a-c4f066560d8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:50:26.338036 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf87044-8760-4a26-b74a-c4f066560d8e admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:50:26.351785 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 984/1969] 10.222.0.58 () {58 vars in 1121 bytes} [Tue Oct 12 16:50:26 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:50:26.353211 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc49975a-deb3-49ee-a573-4ebae1e76f62 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:50:26.363005 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc49975a-deb3-49ee-a573-4ebae1e76f62 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:50:26.375214 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9217e059-061c-491b-b961-b5abdb74ff24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:50:26.375214 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9217e059-061c-491b-b961-b5abdb74ff24 admin admin] REQUEST_METHOD: `PUT` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:50:26.375214 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9217e059-061c-491b-b961-b5abdb74ff24 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:50:26.375214 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9217e059-061c-491b-b961-b5abdb74ff24 admin admin] PATH_INFO: `/v3/projects/929d3800cb9241509dbef39a35036740/users/34fc714a18c64bb4bb15b65b2874500a/roles/55ba49fe29884e64b57c3ad13188d554` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:50:26.385689 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9217e059-061c-491b-b961-b5abdb74ff24 admin admin] RBAC: Authorizing `identity:create_grant(project_id=929d3800cb9241509dbef39a35036740, user_id=34fc714a18c64bb4bb15b65b2874500a, role_id=55ba49fe29884e64b57c3ad13188d554)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:50:26.389323 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9217e059-061c-491b-b961-b5abdb74ff24 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:50:26.401860 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 986/1970] 10.222.0.58 () {60 vars in 1482 bytes} [Tue Oct 12 16:50:26 2021] PUT /identity/v3/projects/929d3800cb9241509dbef39a35036740/users/34fc714a18c64bb4bb15b65b2874500a/roles/55ba49fe29884e64b57c3ad13188d554 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:50:26.411843 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f188fe18-052d-4786-ad21-eeaa99de533d None None] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:50:26.412760 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f188fe18-052d-4786-ad21-eeaa99de533d None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:50:26.413054 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f188fe18-052d-4786-ad21-eeaa99de533d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:50:26.439013 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.auth.core [None req-f188fe18-052d-4786-ad21-eeaa99de533d None None] MFA Rules not processed for user `34fc714a18c64bb4bb15b65b2874500a`. Rule list: `[]` (Enabled: `True`). {{(pid=85205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:50:26.440219 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-f188fe18-052d-4786-ad21-eeaa99de533d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:50:26.500812 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 985/1971] 10.222.0.58 () {58 vars in 957 bytes} [Tue Oct 12 16:50:26 2021] POST /identity/v3/auth/tokens => generated 3405 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:50:26.505173 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9217e059-061c-491b-b961-b5abdb74ff24 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:50:26.578251 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9217e059-061c-491b-b961-b5abdb74ff24 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:50:26.583239 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e304aca4-0792-40c4-a111-478750a776ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:50:26.583913 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e304aca4-0792-40c4-a111-478750a776ea admin admin] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:50:26.584227 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e304aca4-0792-40c4-a111-478750a776ea admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:50:26.584558 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e304aca4-0792-40c4-a111-478750a776ea admin admin] PATH_INFO: `/v3/projects` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:50:26.585278 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e304aca4-0792-40c4-a111-478750a776ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:50:26.587205 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e304aca4-0792-40c4-a111-478750a776ea admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:50:26.627471 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 987/1972] 10.222.0.58 () {60 vars in 1152 bytes} [Tue Oct 12 16:50:26 2021] POST /identity/v3/projects => generated 385 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 16:50:26.628594 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f188fe18-052d-4786-ad21-eeaa99de533d None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:50:26.640323 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f188fe18-052d-4786-ad21-eeaa99de533d None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:50:26.704339 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f1e231-0e28-4102-9846-d1687e2dcb18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:50:26.705137 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f1e231-0e28-4102-9846-d1687e2dcb18 admin admin] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:50:26.705424 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f1e231-0e28-4102-9846-d1687e2dcb18 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:50:26.705808 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f1e231-0e28-4102-9846-d1687e2dcb18 admin admin] PATH_INFO: `/v3/users` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:50:26.706548 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f1e231-0e28-4102-9846-d1687e2dcb18 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:50:26.708508 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f1e231-0e28-4102-9846-d1687e2dcb18 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:50:26.734990 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 986/1973] 10.222.0.58 () {60 vars in 1143 bytes} [Tue Oct 12 16:50:26 2021] POST /identity/v3/users => generated 299 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 16:50:26.738720 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e304aca4-0792-40c4-a111-478750a776ea admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:50:26.750378 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e304aca4-0792-40c4-a111-478750a776ea admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:50:26.755496 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6175340c-8fad-4ce2-b8d6-0601fd411e13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:50:26.756190 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6175340c-8fad-4ce2-b8d6-0601fd411e13 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:50:26.756472 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6175340c-8fad-4ce2-b8d6-0601fd411e13 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:50:26.756748 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6175340c-8fad-4ce2-b8d6-0601fd411e13 admin admin] PATH_INFO: `/v3/roles` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:50:26.757520 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6175340c-8fad-4ce2-b8d6-0601fd411e13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:50:26.759126 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6175340c-8fad-4ce2-b8d6-0601fd411e13 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:50:26.766244 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f1e231-0e28-4102-9846-d1687e2dcb18 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:50:26.767936 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-70f1e231-0e28-4102-9846-d1687e2dcb18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:50:26.773996 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 988/1974] 10.222.0.58 () {58 vars in 1121 bytes} [Tue Oct 12 16:50:26 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 16:50:26.775225 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6175340c-8fad-4ce2-b8d6-0601fd411e13 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:50:26.780325 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f1e231-0e28-4102-9846-d1687e2dcb18 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:50:26.784510 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6175340c-8fad-4ce2-b8d6-0601fd411e13 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:50:26.785103 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4bd445-e4e9-408c-9259-254e5c7329c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:50:26.785926 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4bd445-e4e9-408c-9259-254e5c7329c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:50:26.786216 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4bd445-e4e9-408c-9259-254e5c7329c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:50:26.786496 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4bd445-e4e9-408c-9259-254e5c7329c2 admin admin] PATH_INFO: `/v3/users/d85f8e635364491c936b30b5fe23c9bf` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:50:26.788274 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4bd445-e4e9-408c-9259-254e5c7329c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d85f8e635364491c936b30b5fe23c9bf)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:50:26.789660 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2176c6-c63c-480f-b9a2-81813c09eb5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:50:26.790196 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4bd445-e4e9-408c-9259-254e5c7329c2 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:50:26.790544 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2176c6-c63c-480f-b9a2-81813c09eb5c admin admin] REQUEST_METHOD: `PUT` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:50:26.790829 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2176c6-c63c-480f-b9a2-81813c09eb5c admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:50:26.791104 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2176c6-c63c-480f-b9a2-81813c09eb5c admin admin] PATH_INFO: `/v3/projects/13bf5a4c8674446d9012f2f9e1b1c2a2/users/88c263d7eb8f4f5dbf975ef74ce66d3d/roles/610824e4f50f4fb8954610e98c1de784` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:50:26.805084 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2176c6-c63c-480f-b9a2-81813c09eb5c admin admin] RBAC: Authorizing `identity:create_grant(project_id=13bf5a4c8674446d9012f2f9e1b1c2a2, user_id=88c263d7eb8f4f5dbf975ef74ce66d3d, role_id=610824e4f50f4fb8954610e98c1de784)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:50:26.807747 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2176c6-c63c-480f-b9a2-81813c09eb5c admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:50:26.822491 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 989/1975] 10.222.0.58 () {60 vars in 1482 bytes} [Tue Oct 12 16:50:26 2021] PUT /identity/v3/projects/13bf5a4c8674446d9012f2f9e1b1c2a2/users/88c263d7eb8f4f5dbf975ef74ce66d3d/roles/610824e4f50f4fb8954610e98c1de784 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:50:26.826455 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2176c6-c63c-480f-b9a2-81813c09eb5c admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:50:26.836815 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-8d4bd445-e4e9-408c-9259-254e5c7329c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd85f8e635364491c936b30b5fe23c9bf'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:50:26.848607 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-8d4bd445-e4e9-408c-9259-254e5c7329c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd85f8e635364491c936b30b5fe23c9bf'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:50:26.856562 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-8d4bd445-e4e9-408c-9259-254e5c7329c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd85f8e635364491c936b30b5fe23c9bf'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:50:26.863185 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-8d4bd445-e4e9-408c-9259-254e5c7329c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd85f8e635364491c936b30b5fe23c9bf'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:50:26.863844 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-8d4bd445-e4e9-408c-9259-254e5c7329c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd85f8e635364491c936b30b5fe23c9bf'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:50:26.870375 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 987/1976] 10.222.0.58 () {58 vars in 1223 bytes} [Tue Oct 12 16:50:26 2021] DELETE /identity/v3/users/d85f8e635364491c936b30b5fe23c9bf => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 16:50:26.874991 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11e0418-0b96-4854-82f4-830d576a1125 None None] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:50:26.875291 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11e0418-0b96-4854-82f4-830d576a1125 None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:50:26.875574 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11e0418-0b96-4854-82f4-830d576a1125 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:50:26.887099 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2176c6-c63c-480f-b9a2-81813c09eb5c admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:50:26.893591 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.auth.core [None req-d11e0418-0b96-4854-82f4-830d576a1125 None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:50:26.894952 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-d11e0418-0b96-4854-82f4-830d576a1125 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:50:26.943029 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bc7bd2-6d25-4fa0-9c03-5160def78f41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:50:26.943765 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bc7bd2-6d25-4fa0-9c03-5160def78f41 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:50:26.944059 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bc7bd2-6d25-4fa0-9c03-5160def78f41 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:50:26.944338 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bc7bd2-6d25-4fa0-9c03-5160def78f41 admin admin] PATH_INFO: `/v3/roles` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:50:26.945084 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bc7bd2-6d25-4fa0-9c03-5160def78f41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:50:26.946818 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bc7bd2-6d25-4fa0-9c03-5160def78f41 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:50:26.964490 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 990/1977] 10.222.0.58 () {58 vars in 1121 bytes} [Tue Oct 12 16:50:26 2021] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 16:50:26.965531 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bc7bd2-6d25-4fa0-9c03-5160def78f41 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:50:26.967204 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-c4bc7bd2-6d25-4fa0-9c03-5160def78f41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:50:26.967578 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 988/1978] 10.222.0.58 () {58 vars in 957 bytes} [Tue Oct 12 16:50:26 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:50:26.977960 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11e0418-0b96-4854-82f4-830d576a1125 None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:50:26.979277 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-d11e0418-0b96-4854-82f4-830d576a1125 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:50:26.979788 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bc7bd2-6d25-4fa0-9c03-5160def78f41 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:50:26.986014 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b369ff-736b-435c-9cea-0ae2a6e22e1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:50:26.986928 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b369ff-736b-435c-9cea-0ae2a6e22e1f admin admin] REQUEST_METHOD: `PUT` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:50:26.987208 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b369ff-736b-435c-9cea-0ae2a6e22e1f admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:50:26.987480 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b369ff-736b-435c-9cea-0ae2a6e22e1f admin admin] PATH_INFO: `/v3/projects/13bf5a4c8674446d9012f2f9e1b1c2a2/users/88c263d7eb8f4f5dbf975ef74ce66d3d/roles/610824e4f50f4fb8954610e98c1de784` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:50:26.989858 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b369ff-736b-435c-9cea-0ae2a6e22e1f admin admin] RBAC: Authorizing `identity:create_grant(project_id=13bf5a4c8674446d9012f2f9e1b1c2a2, user_id=88c263d7eb8f4f5dbf975ef74ce66d3d, role_id=610824e4f50f4fb8954610e98c1de784)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:50:26.992352 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b369ff-736b-435c-9cea-0ae2a6e22e1f admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:50:27.003468 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 991/1979] 10.222.0.58 () {60 vars in 1482 bytes} [Tue Oct 12 16:50:26 2021] PUT /identity/v3/projects/13bf5a4c8674446d9012f2f9e1b1c2a2/users/88c263d7eb8f4f5dbf975ef74ce66d3d/roles/610824e4f50f4fb8954610e98c1de784 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 16:50:27.014325 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b28613-ad65-4e0b-b3d1-5fc1fd346b22 None None] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:50:27.014615 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b28613-ad65-4e0b-b3d1-5fc1fd346b22 None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:50:27.015338 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b28613-ad65-4e0b-b3d1-5fc1fd346b22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:50:27.035257 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11e0418-0b96-4854-82f4-830d576a1125 None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:50:27.042713 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.auth.core [None req-22b28613-ad65-4e0b-b3d1-5fc1fd346b22 None None] MFA Rules not processed for user `88c263d7eb8f4f5dbf975ef74ce66d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=85204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:50:27.043936 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-22b28613-ad65-4e0b-b3d1-5fc1fd346b22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:50:27.082188 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdd98a7-6a0c-42ec-add7-2a59f2cee9c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e65f6d0598e4c539134292b86fb43d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:50:27.082840 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdd98a7-6a0c-42ec-add7-2a59f2cee9c0 service neutron] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:50:27.083120 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdd98a7-6a0c-42ec-add7-2a59f2cee9c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:50:27.083392 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdd98a7-6a0c-42ec-add7-2a59f2cee9c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:50:27.110885 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 992/1980] 10.222.0.58 () {58 vars in 957 bytes} [Tue Oct 12 16:50:27 2021] POST /identity/v3/auth/tokens => generated 3472 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:50:27.120781 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b28613-ad65-4e0b-b3d1-5fc1fd346b22 None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:50:27.122195 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-22b28613-ad65-4e0b-b3d1-5fc1fd346b22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:50:27.143908 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdd98a7-6a0c-42ec-add7-2a59f2cee9c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:50:27.145333 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdd98a7-6a0c-42ec-add7-2a59f2cee9c0 service neutron] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:50:27.155524 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 989/1981] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Oct 12 16:50:26 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 12 16:50:27.177295 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b28613-ad65-4e0b-b3d1-5fc1fd346b22 None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:50:27.181050 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4684e1c-10f4-4a7e-8500-4358e503be37 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04704222b3d64a33a6c092fc641ccbb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:50:27.181691 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4684e1c-10f4-4a7e-8500-4358e503be37 service cinder] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:50:27.182000 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4684e1c-10f4-4a7e-8500-4358e503be37 service cinder] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:50:27.182298 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4684e1c-10f4-4a7e-8500-4358e503be37 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:50:27.184192 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-a4684e1c-10f4-4a7e-8500-4358e503be37 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:50:27.248364 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4684e1c-10f4-4a7e-8500-4358e503be37 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:50:27.249656 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4684e1c-10f4-4a7e-8500-4358e503be37 service cinder] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:50:27.262014 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 993/1982] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Oct 12 16:50:27 2021] GET /identity/v3/auth/tokens => generated 3405 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 12 16:50:27.492484 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdd98a7-6a0c-42ec-add7-2a59f2cee9c0 service neutron] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:50:27.494207 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-bcdd98a7-6a0c-42ec-add7-2a59f2cee9c0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:50:27.513322 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdd98a7-6a0c-42ec-add7-2a59f2cee9c0 service neutron] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:50:27.536523 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fb4274-de3c-4d2b-9aaa-f418455a7dc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:50:27.537603 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fb4274-de3c-4d2b-9aaa-f418455a7dc2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:50:27.537921 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fb4274-de3c-4d2b-9aaa-f418455a7dc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:50:27.538197 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fb4274-de3c-4d2b-9aaa-f418455a7dc2 admin admin] PATH_INFO: `/v3/projects/b39d904767ce45a98a285b0df9c88ecd` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:50:27.539792 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fb4274-de3c-4d2b-9aaa-f418455a7dc2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b39d904767ce45a98a285b0df9c88ecd)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:50:27.543026 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fb4274-de3c-4d2b-9aaa-f418455a7dc2 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:50:27.627900 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-29fb4274-de3c-4d2b-9aaa-f418455a7dc2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b39d904767ce45a98a285b0df9c88ecd', 'request_id': 'req-29fb4274-de3c-4d2b-9aaa-f418455a7dc2'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:50:27.637417 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-29fb4274-de3c-4d2b-9aaa-f418455a7dc2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b39d904767ce45a98a285b0df9c88ecd', 'request_id': 'req-29fb4274-de3c-4d2b-9aaa-f418455a7dc2'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:50:27.648994 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-29fb4274-de3c-4d2b-9aaa-f418455a7dc2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b39d904767ce45a98a285b0df9c88ecd', 'request_id': 'req-29fb4274-de3c-4d2b-9aaa-f418455a7dc2'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:50:27.668613 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-29fb4274-de3c-4d2b-9aaa-f418455a7dc2 admin admin] The token cache is being invalidate because project b39d904767ce45a98a285b0df9c88ecd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=85205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 16:50:27.669414 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-29fb4274-de3c-4d2b-9aaa-f418455a7dc2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:50:27.670502 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-29fb4274-de3c-4d2b-9aaa-f418455a7dc2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:50:27.673716 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 990/1983] 10.222.0.58 () {58 vars in 1232 bytes} [Tue Oct 12 16:50:27 2021] DELETE /identity/v3/projects/b39d904767ce45a98a285b0df9c88ecd => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:50:27.678373 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4684e1c-10f4-4a7e-8500-4358e503be37 service cinder] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:50:27.704310 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4684e1c-10f4-4a7e-8500-4358e503be37 service cinder] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:50:27.824500 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196e797f-1a33-496d-a192-9c85f0d58389 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:50:27.826004 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196e797f-1a33-496d-a192-9c85f0d58389 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:50:27.826808 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196e797f-1a33-496d-a192-9c85f0d58389 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:50:27.827336 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196e797f-1a33-496d-a192-9c85f0d58389 admin admin] PATH_INFO: `/v3/users/d1095c78e64e46288c0c8696e6d815dd` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:50:27.830968 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196e797f-1a33-496d-a192-9c85f0d58389 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d1095c78e64e46288c0c8696e6d815dd)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:50:27.840003 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196e797f-1a33-496d-a192-9c85f0d58389 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:50:27.893405 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-196e797f-1a33-496d-a192-9c85f0d58389 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd1095c78e64e46288c0c8696e6d815dd'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:50:27.906027 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-196e797f-1a33-496d-a192-9c85f0d58389 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd1095c78e64e46288c0c8696e6d815dd'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:50:27.913268 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-196e797f-1a33-496d-a192-9c85f0d58389 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd1095c78e64e46288c0c8696e6d815dd'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:50:27.920899 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-196e797f-1a33-496d-a192-9c85f0d58389 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd1095c78e64e46288c0c8696e6d815dd'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:50:27.921613 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-196e797f-1a33-496d-a192-9c85f0d58389 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd1095c78e64e46288c0c8696e6d815dd'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:50:27.927843 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 994/1984] 10.222.0.58 () {58 vars in 1223 bytes} [Tue Oct 12 16:50:27 2021] DELETE /identity/v3/users/d1095c78e64e46288c0c8696e6d815dd => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:50:28.339505 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fb4274-de3c-4d2b-9aaa-f418455a7dc2 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:50:28.342088 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-29fb4274-de3c-4d2b-9aaa-f418455a7dc2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:50:28.365801 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fb4274-de3c-4d2b-9aaa-f418455a7dc2 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:50:28.370921 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196e797f-1a33-496d-a192-9c85f0d58389 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:50:28.373090 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-196e797f-1a33-496d-a192-9c85f0d58389 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:50:28.436479 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84db1d9a-3fdc-4edf-9b60-7ec760e04223 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:50:28.437525 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84db1d9a-3fdc-4edf-9b60-7ec760e04223 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:50:28.437676 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84db1d9a-3fdc-4edf-9b60-7ec760e04223 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:50:28.437989 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84db1d9a-3fdc-4edf-9b60-7ec760e04223 admin admin] PATH_INFO: `/v3/users/6ae30926375e4c75a3939a7694db6561` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:50:28.439329 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84db1d9a-3fdc-4edf-9b60-7ec760e04223 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6ae30926375e4c75a3939a7694db6561)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:50:28.441533 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84db1d9a-3fdc-4edf-9b60-7ec760e04223 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:50:28.449120 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196e797f-1a33-496d-a192-9c85f0d58389 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:50:28.455485 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb6aa9d-df2d-4c2f-928c-8f3f11de6248 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:50:28.456780 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb6aa9d-df2d-4c2f-928c-8f3f11de6248 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:50:28.457071 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb6aa9d-df2d-4c2f-928c-8f3f11de6248 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:50:28.457347 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb6aa9d-df2d-4c2f-928c-8f3f11de6248 admin admin] PATH_INFO: `/v3/projects/44727a644beb46ecb9b5ee9d7eef5f36` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:50:28.459658 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb6aa9d-df2d-4c2f-928c-8f3f11de6248 admin admin] RBAC: Authorizing `identity:delete_project(project_id=44727a644beb46ecb9b5ee9d7eef5f36)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:50:28.461723 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb6aa9d-df2d-4c2f-928c-8f3f11de6248 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:50:28.491277 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-84db1d9a-3fdc-4edf-9b60-7ec760e04223 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6ae30926375e4c75a3939a7694db6561'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:50:28.503887 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-84db1d9a-3fdc-4edf-9b60-7ec760e04223 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6ae30926375e4c75a3939a7694db6561'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:50:28.512750 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-84db1d9a-3fdc-4edf-9b60-7ec760e04223 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6ae30926375e4c75a3939a7694db6561'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:50:28.512907 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-6cb6aa9d-df2d-4c2f-928c-8f3f11de6248 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '44727a644beb46ecb9b5ee9d7eef5f36', 'request_id': 'req-6cb6aa9d-df2d-4c2f-928c-8f3f11de6248'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:50:28.519388 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-6cb6aa9d-df2d-4c2f-928c-8f3f11de6248 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '44727a644beb46ecb9b5ee9d7eef5f36', 'request_id': 'req-6cb6aa9d-df2d-4c2f-928c-8f3f11de6248'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:50:28.521033 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-84db1d9a-3fdc-4edf-9b60-7ec760e04223 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6ae30926375e4c75a3939a7694db6561'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:50:28.522614 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-84db1d9a-3fdc-4edf-9b60-7ec760e04223 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6ae30926375e4c75a3939a7694db6561'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:50:28.527928 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-6cb6aa9d-df2d-4c2f-928c-8f3f11de6248 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '44727a644beb46ecb9b5ee9d7eef5f36', 'request_id': 'req-6cb6aa9d-df2d-4c2f-928c-8f3f11de6248'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:50:28.533051 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 991/1985] 10.222.0.58 () {58 vars in 1223 bytes} [Tue Oct 12 16:50:28 2021] DELETE /identity/v3/users/6ae30926375e4c75a3939a7694db6561 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:50:28.544249 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-6cb6aa9d-df2d-4c2f-928c-8f3f11de6248 admin admin] The token cache is being invalidate because project 44727a644beb46ecb9b5ee9d7eef5f36 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=85204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 16:50:28.544537 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-6cb6aa9d-df2d-4c2f-928c-8f3f11de6248 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:50:28.545702 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-6cb6aa9d-df2d-4c2f-928c-8f3f11de6248 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:50:28.548349 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 995/1986] 10.222.0.58 () {58 vars in 1232 bytes} [Tue Oct 12 16:50:28 2021] DELETE /identity/v3/projects/44727a644beb46ecb9b5ee9d7eef5f36 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 16:50:28.555072 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d513ae-15a2-4908-8c0f-32647f94ee1b None None] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:50:28.555370 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d513ae-15a2-4908-8c0f-32647f94ee1b None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:50:28.555649 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d513ae-15a2-4908-8c0f-32647f94ee1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:50:28.575526 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.auth.core [None req-e7d513ae-15a2-4908-8c0f-32647f94ee1b None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:50:28.576733 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-e7d513ae-15a2-4908-8c0f-32647f94ee1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:50:28.639344 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 992/1987] 10.222.0.58 () {58 vars in 957 bytes} [Tue Oct 12 16:50:28 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:50:28.647796 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff52d94-8cd0-4572-ab67-0ce5d7416796 None None] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:50:28.648085 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff52d94-8cd0-4572-ab67-0ce5d7416796 None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:50:28.648360 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff52d94-8cd0-4572-ab67-0ce5d7416796 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:50:28.667000 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.auth.core [None req-7ff52d94-8cd0-4572-ab67-0ce5d7416796 None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:50:28.668234 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-7ff52d94-8cd0-4572-ab67-0ce5d7416796 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:50:28.676499 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 996/1988] 10.222.0.58 () {58 vars in 957 bytes} [Tue Oct 12 16:50:28 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:50:28.680391 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d513ae-15a2-4908-8c0f-32647f94ee1b None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:50:28.690170 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d513ae-15a2-4908-8c0f-32647f94ee1b None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:50:28.695478 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090ae284-1449-411b-802c-d8488ff1e065 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:50:28.696076 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090ae284-1449-411b-802c-d8488ff1e065 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:50:28.696385 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090ae284-1449-411b-802c-d8488ff1e065 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:50:28.696660 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090ae284-1449-411b-802c-d8488ff1e065 admin admin] PATH_INFO: `/v3/domains` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:50:28.697399 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090ae284-1449-411b-802c-d8488ff1e065 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:50:28.697710 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090ae284-1449-411b-802c-d8488ff1e065 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:50:28.699331 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090ae284-1449-411b-802c-d8488ff1e065 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:50:28.714732 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 993/1989] 10.222.0.58 () {58 vars in 1152 bytes} [Tue Oct 12 16:50:28 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:50:28.715879 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff52d94-8cd0-4572-ab67-0ce5d7416796 None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:50:28.726940 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff52d94-8cd0-4572-ab67-0ce5d7416796 None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:50:28.733189 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9253ec21-f041-4647-84f1-e7e5b6df41b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:50:28.733857 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9253ec21-f041-4647-84f1-e7e5b6df41b8 admin admin] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:50:28.734169 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9253ec21-f041-4647-84f1-e7e5b6df41b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:50:28.734752 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9253ec21-f041-4647-84f1-e7e5b6df41b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:50:28.735152 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9253ec21-f041-4647-84f1-e7e5b6df41b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:50:28.737295 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9253ec21-f041-4647-84f1-e7e5b6df41b8 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:50:28.762905 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090ae284-1449-411b-802c-d8488ff1e065 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:50:28.765050 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-090ae284-1449-411b-802c-d8488ff1e065 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:50:28.770779 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 997/1990] 10.222.0.58 () {60 vars in 1152 bytes} [Tue Oct 12 16:50:28 2021] POST /identity/v3/projects => generated 407 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 16:50:28.774634 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9253ec21-f041-4647-84f1-e7e5b6df41b8 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:50:28.780069 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090ae284-1449-411b-802c-d8488ff1e065 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:50:28.857815 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47901031-435a-44e8-b2e8-779d47e6b509 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:50:28.859441 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47901031-435a-44e8-b2e8-779d47e6b509 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:50:28.860197 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47901031-435a-44e8-b2e8-779d47e6b509 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:50:28.860496 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47901031-435a-44e8-b2e8-779d47e6b509 admin admin] PATH_INFO: `/v3/projects/87933a36279c4f6ab6dcb9851bbe8c65` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:50:28.861740 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47901031-435a-44e8-b2e8-779d47e6b509 admin admin] RBAC: Authorizing `identity:delete_project(project_id=87933a36279c4f6ab6dcb9851bbe8c65)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:50:28.862197 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9253ec21-f041-4647-84f1-e7e5b6df41b8 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:50:28.863757 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47901031-435a-44e8-b2e8-779d47e6b509 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:50:28.867650 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d486f5-90c8-411d-b3e3-85543d4e67cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:50:28.868393 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d486f5-90c8-411d-b3e3-85543d4e67cd admin admin] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:50:28.868746 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d486f5-90c8-411d-b3e3-85543d4e67cd admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:50:28.869085 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d486f5-90c8-411d-b3e3-85543d4e67cd admin admin] PATH_INFO: `/v3/users` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:50:28.870029 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d486f5-90c8-411d-b3e3-85543d4e67cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:50:28.872098 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d486f5-90c8-411d-b3e3-85543d4e67cd admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:50:28.892032 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 998/1991] 10.222.0.58 () {60 vars in 1143 bytes} [Tue Oct 12 16:50:28 2021] POST /identity/v3/users => generated 304 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 16:50:28.896384 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d486f5-90c8-411d-b3e3-85543d4e67cd admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:50:28.906282 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d486f5-90c8-411d-b3e3-85543d4e67cd admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:50:28.911119 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455c567a-6d4c-49bb-8f65-873a39c8c8b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:50:28.911789 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455c567a-6d4c-49bb-8f65-873a39c8c8b9 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:50:28.912076 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455c567a-6d4c-49bb-8f65-873a39c8c8b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:50:28.912881 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455c567a-6d4c-49bb-8f65-873a39c8c8b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:50:28.913627 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455c567a-6d4c-49bb-8f65-873a39c8c8b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:50:28.915294 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455c567a-6d4c-49bb-8f65-873a39c8c8b9 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:50:28.928821 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 999/1992] 10.222.0.58 () {58 vars in 1121 bytes} [Tue Oct 12 16:50:28 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 16:50:28.931503 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-47901031-435a-44e8-b2e8-779d47e6b509 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '87933a36279c4f6ab6dcb9851bbe8c65', 'request_id': 'req-47901031-435a-44e8-b2e8-779d47e6b509'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:50:28.933348 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455c567a-6d4c-49bb-8f65-873a39c8c8b9 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:50:28.938422 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-47901031-435a-44e8-b2e8-779d47e6b509 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '87933a36279c4f6ab6dcb9851bbe8c65', 'request_id': 'req-47901031-435a-44e8-b2e8-779d47e6b509'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:50:28.943363 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455c567a-6d4c-49bb-8f65-873a39c8c8b9 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:50:28.945676 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-47901031-435a-44e8-b2e8-779d47e6b509 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '87933a36279c4f6ab6dcb9851bbe8c65', 'request_id': 'req-47901031-435a-44e8-b2e8-779d47e6b509'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:50:28.962191 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-47901031-435a-44e8-b2e8-779d47e6b509 admin admin] The token cache is being invalidate because project 87933a36279c4f6ab6dcb9851bbe8c65 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=85205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 16:50:28.962609 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-47901031-435a-44e8-b2e8-779d47e6b509 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:50:28.963264 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-47901031-435a-44e8-b2e8-779d47e6b509 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:50:28.964821 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 994/1993] 10.222.0.58 () {58 vars in 1232 bytes} [Tue Oct 12 16:50:28 2021] DELETE /identity/v3/projects/87933a36279c4f6ab6dcb9851bbe8c65 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:50:28.970375 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f25a953-0d67-4253-885f-749997a79642 None None] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:50:28.970675 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f25a953-0d67-4253-885f-749997a79642 None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:50:28.970959 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f25a953-0d67-4253-885f-749997a79642 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:50:28.989171 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.auth.core [None req-8f25a953-0d67-4253-885f-749997a79642 None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:50:28.990992 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-8f25a953-0d67-4253-885f-749997a79642 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:50:29.002570 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73712f11-99bd-4912-9dbd-74c900ce4880 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:50:29.003246 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73712f11-99bd-4912-9dbd-74c900ce4880 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:50:29.003545 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73712f11-99bd-4912-9dbd-74c900ce4880 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:50:29.003857 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73712f11-99bd-4912-9dbd-74c900ce4880 admin admin] PATH_INFO: `/v3/roles` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:50:29.004558 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73712f11-99bd-4912-9dbd-74c900ce4880 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:50:29.006219 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73712f11-99bd-4912-9dbd-74c900ce4880 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:50:29.019459 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1000/1994] 10.222.0.58 () {58 vars in 1121 bytes} [Tue Oct 12 16:50:28 2021] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:50:29.020788 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73712f11-99bd-4912-9dbd-74c900ce4880 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:50:29.025623 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-73712f11-99bd-4912-9dbd-74c900ce4880 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:50:29.048970 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73712f11-99bd-4912-9dbd-74c900ce4880 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:50:29.055042 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f311388-c1e7-4a44-92a3-d64569bb15a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:50:29.055652 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f311388-c1e7-4a44-92a3-d64569bb15a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:50:29.055933 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f311388-c1e7-4a44-92a3-d64569bb15a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:50:29.056334 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f311388-c1e7-4a44-92a3-d64569bb15a3 admin admin] PATH_INFO: `/v3/projects/8129c767a95c46c59bee30e637cab0cc/users/cd2c7a2b71194846b4353d79e0c2ac01/roles/55ba49fe29884e64b57c3ad13188d554` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:50:29.067176 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 995/1995] 10.222.0.58 () {58 vars in 957 bytes} [Tue Oct 12 16:50:28 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:50:29.077124 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7be182a-9729-4327-bbe5-f81b5742d960 None None] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:50:29.077923 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7be182a-9729-4327-bbe5-f81b5742d960 None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:50:29.078487 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7be182a-9729-4327-bbe5-f81b5742d960 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:50:29.078996 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f311388-c1e7-4a44-92a3-d64569bb15a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8129c767a95c46c59bee30e637cab0cc, user_id=cd2c7a2b71194846b4353d79e0c2ac01, role_id=55ba49fe29884e64b57c3ad13188d554)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:50:29.081632 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f311388-c1e7-4a44-92a3-d64569bb15a3 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:50:29.105711 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.auth.core [None req-a7be182a-9729-4327-bbe5-f81b5742d960 None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:50:29.107131 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-a7be182a-9729-4327-bbe5-f81b5742d960 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:50:29.113186 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1001/1996] 10.222.0.58 () {60 vars in 1482 bytes} [Tue Oct 12 16:50:29 2021] PUT /identity/v3/projects/8129c767a95c46c59bee30e637cab0cc/users/cd2c7a2b71194846b4353d79e0c2ac01/roles/55ba49fe29884e64b57c3ad13188d554 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 16:50:29.129666 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caebe2f-f9ef-404b-afca-fe7d91df1b67 None None] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:50:29.130079 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caebe2f-f9ef-404b-afca-fe7d91df1b67 None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:50:29.130432 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caebe2f-f9ef-404b-afca-fe7d91df1b67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:50:29.176873 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.auth.core [None req-4caebe2f-f9ef-404b-afca-fe7d91df1b67 None None] MFA Rules not processed for user `cd2c7a2b71194846b4353d79e0c2ac01`. Rule list: `[]` (Enabled: `True`). {{(pid=85204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:50:29.178388 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-4caebe2f-f9ef-404b-afca-fe7d91df1b67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:50:29.226169 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 996/1997] 10.222.0.58 () {58 vars in 957 bytes} [Tue Oct 12 16:50:29 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:50:29.227417 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7be182a-9729-4327-bbe5-f81b5742d960 None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:50:29.237488 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7be182a-9729-4327-bbe5-f81b5742d960 None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:50:29.247275 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6f1c71-fa9f-4e26-b1c4-abaf17158e53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:50:29.248821 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6f1c71-fa9f-4e26-b1c4-abaf17158e53 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:50:29.248821 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6f1c71-fa9f-4e26-b1c4-abaf17158e53 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:50:29.248821 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6f1c71-fa9f-4e26-b1c4-abaf17158e53 admin admin] PATH_INFO: `/v3/domains` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:50:29.249482 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6f1c71-fa9f-4e26-b1c4-abaf17158e53 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:50:29.250902 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6f1c71-fa9f-4e26-b1c4-abaf17158e53 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:50:29.252382 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6f1c71-fa9f-4e26-b1c4-abaf17158e53 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:50:29.266203 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 997/1998] 10.222.0.58 () {58 vars in 1152 bytes} [Tue Oct 12 16:50:29 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:50:29.270483 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6f1c71-fa9f-4e26-b1c4-abaf17158e53 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:50:29.281620 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1002/1999] 10.222.0.58 () {58 vars in 957 bytes} [Tue Oct 12 16:50:29 2021] POST /identity/v3/auth/tokens => generated 3427 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:50:29.285865 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6f1c71-fa9f-4e26-b1c4-abaf17158e53 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:50:29.286680 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4caebe2f-f9ef-404b-afca-fe7d91df1b67 None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:50:29.293459 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e173ea-6ac5-4abc-82b9-627b028cdfe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:50:29.294266 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e173ea-6ac5-4abc-82b9-627b028cdfe4 admin admin] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:50:29.294595 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e173ea-6ac5-4abc-82b9-627b028cdfe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:50:29.294874 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e173ea-6ac5-4abc-82b9-627b028cdfe4 admin admin] PATH_INFO: `/v3/projects` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:50:29.295596 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e173ea-6ac5-4abc-82b9-627b028cdfe4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:50:29.298498 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e173ea-6ac5-4abc-82b9-627b028cdfe4 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:50:29.302579 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4caebe2f-f9ef-404b-afca-fe7d91df1b67 None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:50:29.318759 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb61468-0b58-4816-ac57-bed7fa60f5b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:50:29.319806 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb61468-0b58-4816-ac57-bed7fa60f5b5 admin admin] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:50:29.320008 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb61468-0b58-4816-ac57-bed7fa60f5b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:50:29.320381 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb61468-0b58-4816-ac57-bed7fa60f5b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:50:29.321169 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb61468-0b58-4816-ac57-bed7fa60f5b5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:50:29.326765 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb61468-0b58-4816-ac57-bed7fa60f5b5 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:50:29.337704 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 998/2000] 10.222.0.58 () {60 vars in 1152 bytes} [Tue Oct 12 16:50:29 2021] POST /identity/v3/projects => generated 383 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 16:50:29.342207 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e173ea-6ac5-4abc-82b9-627b028cdfe4 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:50:29.359086 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1003/2001] 10.222.0.58 () {60 vars in 1152 bytes} [Tue Oct 12 16:50:29 2021] POST /identity/v3/projects => generated 409 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 16:50:29.363135 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb61468-0b58-4816-ac57-bed7fa60f5b5 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:50:29.415872 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e173ea-6ac5-4abc-82b9-627b028cdfe4 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:50:29.420526 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ca9c3d-b4fb-4a0b-810c-2153bea35ba1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:50:29.421348 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ca9c3d-b4fb-4a0b-810c-2153bea35ba1 admin admin] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:50:29.421643 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ca9c3d-b4fb-4a0b-810c-2153bea35ba1 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:50:29.421962 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ca9c3d-b4fb-4a0b-810c-2153bea35ba1 admin admin] PATH_INFO: `/v3/users` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:50:29.422831 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ca9c3d-b4fb-4a0b-810c-2153bea35ba1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:50:29.424511 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb61468-0b58-4816-ac57-bed7fa60f5b5 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:50:29.424982 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ca9c3d-b4fb-4a0b-810c-2153bea35ba1 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:50:29.429333 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87ef2ca-9306-46ba-89cc-5526c6f69860 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:50:29.430042 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87ef2ca-9306-46ba-89cc-5526c6f69860 admin admin] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:50:29.430327 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87ef2ca-9306-46ba-89cc-5526c6f69860 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:50:29.430980 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87ef2ca-9306-46ba-89cc-5526c6f69860 admin admin] PATH_INFO: `/v3/users` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:50:29.432034 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87ef2ca-9306-46ba-89cc-5526c6f69860 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:50:29.435100 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87ef2ca-9306-46ba-89cc-5526c6f69860 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:50:29.448774 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 999/2002] 10.222.0.58 () {60 vars in 1143 bytes} [Tue Oct 12 16:50:29 2021] POST /identity/v3/users => generated 292 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:50:29.449925 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ca9c3d-b4fb-4a0b-810c-2153bea35ba1 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:50:29.460430 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1004/2003] 10.222.0.58 () {60 vars in 1143 bytes} [Tue Oct 12 16:50:29 2021] POST /identity/v3/users => generated 311 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 16:50:29.461234 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87ef2ca-9306-46ba-89cc-5526c6f69860 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:50:29.464530 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ca9c3d-b4fb-4a0b-810c-2153bea35ba1 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:50:29.469103 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce672828-ac33-4d16-a657-ae48469f2a9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:50:29.469756 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce672828-ac33-4d16-a657-ae48469f2a9f admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:50:29.470078 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce672828-ac33-4d16-a657-ae48469f2a9f admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:50:29.470355 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce672828-ac33-4d16-a657-ae48469f2a9f admin admin] PATH_INFO: `/v3/roles` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:50:29.470858 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87ef2ca-9306-46ba-89cc-5526c6f69860 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:50:29.471092 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce672828-ac33-4d16-a657-ae48469f2a9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:50:29.472681 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce672828-ac33-4d16-a657-ae48469f2a9f admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:50:29.475554 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e47234-22f5-47a9-a2e7-4a392e356933 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:50:29.476197 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e47234-22f5-47a9-a2e7-4a392e356933 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:50:29.476479 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e47234-22f5-47a9-a2e7-4a392e356933 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:50:29.476757 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e47234-22f5-47a9-a2e7-4a392e356933 admin admin] PATH_INFO: `/v3/roles` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:50:29.477489 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e47234-22f5-47a9-a2e7-4a392e356933 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:50:29.479084 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e47234-22f5-47a9-a2e7-4a392e356933 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:50:29.482844 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1000/2004] 10.222.0.58 () {58 vars in 1121 bytes} [Tue Oct 12 16:50:29 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 16:50:29.486803 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce672828-ac33-4d16-a657-ae48469f2a9f admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:50:29.488770 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1005/2005] 10.222.0.58 () {58 vars in 1121 bytes} [Tue Oct 12 16:50:29 2021] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 16:50:29.492730 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e47234-22f5-47a9-a2e7-4a392e356933 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:50:29.496706 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce672828-ac33-4d16-a657-ae48469f2a9f admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:50:29.501305 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed4d392-e3f8-4cd5-8b66-ede82d2aa787 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:50:29.501736 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e47234-22f5-47a9-a2e7-4a392e356933 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:50:29.501994 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed4d392-e3f8-4cd5-8b66-ede82d2aa787 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:50:29.502277 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed4d392-e3f8-4cd5-8b66-ede82d2aa787 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:50:29.502561 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed4d392-e3f8-4cd5-8b66-ede82d2aa787 admin admin] PATH_INFO: `/v3/roles` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:50:29.503302 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed4d392-e3f8-4cd5-8b66-ede82d2aa787 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:50:29.504853 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed4d392-e3f8-4cd5-8b66-ede82d2aa787 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:50:29.506920 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db232b6-d40c-4a95-9e1c-c0598a6b94e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:50:29.507770 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db232b6-d40c-4a95-9e1c-c0598a6b94e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:50:29.508047 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db232b6-d40c-4a95-9e1c-c0598a6b94e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:50:29.508320 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db232b6-d40c-4a95-9e1c-c0598a6b94e5 admin admin] PATH_INFO: `/v3/projects/ad330c59fe7f4957a8fb83026fa65544/users/19b76e6b2013477188729a64b5bc7d6e/roles/610824e4f50f4fb8954610e98c1de784` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:50:29.514917 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1001/2006] 10.222.0.58 () {58 vars in 1121 bytes} [Tue Oct 12 16:50:29 2021] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 16:50:29.519104 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed4d392-e3f8-4cd5-8b66-ede82d2aa787 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:50:29.526267 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db232b6-d40c-4a95-9e1c-c0598a6b94e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad330c59fe7f4957a8fb83026fa65544, user_id=19b76e6b2013477188729a64b5bc7d6e, role_id=610824e4f50f4fb8954610e98c1de784)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:50:29.528872 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db232b6-d40c-4a95-9e1c-c0598a6b94e5 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:50:29.529075 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed4d392-e3f8-4cd5-8b66-ede82d2aa787 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:50:29.534614 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa4524f-4fa1-4249-a96d-aa59cb1c9a32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:50:29.535491 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa4524f-4fa1-4249-a96d-aa59cb1c9a32 admin admin] REQUEST_METHOD: `PUT` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:50:29.535828 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa4524f-4fa1-4249-a96d-aa59cb1c9a32 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:50:29.536069 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa4524f-4fa1-4249-a96d-aa59cb1c9a32 admin admin] PATH_INFO: `/v3/projects/21ab55c3bf90442dba24cbfc0d6e5fc1/users/fac2e7e3088b4863b65bd9310b878229/roles/55ba49fe29884e64b57c3ad13188d554` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:50:29.541651 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1006/2007] 10.222.0.58 () {60 vars in 1482 bytes} [Tue Oct 12 16:50:29 2021] PUT /identity/v3/projects/ad330c59fe7f4957a8fb83026fa65544/users/19b76e6b2013477188729a64b5bc7d6e/roles/610824e4f50f4fb8954610e98c1de784 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 16:50:29.545555 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db232b6-d40c-4a95-9e1c-c0598a6b94e5 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:50:29.553805 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa4524f-4fa1-4249-a96d-aa59cb1c9a32 admin admin] RBAC: Authorizing `identity:create_grant(project_id=21ab55c3bf90442dba24cbfc0d6e5fc1, user_id=fac2e7e3088b4863b65bd9310b878229, role_id=55ba49fe29884e64b57c3ad13188d554)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:50:29.556509 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa4524f-4fa1-4249-a96d-aa59cb1c9a32 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:50:29.570060 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1002/2008] 10.222.0.58 () {60 vars in 1482 bytes} [Tue Oct 12 16:50:29 2021] PUT /identity/v3/projects/21ab55c3bf90442dba24cbfc0d6e5fc1/users/fac2e7e3088b4863b65bd9310b878229/roles/55ba49fe29884e64b57c3ad13188d554 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 16:50:29.575066 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca27010-0f8d-4cc2-874f-7616852742b9 None None] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:50:29.575503 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca27010-0f8d-4cc2-874f-7616852742b9 None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:50:29.575787 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca27010-0f8d-4cc2-874f-7616852742b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:50:29.592510 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.auth.core [None req-1ca27010-0f8d-4cc2-874f-7616852742b9 None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:50:29.593743 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-1ca27010-0f8d-4cc2-874f-7616852742b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:50:29.607631 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db232b6-d40c-4a95-9e1c-c0598a6b94e5 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:50:29.650308 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1003/2009] 10.222.0.58 () {58 vars in 957 bytes} [Tue Oct 12 16:50:29 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:50:29.660507 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca27010-0f8d-4cc2-874f-7616852742b9 None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:50:29.662294 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-1ca27010-0f8d-4cc2-874f-7616852742b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:50:29.667213 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a946c03-30dc-423b-946f-9ab9b250997b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:50:29.667944 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a946c03-30dc-423b-946f-9ab9b250997b admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:50:29.668234 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a946c03-30dc-423b-946f-9ab9b250997b admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:50:29.668510 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a946c03-30dc-423b-946f-9ab9b250997b admin admin] PATH_INFO: `/v3/roles` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:50:29.669252 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a946c03-30dc-423b-946f-9ab9b250997b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:50:29.670873 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a946c03-30dc-423b-946f-9ab9b250997b admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:50:29.683718 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1007/2010] 10.222.0.58 () {58 vars in 1121 bytes} [Tue Oct 12 16:50:29 2021] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:50:29.684681 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a946c03-30dc-423b-946f-9ab9b250997b admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:50:29.695180 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a946c03-30dc-423b-946f-9ab9b250997b admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:50:29.699870 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94870afb-42e7-45aa-bd7f-f2dcbb4517a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:50:29.700783 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94870afb-42e7-45aa-bd7f-f2dcbb4517a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:50:29.701069 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94870afb-42e7-45aa-bd7f-f2dcbb4517a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:50:29.701347 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94870afb-42e7-45aa-bd7f-f2dcbb4517a2 admin admin] PATH_INFO: `/v3/projects/ad330c59fe7f4957a8fb83026fa65544/users/19b76e6b2013477188729a64b5bc7d6e/roles/610824e4f50f4fb8954610e98c1de784` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:50:29.703353 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94870afb-42e7-45aa-bd7f-f2dcbb4517a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad330c59fe7f4957a8fb83026fa65544, user_id=19b76e6b2013477188729a64b5bc7d6e, role_id=610824e4f50f4fb8954610e98c1de784)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:50:29.705980 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94870afb-42e7-45aa-bd7f-f2dcbb4517a2 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:50:29.717721 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1008/2011] 10.222.0.58 () {60 vars in 1482 bytes} [Tue Oct 12 16:50:29 2021] PUT /identity/v3/projects/ad330c59fe7f4957a8fb83026fa65544/users/19b76e6b2013477188729a64b5bc7d6e/roles/610824e4f50f4fb8954610e98c1de784 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:50:29.718838 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca27010-0f8d-4cc2-874f-7616852742b9 None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:50:29.727564 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2e971d-312c-4095-a911-c445d15046aa None None] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:50:29.727912 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2e971d-312c-4095-a911-c445d15046aa None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:50:29.728204 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2e971d-312c-4095-a911-c445d15046aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:50:29.760488 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.auth.core [None req-be2e971d-312c-4095-a911-c445d15046aa None None] MFA Rules not processed for user `19b76e6b2013477188729a64b5bc7d6e`. Rule list: `[]` (Enabled: `True`). {{(pid=85204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:50:29.761726 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-be2e971d-312c-4095-a911-c445d15046aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:50:29.765235 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a01f57c-6372-4ba8-8c18-7cfd9cc6e9ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e65f6d0598e4c539134292b86fb43d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:50:29.765907 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a01f57c-6372-4ba8-8c18-7cfd9cc6e9ab service neutron] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:50:29.766200 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a01f57c-6372-4ba8-8c18-7cfd9cc6e9ab service neutron] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:50:29.766462 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a01f57c-6372-4ba8-8c18-7cfd9cc6e9ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:50:29.827406 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a01f57c-6372-4ba8-8c18-7cfd9cc6e9ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:50:29.828842 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a01f57c-6372-4ba8-8c18-7cfd9cc6e9ab service neutron] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:50:29.834364 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1009/2012] 10.222.0.58 () {58 vars in 957 bytes} [Tue Oct 12 16:50:29 2021] POST /identity/v3/auth/tokens => generated 3496 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:50:29.839444 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1004/2013] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Oct 12 16:50:29 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:50:29.843645 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2e971d-312c-4095-a911-c445d15046aa None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:50:29.845054 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-be2e971d-312c-4095-a911-c445d15046aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:50:29.901903 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2e971d-312c-4095-a911-c445d15046aa None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:50:29.906176 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ac73ac-48ec-4386-bea7-fd6e65a4da7e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04704222b3d64a33a6c092fc641ccbb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:50:29.906832 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ac73ac-48ec-4386-bea7-fd6e65a4da7e service cinder] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:50:29.907138 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ac73ac-48ec-4386-bea7-fd6e65a4da7e service cinder] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:50:29.907403 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ac73ac-48ec-4386-bea7-fd6e65a4da7e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:50:29.916540 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ac73ac-48ec-4386-bea7-fd6e65a4da7e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:50:29.918007 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ac73ac-48ec-4386-bea7-fd6e65a4da7e service cinder] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:50:29.927696 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1010/2014] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Oct 12 16:50:29 2021] GET /identity/v3/auth/tokens => generated 3496 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:50:30.064807 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a01f57c-6372-4ba8-8c18-7cfd9cc6e9ab service neutron] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:50:30.074878 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a01f57c-6372-4ba8-8c18-7cfd9cc6e9ab service neutron] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:50:30.078640 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063c05ad-4660-4a6f-8630-04619c7c4637 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04704222b3d64a33a6c092fc641ccbb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:50:30.079314 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063c05ad-4660-4a6f-8630-04619c7c4637 service cinder] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:50:30.079600 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063c05ad-4660-4a6f-8630-04619c7c4637 service cinder] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:50:30.079874 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063c05ad-4660-4a6f-8630-04619c7c4637 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:50:30.135574 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063c05ad-4660-4a6f-8630-04619c7c4637 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:50:30.137030 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063c05ad-4660-4a6f-8630-04619c7c4637 service cinder] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:50:30.147311 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1005/2015] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Oct 12 16:50:30 2021] GET /identity/v3/auth/tokens => generated 3427 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:50:30.752010 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566d67a3-beca-4b7e-842f-5bdf3fd316cf None None] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:50:30.752541 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566d67a3-beca-4b7e-842f-5bdf3fd316cf None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:50:30.752636 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566d67a3-beca-4b7e-842f-5bdf3fd316cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:50:30.779987 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.auth.core [None req-566d67a3-beca-4b7e-842f-5bdf3fd316cf None None] MFA Rules not processed for user `fac2e7e3088b4863b65bd9310b878229`. Rule list: `[]` (Enabled: `True`). {{(pid=85204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:50:30.781296 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-566d67a3-beca-4b7e-842f-5bdf3fd316cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:50:30.850551 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1011/2016] 10.222.0.58 () {58 vars in 957 bytes} [Tue Oct 12 16:50:30 2021] POST /identity/v3/auth/tokens => generated 3403 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:50:30.861177 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a96ce8-65f1-4cad-9b7e-54f0d8244975 None None] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:50:30.862175 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a96ce8-65f1-4cad-9b7e-54f0d8244975 None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:50:30.862456 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a96ce8-65f1-4cad-9b7e-54f0d8244975 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:50:30.879555 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.auth.core [None req-19a96ce8-65f1-4cad-9b7e-54f0d8244975 None None] MFA Rules not processed for user `fac2e7e3088b4863b65bd9310b878229`. Rule list: `[]` (Enabled: `True`). {{(pid=85205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:50:30.880748 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-19a96ce8-65f1-4cad-9b7e-54f0d8244975 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:50:30.888156 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1006/2017] 10.222.0.58 () {58 vars in 957 bytes} [Tue Oct 12 16:50:30 2021] POST /identity/v3/auth/tokens => generated 3403 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:50:30.900943 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566d67a3-beca-4b7e-842f-5bdf3fd316cf None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:50:30.902407 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-566d67a3-beca-4b7e-842f-5bdf3fd316cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:50:30.977630 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566d67a3-beca-4b7e-842f-5bdf3fd316cf None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:50:30.983181 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df13572a-6f99-4c16-8c9a-029267b88f45 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29d30b574eec4ad3990d77d235c8b424', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:50:30.983832 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df13572a-6f99-4c16-8c9a-029267b88f45 service nova] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:50:30.984118 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df13572a-6f99-4c16-8c9a-029267b88f45 service nova] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:50:30.984397 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df13572a-6f99-4c16-8c9a-029267b88f45 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:50:30.992157 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df13572a-6f99-4c16-8c9a-029267b88f45 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:50:30.993726 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df13572a-6f99-4c16-8c9a-029267b88f45 service nova] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:50:31.002240 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1012/2018] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Oct 12 16:50:30 2021] GET /identity/v3/auth/tokens => generated 3403 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:50:31.932408 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a96ce8-65f1-4cad-9b7e-54f0d8244975 None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:50:31.934046 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-19a96ce8-65f1-4cad-9b7e-54f0d8244975 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:50:31.957969 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a96ce8-65f1-4cad-9b7e-54f0d8244975 None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:50:31.969173 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fd804a-5585-478a-aa48-cfd66e2688b9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04704222b3d64a33a6c092fc641ccbb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:50:31.970587 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fd804a-5585-478a-aa48-cfd66e2688b9 service cinder] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:50:31.972906 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fd804a-5585-478a-aa48-cfd66e2688b9 service cinder] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:50:31.973324 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fd804a-5585-478a-aa48-cfd66e2688b9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:50:31.978924 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-51fd804a-5585-478a-aa48-cfd66e2688b9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:50:32.054098 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fd804a-5585-478a-aa48-cfd66e2688b9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:50:32.055513 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fd804a-5585-478a-aa48-cfd66e2688b9 service cinder] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:50:32.065007 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1007/2019] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Oct 12 16:50:31 2021] GET /identity/v3/auth/tokens => generated 3472 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:50:38.761726 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df13572a-6f99-4c16-8c9a-029267b88f45 service nova] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:50:38.773294 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df13572a-6f99-4c16-8c9a-029267b88f45 service nova] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:50:38.780717 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc4ecd4-5d6f-4e1f-a069-af437eaafb07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:50:38.781679 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc4ecd4-5d6f-4e1f-a069-af437eaafb07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:50:38.782607 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc4ecd4-5d6f-4e1f-a069-af437eaafb07 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:50:38.782607 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc4ecd4-5d6f-4e1f-a069-af437eaafb07 admin admin] PATH_INFO: `/v3/users/cd2c7a2b71194846b4353d79e0c2ac01` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:50:38.783945 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc4ecd4-5d6f-4e1f-a069-af437eaafb07 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd2c7a2b71194846b4353d79e0c2ac01)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:50:38.786108 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc4ecd4-5d6f-4e1f-a069-af437eaafb07 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:50:38.844449 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-cdc4ecd4-5d6f-4e1f-a069-af437eaafb07 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd2c7a2b71194846b4353d79e0c2ac01'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:50:38.857706 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-cdc4ecd4-5d6f-4e1f-a069-af437eaafb07 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd2c7a2b71194846b4353d79e0c2ac01'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:50:38.864702 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-cdc4ecd4-5d6f-4e1f-a069-af437eaafb07 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd2c7a2b71194846b4353d79e0c2ac01'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:50:38.872777 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-cdc4ecd4-5d6f-4e1f-a069-af437eaafb07 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd2c7a2b71194846b4353d79e0c2ac01'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:50:38.873448 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-cdc4ecd4-5d6f-4e1f-a069-af437eaafb07 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd2c7a2b71194846b4353d79e0c2ac01'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:50:38.879791 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1013/2020] 10.222.0.58 () {58 vars in 1223 bytes} [Tue Oct 12 16:50:38 2021] DELETE /identity/v3/users/cd2c7a2b71194846b4353d79e0c2ac01 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:50:38.885211 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd21d17-cf1a-4aa1-996d-3f53911dadf9 None None] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:50:38.885728 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd21d17-cf1a-4aa1-996d-3f53911dadf9 None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:50:38.885826 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd21d17-cf1a-4aa1-996d-3f53911dadf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:50:38.903291 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.auth.core [None req-bcd21d17-cf1a-4aa1-996d-3f53911dadf9 None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:50:38.904640 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-bcd21d17-cf1a-4aa1-996d-3f53911dadf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:50:38.971033 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1008/2021] 10.222.0.58 () {58 vars in 957 bytes} [Tue Oct 12 16:50:38 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:50:38.980696 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc4ecd4-5d6f-4e1f-a069-af437eaafb07 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:50:38.982323 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-cdc4ecd4-5d6f-4e1f-a069-af437eaafb07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:50:39.045197 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc4ecd4-5d6f-4e1f-a069-af437eaafb07 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:50:39.055593 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82587bc-b8ff-4c9c-945e-0ef7262a8f8d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e65f6d0598e4c539134292b86fb43d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:50:39.056311 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82587bc-b8ff-4c9c-945e-0ef7262a8f8d service neutron] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:50:39.056601 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82587bc-b8ff-4c9c-945e-0ef7262a8f8d service neutron] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:50:39.056883 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82587bc-b8ff-4c9c-945e-0ef7262a8f8d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:50:39.067279 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82587bc-b8ff-4c9c-945e-0ef7262a8f8d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:50:39.068723 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82587bc-b8ff-4c9c-945e-0ef7262a8f8d service neutron] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:50:39.079008 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1014/2022] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Oct 12 16:50:38 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 12 16:50:39.426855 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd21d17-cf1a-4aa1-996d-3f53911dadf9 None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:50:39.428719 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-bcd21d17-cf1a-4aa1-996d-3f53911dadf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:50:39.443120 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd21d17-cf1a-4aa1-996d-3f53911dadf9 None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:50:39.448981 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f387966-c711-4c3e-9581-5b63035003a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:50:39.450734 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f387966-c711-4c3e-9581-5b63035003a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:50:39.451302 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f387966-c711-4c3e-9581-5b63035003a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:50:39.451725 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f387966-c711-4c3e-9581-5b63035003a4 admin admin] PATH_INFO: `/v3/users/34fc714a18c64bb4bb15b65b2874500a` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:50:39.453363 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f387966-c711-4c3e-9581-5b63035003a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=34fc714a18c64bb4bb15b65b2874500a)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:50:39.455478 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f387966-c711-4c3e-9581-5b63035003a4 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:50:39.539237 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-7f387966-c711-4c3e-9581-5b63035003a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '34fc714a18c64bb4bb15b65b2874500a'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:50:39.551469 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-7f387966-c711-4c3e-9581-5b63035003a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '34fc714a18c64bb4bb15b65b2874500a'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:50:39.559972 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-7f387966-c711-4c3e-9581-5b63035003a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '34fc714a18c64bb4bb15b65b2874500a'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:50:39.567580 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-7f387966-c711-4c3e-9581-5b63035003a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '34fc714a18c64bb4bb15b65b2874500a'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:50:39.568311 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-7f387966-c711-4c3e-9581-5b63035003a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '34fc714a18c64bb4bb15b65b2874500a'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:50:39.574841 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1009/2023] 10.222.0.58 () {58 vars in 1223 bytes} [Tue Oct 12 16:50:39 2021] DELETE /identity/v3/users/34fc714a18c64bb4bb15b65b2874500a => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:50:39.579351 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56165a7-b56c-4ff6-b8e5-c5328f789edd None None] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:50:39.579650 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56165a7-b56c-4ff6-b8e5-c5328f789edd None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:50:39.579935 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56165a7-b56c-4ff6-b8e5-c5328f789edd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:50:39.597275 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.auth.core [None req-d56165a7-b56c-4ff6-b8e5-c5328f789edd None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:50:39.598498 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-d56165a7-b56c-4ff6-b8e5-c5328f789edd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:50:39.662944 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1015/2024] 10.222.0.58 () {58 vars in 957 bytes} [Tue Oct 12 16:50:39 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:50:39.679317 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f387966-c711-4c3e-9581-5b63035003a4 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:50:39.681158 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-7f387966-c711-4c3e-9581-5b63035003a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:50:39.746029 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f387966-c711-4c3e-9581-5b63035003a4 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:50:39.749866 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eada859-f75e-4efa-9a88-422e85cc027c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e65f6d0598e4c539134292b86fb43d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:50:39.750549 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eada859-f75e-4efa-9a88-422e85cc027c service neutron] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:50:39.750829 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eada859-f75e-4efa-9a88-422e85cc027c service neutron] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:50:39.751102 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eada859-f75e-4efa-9a88-422e85cc027c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:50:39.760698 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eada859-f75e-4efa-9a88-422e85cc027c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:50:39.762141 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eada859-f75e-4efa-9a88-422e85cc027c service neutron] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:50:39.772408 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1010/2025] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Oct 12 16:50:39 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:50:39.790781 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56165a7-b56c-4ff6-b8e5-c5328f789edd None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:50:39.792844 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-d56165a7-b56c-4ff6-b8e5-c5328f789edd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:50:39.807134 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56165a7-b56c-4ff6-b8e5-c5328f789edd None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:50:39.813527 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01250cc9-285a-4f89-9653-5109cc8ff8ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:50:39.813832 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01250cc9-285a-4f89-9653-5109cc8ff8ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:50:39.814216 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01250cc9-285a-4f89-9653-5109cc8ff8ed admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:50:39.814610 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01250cc9-285a-4f89-9653-5109cc8ff8ed admin admin] PATH_INFO: `/v3/projects/8129c767a95c46c59bee30e637cab0cc` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:50:39.816142 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01250cc9-285a-4f89-9653-5109cc8ff8ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=8129c767a95c46c59bee30e637cab0cc)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:50:39.819079 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01250cc9-285a-4f89-9653-5109cc8ff8ed admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:50:39.869761 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-01250cc9-285a-4f89-9653-5109cc8ff8ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8129c767a95c46c59bee30e637cab0cc', 'request_id': 'req-01250cc9-285a-4f89-9653-5109cc8ff8ed'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:50:39.875446 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-01250cc9-285a-4f89-9653-5109cc8ff8ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8129c767a95c46c59bee30e637cab0cc', 'request_id': 'req-01250cc9-285a-4f89-9653-5109cc8ff8ed'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:50:39.881823 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-01250cc9-285a-4f89-9653-5109cc8ff8ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8129c767a95c46c59bee30e637cab0cc', 'request_id': 'req-01250cc9-285a-4f89-9653-5109cc8ff8ed'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:50:39.896016 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-01250cc9-285a-4f89-9653-5109cc8ff8ed admin admin] The token cache is being invalidate because project 8129c767a95c46c59bee30e637cab0cc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=85204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 16:50:39.896310 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-01250cc9-285a-4f89-9653-5109cc8ff8ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:50:39.896967 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-01250cc9-285a-4f89-9653-5109cc8ff8ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:50:39.899189 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1016/2026] 10.222.0.58 () {58 vars in 1232 bytes} [Tue Oct 12 16:50:39 2021] DELETE /identity/v3/projects/8129c767a95c46c59bee30e637cab0cc => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:50:39.903374 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eada859-f75e-4efa-9a88-422e85cc027c service neutron] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:50:39.918965 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eada859-f75e-4efa-9a88-422e85cc027c service neutron] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:50:39.994881 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8042a69f-c84c-4d87-9460-687435aa7c5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:50:39.995969 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8042a69f-c84c-4d87-9460-687435aa7c5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:50:39.996287 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8042a69f-c84c-4d87-9460-687435aa7c5a admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:50:39.996565 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8042a69f-c84c-4d87-9460-687435aa7c5a admin admin] PATH_INFO: `/v3/users/19b76e6b2013477188729a64b5bc7d6e` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:50:39.997820 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8042a69f-c84c-4d87-9460-687435aa7c5a admin admin] RBAC: Authorizing `identity:delete_user(user_id=19b76e6b2013477188729a64b5bc7d6e)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:50:39.999782 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8042a69f-c84c-4d87-9460-687435aa7c5a admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:50:40.044910 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-8042a69f-c84c-4d87-9460-687435aa7c5a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '19b76e6b2013477188729a64b5bc7d6e'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:50:40.057849 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-8042a69f-c84c-4d87-9460-687435aa7c5a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '19b76e6b2013477188729a64b5bc7d6e'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:50:40.066978 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-8042a69f-c84c-4d87-9460-687435aa7c5a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '19b76e6b2013477188729a64b5bc7d6e'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:50:40.075115 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-8042a69f-c84c-4d87-9460-687435aa7c5a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '19b76e6b2013477188729a64b5bc7d6e'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:50:40.075881 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-8042a69f-c84c-4d87-9460-687435aa7c5a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '19b76e6b2013477188729a64b5bc7d6e'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:50:40.082939 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1011/2027] 10.222.0.58 () {58 vars in 1223 bytes} [Tue Oct 12 16:50:39 2021] DELETE /identity/v3/users/19b76e6b2013477188729a64b5bc7d6e => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 16:50:40.126250 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01250cc9-285a-4f89-9653-5109cc8ff8ed admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:50:40.128401 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-01250cc9-285a-4f89-9653-5109cc8ff8ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:50:40.152445 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01250cc9-285a-4f89-9653-5109cc8ff8ed admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:50:40.216548 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96b9d60-3942-4951-9285-fe4d8b4da081 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:50:40.217690 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96b9d60-3942-4951-9285-fe4d8b4da081 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:50:40.218011 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96b9d60-3942-4951-9285-fe4d8b4da081 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:50:40.218297 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96b9d60-3942-4951-9285-fe4d8b4da081 admin admin] PATH_INFO: `/v3/projects/929d3800cb9241509dbef39a35036740` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:50:40.219511 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96b9d60-3942-4951-9285-fe4d8b4da081 admin admin] RBAC: Authorizing `identity:delete_project(project_id=929d3800cb9241509dbef39a35036740)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:50:40.221407 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96b9d60-3942-4951-9285-fe4d8b4da081 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:50:40.270767 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-f96b9d60-3942-4951-9285-fe4d8b4da081 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '929d3800cb9241509dbef39a35036740', 'request_id': 'req-f96b9d60-3942-4951-9285-fe4d8b4da081'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:50:40.276487 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-f96b9d60-3942-4951-9285-fe4d8b4da081 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '929d3800cb9241509dbef39a35036740', 'request_id': 'req-f96b9d60-3942-4951-9285-fe4d8b4da081'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:50:40.282480 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-f96b9d60-3942-4951-9285-fe4d8b4da081 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '929d3800cb9241509dbef39a35036740', 'request_id': 'req-f96b9d60-3942-4951-9285-fe4d8b4da081'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:50:40.295949 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-f96b9d60-3942-4951-9285-fe4d8b4da081 admin admin] The token cache is being invalidate because project 929d3800cb9241509dbef39a35036740 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=85204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 16:50:40.296233 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-f96b9d60-3942-4951-9285-fe4d8b4da081 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:50:40.296867 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-f96b9d60-3942-4951-9285-fe4d8b4da081 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:50:40.301807 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1017/2028] 10.222.0.58 () {58 vars in 1232 bytes} [Tue Oct 12 16:50:40 2021] DELETE /identity/v3/projects/929d3800cb9241509dbef39a35036740 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:50:40.302810 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8042a69f-c84c-4d87-9460-687435aa7c5a admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:50:40.304210 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-8042a69f-c84c-4d87-9460-687435aa7c5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:50:40.317615 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8042a69f-c84c-4d87-9460-687435aa7c5a admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:50:40.359407 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96b9d60-3942-4951-9285-fe4d8b4da081 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:50:40.360869 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-f96b9d60-3942-4951-9285-fe4d8b4da081 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:50:40.377692 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c9d2e6-4d83-44f5-aee9-976db3ffc149 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:50:40.378778 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c9d2e6-4d83-44f5-aee9-976db3ffc149 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:50:40.379193 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c9d2e6-4d83-44f5-aee9-976db3ffc149 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:50:40.379469 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c9d2e6-4d83-44f5-aee9-976db3ffc149 admin admin] PATH_INFO: `/v3/users/88c263d7eb8f4f5dbf975ef74ce66d3d` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:50:40.380738 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c9d2e6-4d83-44f5-aee9-976db3ffc149 admin admin] RBAC: Authorizing `identity:delete_user(user_id=88c263d7eb8f4f5dbf975ef74ce66d3d)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:50:40.383426 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c9d2e6-4d83-44f5-aee9-976db3ffc149 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:50:40.426110 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96b9d60-3942-4951-9285-fe4d8b4da081 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:50:40.431707 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-f9c9d2e6-4d83-44f5-aee9-976db3ffc149 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '88c263d7eb8f4f5dbf975ef74ce66d3d'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:50:40.432497 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6408c6-60a1-4857-9eba-27abf2a97b1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:50:40.433417 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6408c6-60a1-4857-9eba-27abf2a97b1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:50:40.433703 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6408c6-60a1-4857-9eba-27abf2a97b1d admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:50:40.434019 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6408c6-60a1-4857-9eba-27abf2a97b1d admin admin] PATH_INFO: `/v3/projects/ad330c59fe7f4957a8fb83026fa65544` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:50:40.435381 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6408c6-60a1-4857-9eba-27abf2a97b1d admin admin] RBAC: Authorizing `identity:delete_project(project_id=ad330c59fe7f4957a8fb83026fa65544)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:50:40.437526 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6408c6-60a1-4857-9eba-27abf2a97b1d admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:50:40.445273 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-f9c9d2e6-4d83-44f5-aee9-976db3ffc149 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '88c263d7eb8f4f5dbf975ef74ce66d3d'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:50:40.455903 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-f9c9d2e6-4d83-44f5-aee9-976db3ffc149 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '88c263d7eb8f4f5dbf975ef74ce66d3d'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:50:40.463211 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-f9c9d2e6-4d83-44f5-aee9-976db3ffc149 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '88c263d7eb8f4f5dbf975ef74ce66d3d'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:50:40.463866 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-f9c9d2e6-4d83-44f5-aee9-976db3ffc149 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '88c263d7eb8f4f5dbf975ef74ce66d3d'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:50:40.470186 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1012/2029] 10.222.0.58 () {58 vars in 1223 bytes} [Tue Oct 12 16:50:40 2021] DELETE /identity/v3/users/88c263d7eb8f4f5dbf975ef74ce66d3d => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 16:50:40.485046 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-6b6408c6-60a1-4857-9eba-27abf2a97b1d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ad330c59fe7f4957a8fb83026fa65544', 'request_id': 'req-6b6408c6-60a1-4857-9eba-27abf2a97b1d'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:50:40.490165 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-6b6408c6-60a1-4857-9eba-27abf2a97b1d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ad330c59fe7f4957a8fb83026fa65544', 'request_id': 'req-6b6408c6-60a1-4857-9eba-27abf2a97b1d'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:50:40.497156 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-6b6408c6-60a1-4857-9eba-27abf2a97b1d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ad330c59fe7f4957a8fb83026fa65544', 'request_id': 'req-6b6408c6-60a1-4857-9eba-27abf2a97b1d'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:50:40.510711 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-6b6408c6-60a1-4857-9eba-27abf2a97b1d admin admin] The token cache is being invalidate because project ad330c59fe7f4957a8fb83026fa65544 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=85204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 16:50:40.511001 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-6b6408c6-60a1-4857-9eba-27abf2a97b1d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:50:40.512042 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-6b6408c6-60a1-4857-9eba-27abf2a97b1d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:50:40.518145 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1018/2030] 10.222.0.58 () {58 vars in 1232 bytes} [Tue Oct 12 16:50:40 2021] DELETE /identity/v3/projects/ad330c59fe7f4957a8fb83026fa65544 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 16:50:40.520142 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b4d931-a889-4016-ad35-be193e21ca93 None None] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:50:40.520596 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b4d931-a889-4016-ad35-be193e21ca93 None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:50:40.520739 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b4d931-a889-4016-ad35-be193e21ca93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:50:40.542272 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.auth.core [None req-a2b4d931-a889-4016-ad35-be193e21ca93 None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:50:40.543852 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-a2b4d931-a889-4016-ad35-be193e21ca93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:50:40.614297 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1013/2031] 10.222.0.58 () {58 vars in 957 bytes} [Tue Oct 12 16:50:40 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:50:40.622916 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10014a73-c103-46cb-be25-7dca23bf8a4f None None] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:50:40.623210 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10014a73-c103-46cb-be25-7dca23bf8a4f None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:50:40.623493 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10014a73-c103-46cb-be25-7dca23bf8a4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:50:40.641473 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.auth.core [None req-10014a73-c103-46cb-be25-7dca23bf8a4f None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:50:40.642715 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-10014a73-c103-46cb-be25-7dca23bf8a4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:50:40.651728 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1019/2032] 10.222.0.58 () {58 vars in 957 bytes} [Tue Oct 12 16:50:40 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:50:40.656156 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b4d931-a889-4016-ad35-be193e21ca93 None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:50:40.666937 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b4d931-a889-4016-ad35-be193e21ca93 None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:50:40.671667 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5faef76f-dcef-495f-b84d-5a3c7c8662fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:50:40.672330 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faef76f-dcef-495f-b84d-5a3c7c8662fe admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:50:40.672614 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faef76f-dcef-495f-b84d-5a3c7c8662fe admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:50:40.672892 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faef76f-dcef-495f-b84d-5a3c7c8662fe admin admin] PATH_INFO: `/v3/domains` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:50:40.673667 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5faef76f-dcef-495f-b84d-5a3c7c8662fe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:50:40.674014 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5faef76f-dcef-495f-b84d-5a3c7c8662fe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:50:40.675601 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5faef76f-dcef-495f-b84d-5a3c7c8662fe admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:50:40.689923 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1014/2033] 10.222.0.58 () {58 vars in 1152 bytes} [Tue Oct 12 16:50:40 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:50:40.695270 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10014a73-c103-46cb-be25-7dca23bf8a4f None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:50:40.713902 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10014a73-c103-46cb-be25-7dca23bf8a4f None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:50:40.725634 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0043dcf4-495e-4591-bd52-c72db41ca455 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:50:40.726475 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0043dcf4-495e-4591-bd52-c72db41ca455 admin admin] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:50:40.726817 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0043dcf4-495e-4591-bd52-c72db41ca455 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:50:40.727417 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0043dcf4-495e-4591-bd52-c72db41ca455 admin admin] PATH_INFO: `/v3/projects` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:50:40.728167 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0043dcf4-495e-4591-bd52-c72db41ca455 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:50:40.730375 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0043dcf4-495e-4591-bd52-c72db41ca455 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:50:40.774410 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1020/2034] 10.222.0.58 () {60 vars in 1152 bytes} [Tue Oct 12 16:50:40 2021] POST /identity/v3/projects => generated 373 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:50:40.778769 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5faef76f-dcef-495f-b84d-5a3c7c8662fe admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:50:40.788507 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5faef76f-dcef-495f-b84d-5a3c7c8662fe admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:50:40.799917 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0043dcf4-495e-4591-bd52-c72db41ca455 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:50:40.801559 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-0043dcf4-495e-4591-bd52-c72db41ca455 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:50:40.858319 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673de200-2da6-48d0-98ec-d4c2909d17b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:50:40.859037 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673de200-2da6-48d0-98ec-d4c2909d17b5 admin admin] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:50:40.859317 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673de200-2da6-48d0-98ec-d4c2909d17b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:50:40.859602 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673de200-2da6-48d0-98ec-d4c2909d17b5 admin admin] PATH_INFO: `/v3/users` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:50:40.860320 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673de200-2da6-48d0-98ec-d4c2909d17b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:50:40.862267 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673de200-2da6-48d0-98ec-d4c2909d17b5 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:50:40.884673 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1015/2035] 10.222.0.58 () {60 vars in 1143 bytes} [Tue Oct 12 16:50:40 2021] POST /identity/v3/users => generated 287 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 16:50:40.888531 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673de200-2da6-48d0-98ec-d4c2909d17b5 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:50:40.897781 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0043dcf4-495e-4591-bd52-c72db41ca455 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:50:40.898719 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673de200-2da6-48d0-98ec-d4c2909d17b5 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:50:40.902479 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebb18ea-07af-4316-b628-64b198fea30d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:50:40.903340 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebb18ea-07af-4316-b628-64b198fea30d admin admin] REQUEST_METHOD: `DELETE` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:50:40.903625 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebb18ea-07af-4316-b628-64b198fea30d admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:50:40.903725 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2557a00-8a1d-4166-860f-2fc145d582d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:50:40.904151 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebb18ea-07af-4316-b628-64b198fea30d admin admin] PATH_INFO: `/v3/projects/13bf5a4c8674446d9012f2f9e1b1c2a2` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:50:40.904330 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2557a00-8a1d-4166-860f-2fc145d582d6 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:50:40.904603 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2557a00-8a1d-4166-860f-2fc145d582d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:50:40.904886 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2557a00-8a1d-4166-860f-2fc145d582d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:50:40.905401 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebb18ea-07af-4316-b628-64b198fea30d admin admin] RBAC: Authorizing `identity:delete_project(project_id=13bf5a4c8674446d9012f2f9e1b1c2a2)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:50:40.905628 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2557a00-8a1d-4166-860f-2fc145d582d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:50:40.907248 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2557a00-8a1d-4166-860f-2fc145d582d6 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:50:40.907350 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebb18ea-07af-4316-b628-64b198fea30d admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:50:40.918694 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1016/2036] 10.222.0.58 () {58 vars in 1121 bytes} [Tue Oct 12 16:50:40 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 16:50:40.923134 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2557a00-8a1d-4166-860f-2fc145d582d6 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:50:40.937555 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2557a00-8a1d-4166-860f-2fc145d582d6 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:50:40.942542 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97aa26f6-b0bc-4787-b1c8-e1e924d0f976 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:50:40.943215 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97aa26f6-b0bc-4787-b1c8-e1e924d0f976 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:50:40.943503 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97aa26f6-b0bc-4787-b1c8-e1e924d0f976 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:50:40.943786 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97aa26f6-b0bc-4787-b1c8-e1e924d0f976 admin admin] PATH_INFO: `/v3/roles` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:50:40.944529 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97aa26f6-b0bc-4787-b1c8-e1e924d0f976 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:50:40.946887 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97aa26f6-b0bc-4787-b1c8-e1e924d0f976 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:50:40.961303 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1017/2037] 10.222.0.58 () {58 vars in 1121 bytes} [Tue Oct 12 16:50:40 2021] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:50:40.962558 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97aa26f6-b0bc-4787-b1c8-e1e924d0f976 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:50:40.974378 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97aa26f6-b0bc-4787-b1c8-e1e924d0f976 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:50:40.987182 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-6ebb18ea-07af-4316-b628-64b198fea30d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '13bf5a4c8674446d9012f2f9e1b1c2a2', 'request_id': 'req-6ebb18ea-07af-4316-b628-64b198fea30d'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:50:40.993210 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-6ebb18ea-07af-4316-b628-64b198fea30d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '13bf5a4c8674446d9012f2f9e1b1c2a2', 'request_id': 'req-6ebb18ea-07af-4316-b628-64b198fea30d'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:50:40.999443 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-6ebb18ea-07af-4316-b628-64b198fea30d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '13bf5a4c8674446d9012f2f9e1b1c2a2', 'request_id': 'req-6ebb18ea-07af-4316-b628-64b198fea30d'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:50:41.012469 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-6ebb18ea-07af-4316-b628-64b198fea30d admin admin] The token cache is being invalidate because project 13bf5a4c8674446d9012f2f9e1b1c2a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=85204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 16:50:41.012838 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-6ebb18ea-07af-4316-b628-64b198fea30d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:50:41.013550 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-6ebb18ea-07af-4316-b628-64b198fea30d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:50:41.015218 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1021/2038] 10.222.0.58 () {58 vars in 1232 bytes} [Tue Oct 12 16:50:40 2021] DELETE /identity/v3/projects/13bf5a4c8674446d9012f2f9e1b1c2a2 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 16:50:41.021663 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9468149e-6291-4b02-977c-3d5e3a06ee14 None None] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:50:41.022056 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9468149e-6291-4b02-977c-3d5e3a06ee14 None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:50:41.022443 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9468149e-6291-4b02-977c-3d5e3a06ee14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:50:41.030156 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db395dea-400c-44ba-9036-41b305ac65f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:50:41.031038 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db395dea-400c-44ba-9036-41b305ac65f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:50:41.031320 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db395dea-400c-44ba-9036-41b305ac65f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:50:41.031684 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db395dea-400c-44ba-9036-41b305ac65f5 admin admin] PATH_INFO: `/v3/projects/418468803a4b41cb91536776b6f61021/users/65b1911087cf4620b324ed0a1dee3b7a/roles/55ba49fe29884e64b57c3ad13188d554` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:50:41.042669 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.auth.core [None req-9468149e-6291-4b02-977c-3d5e3a06ee14 None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:50:41.044034 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-9468149e-6291-4b02-977c-3d5e3a06ee14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:50:41.053386 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1022/2039] 10.222.0.58 () {58 vars in 957 bytes} [Tue Oct 12 16:50:41 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:50:41.054583 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db395dea-400c-44ba-9036-41b305ac65f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=418468803a4b41cb91536776b6f61021, user_id=65b1911087cf4620b324ed0a1dee3b7a, role_id=55ba49fe29884e64b57c3ad13188d554)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:50:41.059474 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db395dea-400c-44ba-9036-41b305ac65f5 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:50:41.062928 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2099056a-eb6c-4bbf-9161-0d3d8ef3db3b None None] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:50:41.063225 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2099056a-eb6c-4bbf-9161-0d3d8ef3db3b None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:50:41.063618 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2099056a-eb6c-4bbf-9161-0d3d8ef3db3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:50:41.076923 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1018/2040] 10.222.0.58 () {60 vars in 1482 bytes} [Tue Oct 12 16:50:40 2021] PUT /identity/v3/projects/418468803a4b41cb91536776b6f61021/users/65b1911087cf4620b324ed0a1dee3b7a/roles/55ba49fe29884e64b57c3ad13188d554 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:50:41.083751 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.auth.core [None req-2099056a-eb6c-4bbf-9161-0d3d8ef3db3b None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:50:41.084947 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-2099056a-eb6c-4bbf-9161-0d3d8ef3db3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:50:41.090248 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1535945a-8b87-4304-a200-90bbeff16bd7 None None] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:50:41.091338 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1535945a-8b87-4304-a200-90bbeff16bd7 None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:50:41.092379 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1535945a-8b87-4304-a200-90bbeff16bd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:50:41.143852 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.auth.core [None req-1535945a-8b87-4304-a200-90bbeff16bd7 None None] MFA Rules not processed for user `65b1911087cf4620b324ed0a1dee3b7a`. Rule list: `[]` (Enabled: `True`). {{(pid=85205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:50:41.145370 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-1535945a-8b87-4304-a200-90bbeff16bd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:50:41.154403 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1023/2041] 10.222.0.58 () {58 vars in 957 bytes} [Tue Oct 12 16:50:41 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:50:41.159018 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2099056a-eb6c-4bbf-9161-0d3d8ef3db3b None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:50:41.172640 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2099056a-eb6c-4bbf-9161-0d3d8ef3db3b None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:50:41.183088 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4a6652-9650-4cad-821f-50670f9e4f73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:50:41.183869 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4a6652-9650-4cad-821f-50670f9e4f73 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:50:41.184226 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4a6652-9650-4cad-821f-50670f9e4f73 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:50:41.184574 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4a6652-9650-4cad-821f-50670f9e4f73 admin admin] PATH_INFO: `/v3/domains` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:50:41.185529 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4a6652-9650-4cad-821f-50670f9e4f73 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:50:41.185782 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4a6652-9650-4cad-821f-50670f9e4f73 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:50:41.187647 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4a6652-9650-4cad-821f-50670f9e4f73 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:50:41.203041 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1024/2042] 10.222.0.58 () {58 vars in 1152 bytes} [Tue Oct 12 16:50:41 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:50:41.204255 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4a6652-9650-4cad-821f-50670f9e4f73 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:50:41.215387 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4a6652-9650-4cad-821f-50670f9e4f73 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:50:41.220444 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985c1452-2d27-4a92-a4aa-5c73fe07042b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:50:41.221248 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985c1452-2d27-4a92-a4aa-5c73fe07042b admin admin] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:50:41.221775 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985c1452-2d27-4a92-a4aa-5c73fe07042b admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:50:41.222144 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985c1452-2d27-4a92-a4aa-5c73fe07042b admin admin] PATH_INFO: `/v3/projects` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:50:41.222942 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985c1452-2d27-4a92-a4aa-5c73fe07042b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:50:41.224978 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985c1452-2d27-4a92-a4aa-5c73fe07042b admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:50:41.257324 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1025/2043] 10.222.0.58 () {60 vars in 1152 bytes} [Tue Oct 12 16:50:41 2021] POST /identity/v3/projects => generated 361 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 16:50:41.258517 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985c1452-2d27-4a92-a4aa-5c73fe07042b admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:50:41.346871 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1019/2044] 10.222.0.58 () {58 vars in 957 bytes} [Tue Oct 12 16:50:41 2021] POST /identity/v3/auth/tokens => generated 3393 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:50:41.347102 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985c1452-2d27-4a92-a4aa-5c73fe07042b admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:50:41.354317 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fef69c1-0e23-457f-835a-eaf70da82151 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:50:41.355196 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fef69c1-0e23-457f-835a-eaf70da82151 admin admin] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:50:41.355479 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fef69c1-0e23-457f-835a-eaf70da82151 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:50:41.355759 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fef69c1-0e23-457f-835a-eaf70da82151 admin admin] PATH_INFO: `/v3/users` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:50:41.356465 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fef69c1-0e23-457f-835a-eaf70da82151 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:50:41.357553 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1535945a-8b87-4304-a200-90bbeff16bd7 None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:50:41.358585 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fef69c1-0e23-457f-835a-eaf70da82151 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:50:41.359674 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-1535945a-8b87-4304-a200-90bbeff16bd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:50:41.383712 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1026/2045] 10.222.0.58 () {60 vars in 1143 bytes} [Tue Oct 12 16:50:41 2021] POST /identity/v3/users => generated 281 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 16:50:41.387316 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fef69c1-0e23-457f-835a-eaf70da82151 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:50:41.397999 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fef69c1-0e23-457f-835a-eaf70da82151 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:50:41.404391 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ffd1f2-ead8-4197-afb3-353309af14b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:50:41.405060 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ffd1f2-ead8-4197-afb3-353309af14b5 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:50:41.405359 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ffd1f2-ead8-4197-afb3-353309af14b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:50:41.405643 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ffd1f2-ead8-4197-afb3-353309af14b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:50:41.406466 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ffd1f2-ead8-4197-afb3-353309af14b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:50:41.408911 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ffd1f2-ead8-4197-afb3-353309af14b5 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:50:41.421594 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1027/2046] 10.222.0.58 () {58 vars in 1121 bytes} [Tue Oct 12 16:50:41 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 16:50:41.425461 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ffd1f2-ead8-4197-afb3-353309af14b5 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:50:41.427987 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1535945a-8b87-4304-a200-90bbeff16bd7 None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:50:41.435262 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ffd1f2-ead8-4197-afb3-353309af14b5 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:50:41.440463 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac453b0d-b5e4-43a6-86df-16c49a3f23a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:50:41.441115 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac453b0d-b5e4-43a6-86df-16c49a3f23a9 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:50:41.441397 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac453b0d-b5e4-43a6-86df-16c49a3f23a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:50:41.441669 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac453b0d-b5e4-43a6-86df-16c49a3f23a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:50:41.442458 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac453b0d-b5e4-43a6-86df-16c49a3f23a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:50:41.444033 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac453b0d-b5e4-43a6-86df-16c49a3f23a9 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:50:41.454684 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1028/2047] 10.222.0.58 () {58 vars in 1121 bytes} [Tue Oct 12 16:50:41 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 16:50:41.458998 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac453b0d-b5e4-43a6-86df-16c49a3f23a9 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:50:41.470131 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac453b0d-b5e4-43a6-86df-16c49a3f23a9 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:50:41.475310 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af8db8f-b4af-4b45-8e7f-996c2058b089 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:50:41.476192 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af8db8f-b4af-4b45-8e7f-996c2058b089 admin admin] REQUEST_METHOD: `PUT` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:50:41.476478 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af8db8f-b4af-4b45-8e7f-996c2058b089 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:50:41.477316 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af8db8f-b4af-4b45-8e7f-996c2058b089 admin admin] PATH_INFO: `/v3/projects/096961e0e47e4ae397fa47db915775f0/users/3974fdfd8c9a4e19886306b11a89473d/roles/55ba49fe29884e64b57c3ad13188d554` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:50:41.479456 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70541691-aa20-4fae-b8d1-8174b720e215 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04704222b3d64a33a6c092fc641ccbb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:50:41.480105 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70541691-aa20-4fae-b8d1-8174b720e215 service cinder] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:50:41.480613 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70541691-aa20-4fae-b8d1-8174b720e215 service cinder] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:50:41.480908 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70541691-aa20-4fae-b8d1-8174b720e215 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:50:41.494131 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af8db8f-b4af-4b45-8e7f-996c2058b089 admin admin] RBAC: Authorizing `identity:create_grant(project_id=096961e0e47e4ae397fa47db915775f0, user_id=3974fdfd8c9a4e19886306b11a89473d, role_id=55ba49fe29884e64b57c3ad13188d554)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:50:41.496924 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af8db8f-b4af-4b45-8e7f-996c2058b089 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:50:41.510811 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1029/2048] 10.222.0.58 () {60 vars in 1482 bytes} [Tue Oct 12 16:50:41 2021] PUT /identity/v3/projects/096961e0e47e4ae397fa47db915775f0/users/3974fdfd8c9a4e19886306b11a89473d/roles/55ba49fe29884e64b57c3ad13188d554 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 16:50:41.523387 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1a4872-b2d6-4032-9f7f-81d4359eb87f None None] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:50:41.524212 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1a4872-b2d6-4032-9f7f-81d4359eb87f None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:50:41.524496 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1a4872-b2d6-4032-9f7f-81d4359eb87f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:50:41.556221 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.auth.core [None req-dc1a4872-b2d6-4032-9f7f-81d4359eb87f None None] MFA Rules not processed for user `3974fdfd8c9a4e19886306b11a89473d`. Rule list: `[]` (Enabled: `True`). {{(pid=85204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:50:41.557600 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-dc1a4872-b2d6-4032-9f7f-81d4359eb87f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:50:41.565595 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70541691-aa20-4fae-b8d1-8174b720e215 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:50:41.566628 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70541691-aa20-4fae-b8d1-8174b720e215 service cinder] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:50:41.576800 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1020/2049] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Oct 12 16:50:41 2021] GET /identity/v3/auth/tokens => generated 3393 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 12 16:50:41.628897 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1030/2050] 10.222.0.58 () {58 vars in 957 bytes} [Tue Oct 12 16:50:41 2021] POST /identity/v3/auth/tokens => generated 3381 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:50:41.655576 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70541691-aa20-4fae-b8d1-8174b720e215 service cinder] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:50:41.656962 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-70541691-aa20-4fae-b8d1-8174b720e215 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:50:41.668032 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70541691-aa20-4fae-b8d1-8174b720e215 service cinder] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:50:41.716536 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d199c5-0209-45a5-b4b0-bf12a334fe4f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04704222b3d64a33a6c092fc641ccbb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:50:41.717199 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d199c5-0209-45a5-b4b0-bf12a334fe4f service cinder] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:50:41.717509 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d199c5-0209-45a5-b4b0-bf12a334fe4f service cinder] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:50:41.717769 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d199c5-0209-45a5-b4b0-bf12a334fe4f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:50:41.726781 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d199c5-0209-45a5-b4b0-bf12a334fe4f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:50:41.728724 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d199c5-0209-45a5-b4b0-bf12a334fe4f service cinder] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:50:41.738391 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1021/2051] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Oct 12 16:50:41 2021] GET /identity/v3/auth/tokens => generated 3381 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:50:41.753775 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1a4872-b2d6-4032-9f7f-81d4359eb87f None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:50:41.830632 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1a4872-b2d6-4032-9f7f-81d4359eb87f None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:50:41.836783 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ad1a23-d74c-4ad6-b0eb-93041df3837e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:50:41.837667 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ad1a23-d74c-4ad6-b0eb-93041df3837e admin admin] REQUEST_METHOD: `DELETE` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:50:41.837986 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ad1a23-d74c-4ad6-b0eb-93041df3837e admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:50:41.838266 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ad1a23-d74c-4ad6-b0eb-93041df3837e admin admin] PATH_INFO: `/v3/users/3974fdfd8c9a4e19886306b11a89473d` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:50:41.839552 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ad1a23-d74c-4ad6-b0eb-93041df3837e admin admin] RBAC: Authorizing `identity:delete_user(user_id=3974fdfd8c9a4e19886306b11a89473d)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:50:41.841453 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ad1a23-d74c-4ad6-b0eb-93041df3837e admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:50:41.897195 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-32ad1a23-d74c-4ad6-b0eb-93041df3837e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3974fdfd8c9a4e19886306b11a89473d'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:50:41.910316 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-32ad1a23-d74c-4ad6-b0eb-93041df3837e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3974fdfd8c9a4e19886306b11a89473d'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:50:41.916827 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-32ad1a23-d74c-4ad6-b0eb-93041df3837e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3974fdfd8c9a4e19886306b11a89473d'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:50:41.923842 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-32ad1a23-d74c-4ad6-b0eb-93041df3837e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3974fdfd8c9a4e19886306b11a89473d'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:50:41.924527 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-32ad1a23-d74c-4ad6-b0eb-93041df3837e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3974fdfd8c9a4e19886306b11a89473d'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:50:41.930440 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1031/2052] 10.222.0.58 () {58 vars in 1223 bytes} [Tue Oct 12 16:50:41 2021] DELETE /identity/v3/users/3974fdfd8c9a4e19886306b11a89473d => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:50:41.934824 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37190b89-58dd-4280-b7a9-1a36e103cc03 None None] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:50:41.935341 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37190b89-58dd-4280-b7a9-1a36e103cc03 None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:50:41.935877 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37190b89-58dd-4280-b7a9-1a36e103cc03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:50:41.953580 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.auth.core [None req-37190b89-58dd-4280-b7a9-1a36e103cc03 None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:50:41.954816 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-37190b89-58dd-4280-b7a9-1a36e103cc03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:50:42.047204 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1022/2053] 10.222.0.58 () {58 vars in 957 bytes} [Tue Oct 12 16:50:41 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:50:42.066031 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ad1a23-d74c-4ad6-b0eb-93041df3837e admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:50:42.068368 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-32ad1a23-d74c-4ad6-b0eb-93041df3837e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:50:42.144275 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ad1a23-d74c-4ad6-b0eb-93041df3837e admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:50:42.148131 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4adf790-ed12-4080-aa59-b79a6b434997 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e65f6d0598e4c539134292b86fb43d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:50:42.149340 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4adf790-ed12-4080-aa59-b79a6b434997 service neutron] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:50:42.149789 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4adf790-ed12-4080-aa59-b79a6b434997 service neutron] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:50:42.150117 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4adf790-ed12-4080-aa59-b79a6b434997 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:50:42.162800 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4adf790-ed12-4080-aa59-b79a6b434997 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:50:42.164868 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4adf790-ed12-4080-aa59-b79a6b434997 service neutron] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:50:42.177615 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1032/2054] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Oct 12 16:50:42 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:50:42.615291 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37190b89-58dd-4280-b7a9-1a36e103cc03 None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:50:42.616925 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-37190b89-58dd-4280-b7a9-1a36e103cc03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:50:42.646576 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37190b89-58dd-4280-b7a9-1a36e103cc03 None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:50:42.652248 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76eda4a-fe6a-46f6-a3d0-5fde0b75cd06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:50:42.653111 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76eda4a-fe6a-46f6-a3d0-5fde0b75cd06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:50:42.653446 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76eda4a-fe6a-46f6-a3d0-5fde0b75cd06 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:50:42.653721 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76eda4a-fe6a-46f6-a3d0-5fde0b75cd06 admin admin] PATH_INFO: `/v3/projects/096961e0e47e4ae397fa47db915775f0` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:50:42.655807 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76eda4a-fe6a-46f6-a3d0-5fde0b75cd06 admin admin] RBAC: Authorizing `identity:delete_project(project_id=096961e0e47e4ae397fa47db915775f0)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:50:42.658346 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76eda4a-fe6a-46f6-a3d0-5fde0b75cd06 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:50:42.705901 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-e76eda4a-fe6a-46f6-a3d0-5fde0b75cd06 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '096961e0e47e4ae397fa47db915775f0', 'request_id': 'req-e76eda4a-fe6a-46f6-a3d0-5fde0b75cd06'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:50:42.712169 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-e76eda4a-fe6a-46f6-a3d0-5fde0b75cd06 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '096961e0e47e4ae397fa47db915775f0', 'request_id': 'req-e76eda4a-fe6a-46f6-a3d0-5fde0b75cd06'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:50:42.718623 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-e76eda4a-fe6a-46f6-a3d0-5fde0b75cd06 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '096961e0e47e4ae397fa47db915775f0', 'request_id': 'req-e76eda4a-fe6a-46f6-a3d0-5fde0b75cd06'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:50:42.730731 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-e76eda4a-fe6a-46f6-a3d0-5fde0b75cd06 admin admin] The token cache is being invalidate because project 096961e0e47e4ae397fa47db915775f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=85205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 16:50:42.731018 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-e76eda4a-fe6a-46f6-a3d0-5fde0b75cd06 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:50:42.731637 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-e76eda4a-fe6a-46f6-a3d0-5fde0b75cd06 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:50:42.733181 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1023/2055] 10.222.0.58 () {58 vars in 1232 bytes} [Tue Oct 12 16:50:42 2021] DELETE /identity/v3/projects/096961e0e47e4ae397fa47db915775f0 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:50:42.739261 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b527a0-ced0-4a80-b5a7-405cd72bdf5c None None] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:50:42.739553 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b527a0-ced0-4a80-b5a7-405cd72bdf5c None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:50:42.739855 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b527a0-ced0-4a80-b5a7-405cd72bdf5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:50:42.757781 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.auth.core [None req-30b527a0-ced0-4a80-b5a7-405cd72bdf5c None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:50:42.759565 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-30b527a0-ced0-4a80-b5a7-405cd72bdf5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:50:42.827210 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1033/2056] 10.222.0.58 () {58 vars in 957 bytes} [Tue Oct 12 16:50:42 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:50:42.835753 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693703df-8737-42e7-9b20-73ea98fe8aed None None] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:50:42.836131 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693703df-8737-42e7-9b20-73ea98fe8aed None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:50:42.837024 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693703df-8737-42e7-9b20-73ea98fe8aed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:50:42.859844 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.auth.core [None req-693703df-8737-42e7-9b20-73ea98fe8aed None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:50:42.861053 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-693703df-8737-42e7-9b20-73ea98fe8aed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:50:42.869351 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1024/2057] 10.222.0.58 () {58 vars in 957 bytes} [Tue Oct 12 16:50:42 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:50:42.873800 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b527a0-ced0-4a80-b5a7-405cd72bdf5c None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:50:42.884799 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b527a0-ced0-4a80-b5a7-405cd72bdf5c None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:50:42.892561 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b46613-4e54-43d5-9062-3d5177bf548e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:50:42.893307 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b46613-4e54-43d5-9062-3d5177bf548e admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:50:42.893756 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b46613-4e54-43d5-9062-3d5177bf548e admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:50:42.894072 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b46613-4e54-43d5-9062-3d5177bf548e admin admin] PATH_INFO: `/v3/domains` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:50:42.894816 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b46613-4e54-43d5-9062-3d5177bf548e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:50:42.895132 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b46613-4e54-43d5-9062-3d5177bf548e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:50:42.896779 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b46613-4e54-43d5-9062-3d5177bf548e admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:50:42.909354 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1034/2058] 10.222.0.58 () {58 vars in 1152 bytes} [Tue Oct 12 16:50:42 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:50:42.913592 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693703df-8737-42e7-9b20-73ea98fe8aed None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:50:42.922939 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693703df-8737-42e7-9b20-73ea98fe8aed None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:50:42.933172 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac381199-e74a-4922-9d24-c15becee7fe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:50:42.933822 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac381199-e74a-4922-9d24-c15becee7fe3 admin admin] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:50:42.934135 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac381199-e74a-4922-9d24-c15becee7fe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:50:42.934413 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac381199-e74a-4922-9d24-c15becee7fe3 admin admin] PATH_INFO: `/v3/projects` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:50:42.935132 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac381199-e74a-4922-9d24-c15becee7fe3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:50:42.937325 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac381199-e74a-4922-9d24-c15becee7fe3 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:50:42.964903 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1025/2059] 10.222.0.58 () {60 vars in 1152 bytes} [Tue Oct 12 16:50:42 2021] POST /identity/v3/projects => generated 377 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 16:50:42.969073 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b46613-4e54-43d5-9062-3d5177bf548e admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:50:42.978885 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b46613-4e54-43d5-9062-3d5177bf548e admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:50:43.036049 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db15e2e-93a9-400a-8da8-593ee5945bb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:50:43.036750 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db15e2e-93a9-400a-8da8-593ee5945bb9 admin admin] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:50:43.037037 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db15e2e-93a9-400a-8da8-593ee5945bb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:50:43.037319 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db15e2e-93a9-400a-8da8-593ee5945bb9 admin admin] PATH_INFO: `/v3/users` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:50:43.038063 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db15e2e-93a9-400a-8da8-593ee5945bb9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:50:43.039986 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db15e2e-93a9-400a-8da8-593ee5945bb9 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:50:43.058963 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1035/2060] 10.222.0.58 () {60 vars in 1143 bytes} [Tue Oct 12 16:50:42 2021] POST /identity/v3/users => generated 289 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:50:43.067099 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac381199-e74a-4922-9d24-c15becee7fe3 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:50:43.075143 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac381199-e74a-4922-9d24-c15becee7fe3 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:50:43.080201 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211147f0-c5ca-4042-b956-bbfb329cb200 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:50:43.081120 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211147f0-c5ca-4042-b956-bbfb329cb200 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:50:43.081606 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211147f0-c5ca-4042-b956-bbfb329cb200 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:50:43.082174 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211147f0-c5ca-4042-b956-bbfb329cb200 admin admin] PATH_INFO: `/v3/roles` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:50:43.082918 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211147f0-c5ca-4042-b956-bbfb329cb200 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:50:43.085192 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211147f0-c5ca-4042-b956-bbfb329cb200 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:50:43.096562 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1026/2061] 10.222.0.58 () {58 vars in 1121 bytes} [Tue Oct 12 16:50:43 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 16:50:43.100395 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db15e2e-93a9-400a-8da8-593ee5945bb9 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:50:43.110234 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db15e2e-93a9-400a-8da8-593ee5945bb9 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:50:43.114755 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84997ed5-c53f-4334-af43-09d7e3dbf694 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:50:43.115402 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84997ed5-c53f-4334-af43-09d7e3dbf694 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:50:43.115684 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84997ed5-c53f-4334-af43-09d7e3dbf694 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:50:43.116234 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84997ed5-c53f-4334-af43-09d7e3dbf694 admin admin] PATH_INFO: `/v3/roles` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:50:43.116966 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84997ed5-c53f-4334-af43-09d7e3dbf694 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:50:43.118667 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84997ed5-c53f-4334-af43-09d7e3dbf694 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:50:43.128564 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1036/2062] 10.222.0.58 () {58 vars in 1121 bytes} [Tue Oct 12 16:50:43 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:50:43.133371 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211147f0-c5ca-4042-b956-bbfb329cb200 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:50:43.143248 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211147f0-c5ca-4042-b956-bbfb329cb200 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:50:43.148128 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7243504f-ce42-4967-b8a9-fe440c7f9a11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:50:43.149601 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7243504f-ce42-4967-b8a9-fe440c7f9a11 admin admin] REQUEST_METHOD: `PUT` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:50:43.149933 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7243504f-ce42-4967-b8a9-fe440c7f9a11 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:50:43.150208 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7243504f-ce42-4967-b8a9-fe440c7f9a11 admin admin] PATH_INFO: `/v3/projects/fa94f0777efa4b4ab427769cdbbb82f6/users/9920dccb47544863ae7e8c0162c77c35/roles/55ba49fe29884e64b57c3ad13188d554` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:50:43.164203 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7243504f-ce42-4967-b8a9-fe440c7f9a11 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa94f0777efa4b4ab427769cdbbb82f6, user_id=9920dccb47544863ae7e8c0162c77c35, role_id=55ba49fe29884e64b57c3ad13188d554)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:50:43.166930 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7243504f-ce42-4967-b8a9-fe440c7f9a11 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:50:43.182841 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1027/2063] 10.222.0.58 () {60 vars in 1482 bytes} [Tue Oct 12 16:50:43 2021] PUT /identity/v3/projects/fa94f0777efa4b4ab427769cdbbb82f6/users/9920dccb47544863ae7e8c0162c77c35/roles/55ba49fe29884e64b57c3ad13188d554 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:50:43.187863 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c864bf4-6380-4bac-aa81-7e907c002e3f None None] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:50:43.188210 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c864bf4-6380-4bac-aa81-7e907c002e3f None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:50:43.188501 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c864bf4-6380-4bac-aa81-7e907c002e3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:50:43.208885 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.auth.core [None req-7c864bf4-6380-4bac-aa81-7e907c002e3f None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:50:43.210123 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-7c864bf4-6380-4bac-aa81-7e907c002e3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:50:43.269070 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1037/2064] 10.222.0.58 () {58 vars in 957 bytes} [Tue Oct 12 16:50:43 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:50:43.290904 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7243504f-ce42-4967-b8a9-fe440c7f9a11 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:50:43.292683 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-7243504f-ce42-4967-b8a9-fe440c7f9a11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:50:43.359658 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7243504f-ce42-4967-b8a9-fe440c7f9a11 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:50:43.363525 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa7a30d-1296-428b-ab71-827d209f1177 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e65f6d0598e4c539134292b86fb43d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:50:43.364162 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa7a30d-1296-428b-ab71-827d209f1177 service neutron] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:50:43.364453 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa7a30d-1296-428b-ab71-827d209f1177 service neutron] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:50:43.364729 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa7a30d-1296-428b-ab71-827d209f1177 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:50:43.374340 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa7a30d-1296-428b-ab71-827d209f1177 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:50:43.375744 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa7a30d-1296-428b-ab71-827d209f1177 service neutron] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:50:43.385404 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1028/2065] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Oct 12 16:50:43 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:50:47.667970 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea58c08e-2fbb-4dff-b3f9-1398d6a67d90 None None] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:50:47.668617 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea58c08e-2fbb-4dff-b3f9-1398d6a67d90 None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:50:47.668617 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea58c08e-2fbb-4dff-b3f9-1398d6a67d90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:50:47.724943 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.auth.core [None req-ea58c08e-2fbb-4dff-b3f9-1398d6a67d90 None None] MFA Rules not processed for user `a4b2efcb30314209a8c0366c9168836e`. Rule list: `[]` (Enabled: `True`). {{(pid=85204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:50:47.726222 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-ea58c08e-2fbb-4dff-b3f9-1398d6a67d90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:50:47.863271 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1038/2066] 10.222.0.58 () {58 vars in 957 bytes} [Tue Oct 12 16:50:47 2021] POST /identity/v3/auth/tokens => generated 3391 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:50:48.040026 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32563b76-b376-41a5-ba29-e722b5cb88db None None] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:50:48.040554 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32563b76-b376-41a5-ba29-e722b5cb88db None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:50:48.040645 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32563b76-b376-41a5-ba29-e722b5cb88db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:50:48.076022 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.auth.core [None req-32563b76-b376-41a5-ba29-e722b5cb88db None None] MFA Rules not processed for user `9920dccb47544863ae7e8c0162c77c35`. Rule list: `[]` (Enabled: `True`). {{(pid=85205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:50:48.077282 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-32563b76-b376-41a5-ba29-e722b5cb88db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:50:48.158459 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1029/2067] 10.222.0.58 () {58 vars in 957 bytes} [Tue Oct 12 16:50:48 2021] POST /identity/v3/auth/tokens => generated 3397 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:50:48.163717 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea58c08e-2fbb-4dff-b3f9-1398d6a67d90 None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:50:48.176184 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea58c08e-2fbb-4dff-b3f9-1398d6a67d90 None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:50:48.180798 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad8e64c-b095-4dd3-8aed-de9bfe06c899 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:50:48.181618 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad8e64c-b095-4dd3-8aed-de9bfe06c899 admin admin] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:50:48.182096 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad8e64c-b095-4dd3-8aed-de9bfe06c899 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:50:48.182391 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad8e64c-b095-4dd3-8aed-de9bfe06c899 admin admin] PATH_INFO: `/v3/projects` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:50:48.183122 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad8e64c-b095-4dd3-8aed-de9bfe06c899 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:50:48.185178 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad8e64c-b095-4dd3-8aed-de9bfe06c899 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:50:48.216906 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1039/2068] 10.222.0.58 () {60 vars in 1152 bytes} [Tue Oct 12 16:50:48 2021] POST /identity/v3/projects => generated 379 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:50:48.218105 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32563b76-b376-41a5-ba29-e722b5cb88db None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:50:48.229452 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32563b76-b376-41a5-ba29-e722b5cb88db None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:50:48.309967 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c800f2-0ba4-4fc6-8495-dc4b748495ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:50:48.309967 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c800f2-0ba4-4fc6-8495-dc4b748495ef admin admin] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:50:48.309967 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c800f2-0ba4-4fc6-8495-dc4b748495ef admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:50:48.309967 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c800f2-0ba4-4fc6-8495-dc4b748495ef admin admin] PATH_INFO: `/v3/users` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:50:48.310362 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c800f2-0ba4-4fc6-8495-dc4b748495ef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:50:48.310362 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c800f2-0ba4-4fc6-8495-dc4b748495ef admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:50:48.337928 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1030/2069] 10.222.0.58 () {60 vars in 1143 bytes} [Tue Oct 12 16:50:48 2021] POST /identity/v3/users => generated 296 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:50:48.340722 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad8e64c-b095-4dd3-8aed-de9bfe06c899 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:50:48.355646 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad8e64c-b095-4dd3-8aed-de9bfe06c899 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:50:48.361728 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706c3d94-2e8a-47de-9ae6-a9bc416e0eba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:50:48.362440 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706c3d94-2e8a-47de-9ae6-a9bc416e0eba admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:50:48.362730 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706c3d94-2e8a-47de-9ae6-a9bc416e0eba admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:50:48.363013 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706c3d94-2e8a-47de-9ae6-a9bc416e0eba admin admin] PATH_INFO: `/v3/roles` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:50:48.363774 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706c3d94-2e8a-47de-9ae6-a9bc416e0eba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:50:48.365408 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706c3d94-2e8a-47de-9ae6-a9bc416e0eba admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:50:48.378538 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1040/2070] 10.222.0.58 () {58 vars in 1121 bytes} [Tue Oct 12 16:50:48 2021] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:50:48.382292 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c800f2-0ba4-4fc6-8495-dc4b748495ef admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:50:48.399947 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c800f2-0ba4-4fc6-8495-dc4b748495ef admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:50:48.406188 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0f6e7a-d060-4434-a0ae-abaeebe44fdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:50:48.407168 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0f6e7a-d060-4434-a0ae-abaeebe44fdb admin admin] REQUEST_METHOD: `PUT` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:50:48.408251 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0f6e7a-d060-4434-a0ae-abaeebe44fdb admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:50:48.408251 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0f6e7a-d060-4434-a0ae-abaeebe44fdb admin admin] PATH_INFO: `/v3/projects/54b5aeef626c4860b1bef7af31feddee/users/872958f683df4a478d07aadc8ea3405b/roles/610824e4f50f4fb8954610e98c1de784` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:50:48.425222 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0f6e7a-d060-4434-a0ae-abaeebe44fdb admin admin] RBAC: Authorizing `identity:create_grant(project_id=54b5aeef626c4860b1bef7af31feddee, user_id=872958f683df4a478d07aadc8ea3405b, role_id=610824e4f50f4fb8954610e98c1de784)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:50:48.429455 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0f6e7a-d060-4434-a0ae-abaeebe44fdb admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:50:48.477917 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1031/2071] 10.222.0.58 () {60 vars in 1482 bytes} [Tue Oct 12 16:50:48 2021] PUT /identity/v3/projects/54b5aeef626c4860b1bef7af31feddee/users/872958f683df4a478d07aadc8ea3405b/roles/610824e4f50f4fb8954610e98c1de784 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 16:50:48.480358 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706c3d94-2e8a-47de-9ae6-a9bc416e0eba admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:50:48.491954 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706c3d94-2e8a-47de-9ae6-a9bc416e0eba admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:50:48.568474 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cef9ab4-00d8-44d7-8764-583c1372a398 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:50:48.569203 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cef9ab4-00d8-44d7-8764-583c1372a398 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:50:48.569448 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cef9ab4-00d8-44d7-8764-583c1372a398 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:50:48.569808 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cef9ab4-00d8-44d7-8764-583c1372a398 admin admin] PATH_INFO: `/v3/roles` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:50:48.571045 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cef9ab4-00d8-44d7-8764-583c1372a398 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:50:48.574107 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cef9ab4-00d8-44d7-8764-583c1372a398 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:50:48.589314 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1041/2072] 10.222.0.58 () {58 vars in 1121 bytes} [Tue Oct 12 16:50:48 2021] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:50:48.591187 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0f6e7a-d060-4434-a0ae-abaeebe44fdb admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:50:48.605710 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0f6e7a-d060-4434-a0ae-abaeebe44fdb admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:50:48.637309 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05057c64-7d0c-4385-ae94-b5ed5a99b5a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:50:48.638584 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05057c64-7d0c-4385-ae94-b5ed5a99b5a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:50:48.639128 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05057c64-7d0c-4385-ae94-b5ed5a99b5a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:50:48.639873 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05057c64-7d0c-4385-ae94-b5ed5a99b5a6 admin admin] PATH_INFO: `/v3/projects/54b5aeef626c4860b1bef7af31feddee/users/872958f683df4a478d07aadc8ea3405b/roles/610824e4f50f4fb8954610e98c1de784` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:50:48.656242 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05057c64-7d0c-4385-ae94-b5ed5a99b5a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=54b5aeef626c4860b1bef7af31feddee, user_id=872958f683df4a478d07aadc8ea3405b, role_id=610824e4f50f4fb8954610e98c1de784)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:50:48.666162 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05057c64-7d0c-4385-ae94-b5ed5a99b5a6 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:50:48.697342 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1032/2073] 10.222.0.58 () {60 vars in 1482 bytes} [Tue Oct 12 16:50:48 2021] PUT /identity/v3/projects/54b5aeef626c4860b1bef7af31feddee/users/872958f683df4a478d07aadc8ea3405b/roles/610824e4f50f4fb8954610e98c1de784 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:50:55.120649 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1d028a-8ba9-4c98-b776-b3e6f6d1dec7 None None] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:50:55.121581 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1d028a-8ba9-4c98-b776-b3e6f6d1dec7 None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:50:55.122112 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1d028a-8ba9-4c98-b776-b3e6f6d1dec7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:50:55.154522 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.auth.core [None req-ba1d028a-8ba9-4c98-b776-b3e6f6d1dec7 None None] MFA Rules not processed for user `872958f683df4a478d07aadc8ea3405b`. Rule list: `[]` (Enabled: `True`). {{(pid=85204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:50:55.155813 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-ba1d028a-8ba9-4c98-b776-b3e6f6d1dec7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:50:55.237707 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1042/2074] 10.222.0.58 () {58 vars in 957 bytes} [Tue Oct 12 16:50:55 2021] POST /identity/v3/auth/tokens => generated 3466 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:50:55.253018 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05057c64-7d0c-4385-ae94-b5ed5a99b5a6 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:50:55.254836 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-05057c64-7d0c-4385-ae94-b5ed5a99b5a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:50:55.345117 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05057c64-7d0c-4385-ae94-b5ed5a99b5a6 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:50:55.357157 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54230a1d-2300-4ea2-a92c-549fefd0b842 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29d30b574eec4ad3990d77d235c8b424', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:50:55.359111 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54230a1d-2300-4ea2-a92c-549fefd0b842 service nova] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:50:55.359407 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54230a1d-2300-4ea2-a92c-549fefd0b842 service nova] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:50:55.359696 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54230a1d-2300-4ea2-a92c-549fefd0b842 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:50:55.432042 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54230a1d-2300-4ea2-a92c-549fefd0b842 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:50:55.433647 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54230a1d-2300-4ea2-a92c-549fefd0b842 service nova] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:50:55.445994 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1033/2075] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Oct 12 16:50:55 2021] GET /identity/v3/auth/tokens => generated 3397 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:51:04.235075 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1d028a-8ba9-4c98-b776-b3e6f6d1dec7 None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:51:04.236658 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-ba1d028a-8ba9-4c98-b776-b3e6f6d1dec7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:51:04.300168 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1d028a-8ba9-4c98-b776-b3e6f6d1dec7 None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:51:04.305162 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae3c39d-97f4-4761-adc2-a793a8ab9eba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:51:04.306058 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae3c39d-97f4-4761-adc2-a793a8ab9eba admin admin] REQUEST_METHOD: `DELETE` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:51:04.306341 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae3c39d-97f4-4761-adc2-a793a8ab9eba admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:51:04.306615 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae3c39d-97f4-4761-adc2-a793a8ab9eba admin admin] PATH_INFO: `/v3/users/65b1911087cf4620b324ed0a1dee3b7a` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:51:04.307810 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae3c39d-97f4-4761-adc2-a793a8ab9eba admin admin] RBAC: Authorizing `identity:delete_user(user_id=65b1911087cf4620b324ed0a1dee3b7a)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:51:04.309713 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae3c39d-97f4-4761-adc2-a793a8ab9eba admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:51:04.354222 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-dae3c39d-97f4-4761-adc2-a793a8ab9eba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '65b1911087cf4620b324ed0a1dee3b7a'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:51:04.372272 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-dae3c39d-97f4-4761-adc2-a793a8ab9eba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '65b1911087cf4620b324ed0a1dee3b7a'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:51:04.379045 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-dae3c39d-97f4-4761-adc2-a793a8ab9eba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '65b1911087cf4620b324ed0a1dee3b7a'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:51:04.387102 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-dae3c39d-97f4-4761-adc2-a793a8ab9eba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '65b1911087cf4620b324ed0a1dee3b7a'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:51:04.387747 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-dae3c39d-97f4-4761-adc2-a793a8ab9eba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '65b1911087cf4620b324ed0a1dee3b7a'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:51:04.393730 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1043/2076] 10.222.0.58 () {58 vars in 1223 bytes} [Tue Oct 12 16:51:04 2021] DELETE /identity/v3/users/65b1911087cf4620b324ed0a1dee3b7a => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:51:04.398407 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02599bc-0654-4347-89d2-937f8c7b6bde None None] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:51:04.398948 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02599bc-0654-4347-89d2-937f8c7b6bde None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:51:04.399343 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02599bc-0654-4347-89d2-937f8c7b6bde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:51:04.416440 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.auth.core [None req-b02599bc-0654-4347-89d2-937f8c7b6bde None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:51:04.417794 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-b02599bc-0654-4347-89d2-937f8c7b6bde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:51:04.481444 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1034/2077] 10.222.0.58 () {58 vars in 957 bytes} [Tue Oct 12 16:51:04 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:51:04.492067 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae3c39d-97f4-4761-adc2-a793a8ab9eba admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:51:04.494166 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-dae3c39d-97f4-4761-adc2-a793a8ab9eba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:51:04.549472 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae3c39d-97f4-4761-adc2-a793a8ab9eba admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:51:04.553108 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e622301-4f36-45cf-8864-fe587509e0af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e65f6d0598e4c539134292b86fb43d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:51:04.553759 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e622301-4f36-45cf-8864-fe587509e0af service neutron] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:51:04.554073 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e622301-4f36-45cf-8864-fe587509e0af service neutron] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:51:04.554352 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e622301-4f36-45cf-8864-fe587509e0af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:51:04.563878 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e622301-4f36-45cf-8864-fe587509e0af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:51:04.565486 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e622301-4f36-45cf-8864-fe587509e0af service neutron] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:51:04.576112 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1044/2078] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Oct 12 16:51:04 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:51:04.886739 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02599bc-0654-4347-89d2-937f8c7b6bde None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:51:04.888262 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-b02599bc-0654-4347-89d2-937f8c7b6bde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:51:04.900370 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02599bc-0654-4347-89d2-937f8c7b6bde None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:51:04.906286 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b8c22d-eaab-4074-89b2-b5eb22d1bde9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:51:04.907640 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b8c22d-eaab-4074-89b2-b5eb22d1bde9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:51:04.907964 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b8c22d-eaab-4074-89b2-b5eb22d1bde9 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:51:04.908305 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b8c22d-eaab-4074-89b2-b5eb22d1bde9 admin admin] PATH_INFO: `/v3/projects/418468803a4b41cb91536776b6f61021` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:51:04.910047 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b8c22d-eaab-4074-89b2-b5eb22d1bde9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=418468803a4b41cb91536776b6f61021)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:51:04.912077 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b8c22d-eaab-4074-89b2-b5eb22d1bde9 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:51:04.964630 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-79b8c22d-eaab-4074-89b2-b5eb22d1bde9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '418468803a4b41cb91536776b6f61021', 'request_id': 'req-79b8c22d-eaab-4074-89b2-b5eb22d1bde9'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:51:04.969725 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-79b8c22d-eaab-4074-89b2-b5eb22d1bde9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '418468803a4b41cb91536776b6f61021', 'request_id': 'req-79b8c22d-eaab-4074-89b2-b5eb22d1bde9'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:51:04.975549 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-79b8c22d-eaab-4074-89b2-b5eb22d1bde9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '418468803a4b41cb91536776b6f61021', 'request_id': 'req-79b8c22d-eaab-4074-89b2-b5eb22d1bde9'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:51:04.987531 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-79b8c22d-eaab-4074-89b2-b5eb22d1bde9 admin admin] The token cache is being invalidate because project 418468803a4b41cb91536776b6f61021 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=85205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 16:51:04.987819 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-79b8c22d-eaab-4074-89b2-b5eb22d1bde9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:51:04.988453 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-79b8c22d-eaab-4074-89b2-b5eb22d1bde9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:51:04.989971 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1035/2079] 10.222.0.58 () {58 vars in 1232 bytes} [Tue Oct 12 16:51:04 2021] DELETE /identity/v3/projects/418468803a4b41cb91536776b6f61021 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:51:04.996590 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aede4844-9f72-4521-830a-bedbef5df78f None None] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:51:04.996885 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aede4844-9f72-4521-830a-bedbef5df78f None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:51:04.997167 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aede4844-9f72-4521-830a-bedbef5df78f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:51:05.014188 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.auth.core [None req-aede4844-9f72-4521-830a-bedbef5df78f None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:51:05.015387 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-aede4844-9f72-4521-830a-bedbef5df78f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:51:05.070844 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1045/2080] 10.222.0.58 () {58 vars in 957 bytes} [Tue Oct 12 16:51:04 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:51:05.078580 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4af294-aab5-4c6a-ad93-2a638ee0647c None None] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:51:05.078869 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4af294-aab5-4c6a-ad93-2a638ee0647c None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:51:05.079142 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4af294-aab5-4c6a-ad93-2a638ee0647c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:51:05.097246 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.auth.core [None req-5c4af294-aab5-4c6a-ad93-2a638ee0647c None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:51:05.098467 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-5c4af294-aab5-4c6a-ad93-2a638ee0647c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:51:05.106811 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1036/2081] 10.222.0.58 () {58 vars in 957 bytes} [Tue Oct 12 16:51:05 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:51:05.110777 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aede4844-9f72-4521-830a-bedbef5df78f None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:51:05.120407 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aede4844-9f72-4521-830a-bedbef5df78f None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:51:05.124867 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03973351-9749-49f7-99f3-8e10b3188873 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:51:05.125505 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03973351-9749-49f7-99f3-8e10b3188873 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:51:05.125786 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03973351-9749-49f7-99f3-8e10b3188873 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:51:05.126093 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03973351-9749-49f7-99f3-8e10b3188873 admin admin] PATH_INFO: `/v3/domains` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:51:05.126830 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03973351-9749-49f7-99f3-8e10b3188873 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:51:05.127139 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03973351-9749-49f7-99f3-8e10b3188873 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:51:05.128712 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03973351-9749-49f7-99f3-8e10b3188873 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:51:05.143181 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1046/2082] 10.222.0.58 () {58 vars in 1152 bytes} [Tue Oct 12 16:51:05 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:51:05.144293 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4af294-aab5-4c6a-ad93-2a638ee0647c None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:51:05.153896 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4af294-aab5-4c6a-ad93-2a638ee0647c None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:51:05.159018 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b04126-e122-4cdf-9f09-74c4a8d13d0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:51:05.159621 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b04126-e122-4cdf-9f09-74c4a8d13d0f admin admin] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:51:05.159900 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b04126-e122-4cdf-9f09-74c4a8d13d0f admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:51:05.160170 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b04126-e122-4cdf-9f09-74c4a8d13d0f admin admin] PATH_INFO: `/v3/projects` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:51:05.160861 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b04126-e122-4cdf-9f09-74c4a8d13d0f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:51:05.162750 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b04126-e122-4cdf-9f09-74c4a8d13d0f admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:51:05.187465 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1037/2083] 10.222.0.58 () {60 vars in 1152 bytes} [Tue Oct 12 16:51:05 2021] POST /identity/v3/projects => generated 369 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 16:51:05.191472 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03973351-9749-49f7-99f3-8e10b3188873 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:51:05.201207 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03973351-9749-49f7-99f3-8e10b3188873 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:51:05.256909 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cda12e-575f-4665-888e-a7584db0dcf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:51:05.257581 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cda12e-575f-4665-888e-a7584db0dcf4 admin admin] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:51:05.258037 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cda12e-575f-4665-888e-a7584db0dcf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:51:05.258315 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cda12e-575f-4665-888e-a7584db0dcf4 admin admin] PATH_INFO: `/v3/users` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:51:05.259139 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cda12e-575f-4665-888e-a7584db0dcf4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:51:05.261024 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cda12e-575f-4665-888e-a7584db0dcf4 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:51:05.280789 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1047/2084] 10.222.0.58 () {60 vars in 1143 bytes} [Tue Oct 12 16:51:05 2021] POST /identity/v3/users => generated 285 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:51:05.285438 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b04126-e122-4cdf-9f09-74c4a8d13d0f admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:51:05.296790 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b04126-e122-4cdf-9f09-74c4a8d13d0f admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:51:05.301608 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df717e53-64e1-425a-921d-de7195ede013 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:51:05.302385 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df717e53-64e1-425a-921d-de7195ede013 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:51:05.302733 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df717e53-64e1-425a-921d-de7195ede013 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:51:05.303098 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df717e53-64e1-425a-921d-de7195ede013 admin admin] PATH_INFO: `/v3/roles` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:51:05.303968 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df717e53-64e1-425a-921d-de7195ede013 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:51:05.305625 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df717e53-64e1-425a-921d-de7195ede013 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:51:05.317027 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1038/2085] 10.222.0.58 () {58 vars in 1121 bytes} [Tue Oct 12 16:51:05 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:51:05.321321 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cda12e-575f-4665-888e-a7584db0dcf4 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:51:05.331839 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cda12e-575f-4665-888e-a7584db0dcf4 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:51:05.337318 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c6ede5-67bc-41b5-9e41-1eb50bc18567 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:51:05.338074 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c6ede5-67bc-41b5-9e41-1eb50bc18567 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:51:05.338366 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c6ede5-67bc-41b5-9e41-1eb50bc18567 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:51:05.338647 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c6ede5-67bc-41b5-9e41-1eb50bc18567 admin admin] PATH_INFO: `/v3/roles` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:51:05.339418 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c6ede5-67bc-41b5-9e41-1eb50bc18567 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:51:05.341051 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c6ede5-67bc-41b5-9e41-1eb50bc18567 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:51:05.355650 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1048/2086] 10.222.0.58 () {58 vars in 1121 bytes} [Tue Oct 12 16:51:05 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 16:51:05.356905 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df717e53-64e1-425a-921d-de7195ede013 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:51:05.367616 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df717e53-64e1-425a-921d-de7195ede013 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:51:05.372451 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367cae9d-4ad3-4acb-acd9-44330cc9f1a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:51:05.373299 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367cae9d-4ad3-4acb-acd9-44330cc9f1a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:51:05.373582 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367cae9d-4ad3-4acb-acd9-44330cc9f1a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:51:05.373854 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367cae9d-4ad3-4acb-acd9-44330cc9f1a7 admin admin] PATH_INFO: `/v3/projects/707abf6752314320bb947dd67452b3a7/users/8ff954bb4ec44c60b7f1133ae6e616ba/roles/55ba49fe29884e64b57c3ad13188d554` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:51:05.390578 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367cae9d-4ad3-4acb-acd9-44330cc9f1a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=707abf6752314320bb947dd67452b3a7, user_id=8ff954bb4ec44c60b7f1133ae6e616ba, role_id=55ba49fe29884e64b57c3ad13188d554)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:51:05.393522 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367cae9d-4ad3-4acb-acd9-44330cc9f1a7 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:51:05.416035 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1039/2087] 10.222.0.58 () {60 vars in 1482 bytes} [Tue Oct 12 16:51:05 2021] PUT /identity/v3/projects/707abf6752314320bb947dd67452b3a7/users/8ff954bb4ec44c60b7f1133ae6e616ba/roles/55ba49fe29884e64b57c3ad13188d554 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:51:05.427530 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fe8ee7-af87-4cd4-bedc-0a9ca7167235 None None] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:51:05.427961 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fe8ee7-af87-4cd4-bedc-0a9ca7167235 None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:51:05.428313 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fe8ee7-af87-4cd4-bedc-0a9ca7167235 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:51:05.456552 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.auth.core [None req-73fe8ee7-af87-4cd4-bedc-0a9ca7167235 None None] MFA Rules not processed for user `8ff954bb4ec44c60b7f1133ae6e616ba`. Rule list: `[]` (Enabled: `True`). {{(pid=85204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:51:05.457903 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-73fe8ee7-af87-4cd4-bedc-0a9ca7167235 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:51:05.520068 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1049/2088] 10.222.0.58 () {58 vars in 957 bytes} [Tue Oct 12 16:51:05 2021] POST /identity/v3/auth/tokens => generated 3389 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:51:05.532464 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367cae9d-4ad3-4acb-acd9-44330cc9f1a7 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:51:05.534404 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-367cae9d-4ad3-4acb-acd9-44330cc9f1a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:51:05.591378 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367cae9d-4ad3-4acb-acd9-44330cc9f1a7 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:51:05.595091 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e892ca87-20e2-4f33-9db4-59f122dcf653 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ff84015069041f2bf33e3fd55b92e44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:51:05.595718 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e892ca87-20e2-4f33-9db4-59f122dcf653 service glance] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:51:05.596002 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e892ca87-20e2-4f33-9db4-59f122dcf653 service glance] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:51:05.596299 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e892ca87-20e2-4f33-9db4-59f122dcf653 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:51:05.604315 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e892ca87-20e2-4f33-9db4-59f122dcf653 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:51:05.605726 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e892ca87-20e2-4f33-9db4-59f122dcf653 service glance] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:51:05.614169 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1040/2089] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Oct 12 16:51:05 2021] GET /identity/v3/auth/tokens => generated 3389 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 12 16:51:08.390510 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698616f7-b2ee-4303-843a-65d303933773 None None] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:51:08.390950 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698616f7-b2ee-4303-843a-65d303933773 None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:51:08.391247 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698616f7-b2ee-4303-843a-65d303933773 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:51:08.409447 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.auth.core [None req-698616f7-b2ee-4303-843a-65d303933773 None None] MFA Rules not processed for user `fac2e7e3088b4863b65bd9310b878229`. Rule list: `[]` (Enabled: `True`). {{(pid=85204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:51:08.410730 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-698616f7-b2ee-4303-843a-65d303933773 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:51:08.466418 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1050/2090] 10.222.0.58 () {58 vars in 957 bytes} [Tue Oct 12 16:51:08 2021] POST /identity/v3/auth/tokens => generated 3403 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:51:36.240465 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26438dc4-c4d2-44be-94a7-35473cd35009 None None] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:51:36.240969 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26438dc4-c4d2-44be-94a7-35473cd35009 None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:51:36.241072 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26438dc4-c4d2-44be-94a7-35473cd35009 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:51:36.258435 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.auth.core [None req-26438dc4-c4d2-44be-94a7-35473cd35009 None None] MFA Rules not processed for user `387a65d2bfb142499c9b3b0ac946f48b`. Rule list: `[]` (Enabled: `True`). {{(pid=85205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:51:36.259623 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-26438dc4-c4d2-44be-94a7-35473cd35009 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:51:36.315158 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1041/2091] 10.222.0.58 () {58 vars in 1009 bytes} [Tue Oct 12 16:51:36 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:51:36.359780 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698616f7-b2ee-4303-843a-65d303933773 None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:51:36.361162 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-698616f7-b2ee-4303-843a-65d303933773 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:51:36.445284 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698616f7-b2ee-4303-843a-65d303933773 None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:51:36.451488 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8136e48d-72ee-4c21-9324-346a4444097f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdeb0a451344c9987b4134b957ffa22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:51:36.452261 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8136e48d-72ee-4c21-9324-346a4444097f service swift] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:51:36.452941 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8136e48d-72ee-4c21-9324-346a4444097f service swift] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:51:36.457918 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8136e48d-72ee-4c21-9324-346a4444097f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:51:36.462294 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8136e48d-72ee-4c21-9324-346a4444097f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:51:36.463888 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8136e48d-72ee-4c21-9324-346a4444097f service swift] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:51:36.472400 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1051/2092] 10.222.0.58 () {60 vars in 1384 bytes} [Tue Oct 12 16:51:36 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 12 16:51:44.902233 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e927f1f9-b358-44f2-ae69-165cf221d4ae None None] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:51:44.902815 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e927f1f9-b358-44f2-ae69-165cf221d4ae None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:51:44.902815 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e927f1f9-b358-44f2-ae69-165cf221d4ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:51:44.922512 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.auth.core [None req-e927f1f9-b358-44f2-ae69-165cf221d4ae None None] MFA Rules not processed for user `9920dccb47544863ae7e8c0162c77c35`. Rule list: `[]` (Enabled: `True`). {{(pid=85205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:51:44.923744 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-e927f1f9-b358-44f2-ae69-165cf221d4ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:51:44.978874 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1042/2093] 10.222.0.58 () {58 vars in 957 bytes} [Tue Oct 12 16:51:44 2021] POST /identity/v3/auth/tokens => generated 3397 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:52:05.914077 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785e72da-5639-40aa-8b3c-36d1c1048c8b None None] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:52:05.914630 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785e72da-5639-40aa-8b3c-36d1c1048c8b None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:52:05.914813 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785e72da-5639-40aa-8b3c-36d1c1048c8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:52:05.941762 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.auth.core [None req-785e72da-5639-40aa-8b3c-36d1c1048c8b None None] MFA Rules not processed for user `387a65d2bfb142499c9b3b0ac946f48b`. Rule list: `[]` (Enabled: `True`). {{(pid=85204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:52:05.943014 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-785e72da-5639-40aa-8b3c-36d1c1048c8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:52:05.970580 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1052/2094] 10.222.0.58 () {58 vars in 967 bytes} [Tue Oct 12 16:52:05 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:52:05.984841 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e927f1f9-b358-44f2-ae69-165cf221d4ae None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:52:06.019160 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e927f1f9-b358-44f2-ae69-165cf221d4ae None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:52:06.024287 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580b50c6-1dd2-49a1-952a-9a5bcb787f85 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdeb0a451344c9987b4134b957ffa22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:52:06.025196 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580b50c6-1dd2-49a1-952a-9a5bcb787f85 service swift] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:52:06.025478 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580b50c6-1dd2-49a1-952a-9a5bcb787f85 service swift] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:52:06.025750 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580b50c6-1dd2-49a1-952a-9a5bcb787f85 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:52:06.034405 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580b50c6-1dd2-49a1-952a-9a5bcb787f85 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:52:06.035976 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580b50c6-1dd2-49a1-952a-9a5bcb787f85 service swift] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:52:06.044230 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1043/2095] 10.222.0.58 () {60 vars in 1384 bytes} [Tue Oct 12 16:52:05 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 12 16:52:08.142784 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785e72da-5639-40aa-8b3c-36d1c1048c8b None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:52:08.144780 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-785e72da-5639-40aa-8b3c-36d1c1048c8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:52:08.239274 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785e72da-5639-40aa-8b3c-36d1c1048c8b None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:52:08.244252 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a6cbaa-cf8d-446f-b7df-2ff3940d9423 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:52:08.245229 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a6cbaa-cf8d-446f-b7df-2ff3940d9423 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:52:08.245509 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a6cbaa-cf8d-446f-b7df-2ff3940d9423 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:52:08.245782 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a6cbaa-cf8d-446f-b7df-2ff3940d9423 admin admin] PATH_INFO: `/v3/users/a4b2efcb30314209a8c0366c9168836e` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:52:08.247026 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a6cbaa-cf8d-446f-b7df-2ff3940d9423 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a4b2efcb30314209a8c0366c9168836e)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:52:08.248987 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a6cbaa-cf8d-446f-b7df-2ff3940d9423 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:52:08.295709 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-a3a6cbaa-cf8d-446f-b7df-2ff3940d9423 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a4b2efcb30314209a8c0366c9168836e'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:52:08.307399 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-a3a6cbaa-cf8d-446f-b7df-2ff3940d9423 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a4b2efcb30314209a8c0366c9168836e'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:52:08.314154 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-a3a6cbaa-cf8d-446f-b7df-2ff3940d9423 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a4b2efcb30314209a8c0366c9168836e'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:52:08.321158 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-a3a6cbaa-cf8d-446f-b7df-2ff3940d9423 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a4b2efcb30314209a8c0366c9168836e'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:52:08.322080 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-a3a6cbaa-cf8d-446f-b7df-2ff3940d9423 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a4b2efcb30314209a8c0366c9168836e'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:52:08.329088 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1053/2096] 10.222.0.58 () {58 vars in 1223 bytes} [Tue Oct 12 16:52:08 2021] DELETE /identity/v3/users/a4b2efcb30314209a8c0366c9168836e => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:52:08.498627 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580b50c6-1dd2-49a1-952a-9a5bcb787f85 service swift] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:52:08.510553 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a6cbaa-cf8d-446f-b7df-2ff3940d9423 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:52:08.512892 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-a3a6cbaa-cf8d-446f-b7df-2ff3940d9423 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:52:08.526644 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580b50c6-1dd2-49a1-952a-9a5bcb787f85 service swift] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:52:08.589110 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d91416e-f733-4a0a-b549-867dba2c86c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:52:08.590025 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d91416e-f733-4a0a-b549-867dba2c86c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:52:08.590314 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d91416e-f733-4a0a-b549-867dba2c86c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:52:08.590594 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d91416e-f733-4a0a-b549-867dba2c86c1 admin admin] PATH_INFO: `/v3/users/8ff954bb4ec44c60b7f1133ae6e616ba` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:52:08.592663 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d91416e-f733-4a0a-b549-867dba2c86c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ff954bb4ec44c60b7f1133ae6e616ba)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:52:08.594862 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d91416e-f733-4a0a-b549-867dba2c86c1 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:52:08.656895 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-6d91416e-f733-4a0a-b549-867dba2c86c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ff954bb4ec44c60b7f1133ae6e616ba'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:52:08.670965 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-6d91416e-f733-4a0a-b549-867dba2c86c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ff954bb4ec44c60b7f1133ae6e616ba'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:52:08.679664 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-6d91416e-f733-4a0a-b549-867dba2c86c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ff954bb4ec44c60b7f1133ae6e616ba'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:52:08.688538 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-6d91416e-f733-4a0a-b549-867dba2c86c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ff954bb4ec44c60b7f1133ae6e616ba'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:52:08.689512 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-6d91416e-f733-4a0a-b549-867dba2c86c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ff954bb4ec44c60b7f1133ae6e616ba'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:52:08.696755 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1044/2097] 10.222.0.58 () {58 vars in 1223 bytes} [Tue Oct 12 16:52:08 2021] DELETE /identity/v3/users/8ff954bb4ec44c60b7f1133ae6e616ba => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:52:08.701903 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71819b09-ed8b-4d59-8233-8bba5f327b92 None None] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:52:08.702418 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71819b09-ed8b-4d59-8233-8bba5f327b92 None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:52:08.702916 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71819b09-ed8b-4d59-8233-8bba5f327b92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:52:08.730081 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.auth.core [None req-71819b09-ed8b-4d59-8233-8bba5f327b92 None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:52:08.731399 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-71819b09-ed8b-4d59-8233-8bba5f327b92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:52:08.737753 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a6cbaa-cf8d-446f-b7df-2ff3940d9423 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:52:08.801146 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac29745-db0e-4592-bb6a-3d4624cde333 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:52:08.801717 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1045/2098] 10.222.0.58 () {58 vars in 957 bytes} [Tue Oct 12 16:52:08 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:52:08.802040 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac29745-db0e-4592-bb6a-3d4624cde333 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:52:08.802323 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac29745-db0e-4592-bb6a-3d4624cde333 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:52:08.802594 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac29745-db0e-4592-bb6a-3d4624cde333 admin admin] PATH_INFO: `/v3/projects/9eecf5f736d944d6bb4d373efa9d16db` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:52:08.804856 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac29745-db0e-4592-bb6a-3d4624cde333 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9eecf5f736d944d6bb4d373efa9d16db)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:52:08.807646 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac29745-db0e-4592-bb6a-3d4624cde333 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:52:08.813842 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71819b09-ed8b-4d59-8233-8bba5f327b92 None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:52:08.815319 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-71819b09-ed8b-4d59-8233-8bba5f327b92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:52:08.864144 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-fac29745-db0e-4592-bb6a-3d4624cde333 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9eecf5f736d944d6bb4d373efa9d16db', 'request_id': 'req-fac29745-db0e-4592-bb6a-3d4624cde333'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:52:08.869675 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-fac29745-db0e-4592-bb6a-3d4624cde333 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9eecf5f736d944d6bb4d373efa9d16db', 'request_id': 'req-fac29745-db0e-4592-bb6a-3d4624cde333'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:52:08.876106 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-fac29745-db0e-4592-bb6a-3d4624cde333 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9eecf5f736d944d6bb4d373efa9d16db', 'request_id': 'req-fac29745-db0e-4592-bb6a-3d4624cde333'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:52:08.889797 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-fac29745-db0e-4592-bb6a-3d4624cde333 admin admin] The token cache is being invalidate because project 9eecf5f736d944d6bb4d373efa9d16db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=85204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 16:52:08.890231 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-fac29745-db0e-4592-bb6a-3d4624cde333 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:52:08.890958 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-fac29745-db0e-4592-bb6a-3d4624cde333 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:52:08.892798 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1054/2099] 10.222.0.58 () {58 vars in 1232 bytes} [Tue Oct 12 16:52:08 2021] DELETE /identity/v3/projects/9eecf5f736d944d6bb4d373efa9d16db => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:52:08.895193 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71819b09-ed8b-4d59-8233-8bba5f327b92 None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:52:08.898118 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6268a8-b8b2-47ad-8dbc-14e4cf5a42ee None None] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:52:08.898486 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6268a8-b8b2-47ad-8dbc-14e4cf5a42ee None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:52:08.898833 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6268a8-b8b2-47ad-8dbc-14e4cf5a42ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:52:08.934097 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.auth.core [None req-7e6268a8-b8b2-47ad-8dbc-14e4cf5a42ee None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:52:08.935828 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-7e6268a8-b8b2-47ad-8dbc-14e4cf5a42ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:52:08.941124 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a678b30-8bf0-49f0-bcdd-34e51ef96172 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e65f6d0598e4c539134292b86fb43d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:52:08.941778 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a678b30-8bf0-49f0-bcdd-34e51ef96172 service neutron] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:52:08.942090 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a678b30-8bf0-49f0-bcdd-34e51ef96172 service neutron] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:52:08.942364 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a678b30-8bf0-49f0-bcdd-34e51ef96172 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:52:08.944163 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-2a678b30-8bf0-49f0-bcdd-34e51ef96172 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:52:08.991953 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1055/2100] 10.222.0.58 () {58 vars in 957 bytes} [Tue Oct 12 16:52:08 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:52:09.000214 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ecd2e4-91ed-47b9-b32b-ee91e9ce43d8 None None] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:52:09.000538 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ecd2e4-91ed-47b9-b32b-ee91e9ce43d8 None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:52:09.000817 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ecd2e4-91ed-47b9-b32b-ee91e9ce43d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:52:09.003493 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a678b30-8bf0-49f0-bcdd-34e51ef96172 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:52:09.004920 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a678b30-8bf0-49f0-bcdd-34e51ef96172 service neutron] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:52:09.014911 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1046/2101] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Oct 12 16:52:08 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 12 16:52:09.019109 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.auth.core [None req-b3ecd2e4-91ed-47b9-b32b-ee91e9ce43d8 None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:52:09.020346 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-b3ecd2e4-91ed-47b9-b32b-ee91e9ce43d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:52:09.028257 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1056/2102] 10.222.0.58 () {58 vars in 957 bytes} [Tue Oct 12 16:52:08 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:52:09.032498 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a678b30-8bf0-49f0-bcdd-34e51ef96172 service neutron] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:52:09.041748 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a678b30-8bf0-49f0-bcdd-34e51ef96172 service neutron] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:52:09.047117 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fa4e96-799b-4a91-b0c3-953a5a2943b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:52:09.047775 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fa4e96-799b-4a91-b0c3-953a5a2943b6 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:52:09.048054 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fa4e96-799b-4a91-b0c3-953a5a2943b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:52:09.048557 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fa4e96-799b-4a91-b0c3-953a5a2943b6 admin admin] PATH_INFO: `/v3/domains` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:52:09.049059 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fa4e96-799b-4a91-b0c3-953a5a2943b6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:52:09.049400 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fa4e96-799b-4a91-b0c3-953a5a2943b6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:52:09.051064 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fa4e96-799b-4a91-b0c3-953a5a2943b6 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:52:09.064361 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1047/2103] 10.222.0.58 () {58 vars in 1152 bytes} [Tue Oct 12 16:52:09 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:52:09.069285 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ecd2e4-91ed-47b9-b32b-ee91e9ce43d8 None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:52:09.079421 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ecd2e4-91ed-47b9-b32b-ee91e9ce43d8 None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:52:09.084658 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489f0937-7036-4c9a-ada6-2542d648dd18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:52:09.085330 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489f0937-7036-4c9a-ada6-2542d648dd18 admin admin] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:52:09.085645 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489f0937-7036-4c9a-ada6-2542d648dd18 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:52:09.085953 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489f0937-7036-4c9a-ada6-2542d648dd18 admin admin] PATH_INFO: `/v3/projects` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:52:09.086663 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489f0937-7036-4c9a-ada6-2542d648dd18 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:52:09.088589 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489f0937-7036-4c9a-ada6-2542d648dd18 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:52:09.129197 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1057/2104] 10.222.0.58 () {60 vars in 1152 bytes} [Tue Oct 12 16:52:09 2021] POST /identity/v3/projects => generated 391 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:52:09.130739 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fa4e96-799b-4a91-b0c3-953a5a2943b6 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:52:09.140918 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fa4e96-799b-4a91-b0c3-953a5a2943b6 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:52:09.205666 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332f11d2-4afe-40c0-9829-93495a284c4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:52:09.206646 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332f11d2-4afe-40c0-9829-93495a284c4f admin admin] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:52:09.206787 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332f11d2-4afe-40c0-9829-93495a284c4f admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:52:09.207240 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332f11d2-4afe-40c0-9829-93495a284c4f admin admin] PATH_INFO: `/v3/users` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:52:09.207752 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332f11d2-4afe-40c0-9829-93495a284c4f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:52:09.209816 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332f11d2-4afe-40c0-9829-93495a284c4f admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:52:09.230054 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1048/2105] 10.222.0.58 () {60 vars in 1143 bytes} [Tue Oct 12 16:52:09 2021] POST /identity/v3/users => generated 296 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 16:52:09.234561 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489f0937-7036-4c9a-ada6-2542d648dd18 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:52:09.245735 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489f0937-7036-4c9a-ada6-2542d648dd18 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:52:09.251998 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7027260-6799-4302-a69f-5401d1a089d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:52:09.253301 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7027260-6799-4302-a69f-5401d1a089d7 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:52:09.253716 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7027260-6799-4302-a69f-5401d1a089d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:52:09.254035 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7027260-6799-4302-a69f-5401d1a089d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:52:09.254841 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7027260-6799-4302-a69f-5401d1a089d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:52:09.256618 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7027260-6799-4302-a69f-5401d1a089d7 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:52:09.270549 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1058/2106] 10.222.0.58 () {58 vars in 1121 bytes} [Tue Oct 12 16:52:09 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:52:09.271746 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332f11d2-4afe-40c0-9829-93495a284c4f admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:52:09.284493 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332f11d2-4afe-40c0-9829-93495a284c4f admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:52:09.289548 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e78fea-1bcf-4b2b-9962-ba8268b3edc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:52:09.290365 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e78fea-1bcf-4b2b-9962-ba8268b3edc1 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:52:09.290757 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e78fea-1bcf-4b2b-9962-ba8268b3edc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:52:09.291136 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e78fea-1bcf-4b2b-9962-ba8268b3edc1 admin admin] PATH_INFO: `/v3/roles` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:52:09.292115 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e78fea-1bcf-4b2b-9962-ba8268b3edc1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:52:09.293909 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e78fea-1bcf-4b2b-9962-ba8268b3edc1 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:52:09.297082 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7027260-6799-4302-a69f-5401d1a089d7 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:52:09.299053 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-d7027260-6799-4302-a69f-5401d1a089d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:52:09.305695 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1049/2107] 10.222.0.58 () {58 vars in 1121 bytes} [Tue Oct 12 16:52:09 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:52:09.309766 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e78fea-1bcf-4b2b-9962-ba8268b3edc1 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:52:09.315725 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7027260-6799-4302-a69f-5401d1a089d7 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:52:09.321109 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d496bab8-5fab-46d1-870e-7025ad5e5048 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:52:09.322151 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d496bab8-5fab-46d1-870e-7025ad5e5048 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:52:09.322670 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d496bab8-5fab-46d1-870e-7025ad5e5048 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:52:09.323057 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d496bab8-5fab-46d1-870e-7025ad5e5048 admin admin] PATH_INFO: `/v3/projects/707abf6752314320bb947dd67452b3a7` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:52:09.324935 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d496bab8-5fab-46d1-870e-7025ad5e5048 admin admin] RBAC: Authorizing `identity:delete_project(project_id=707abf6752314320bb947dd67452b3a7)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:52:09.327428 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d496bab8-5fab-46d1-870e-7025ad5e5048 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:52:09.329661 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e78fea-1bcf-4b2b-9962-ba8268b3edc1 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:52:09.334982 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09c74f0-bfc8-4de9-82a8-1f1b6bd8669c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:52:09.335781 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09c74f0-bfc8-4de9-82a8-1f1b6bd8669c admin admin] REQUEST_METHOD: `PUT` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:52:09.336068 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09c74f0-bfc8-4de9-82a8-1f1b6bd8669c admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:52:09.336344 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09c74f0-bfc8-4de9-82a8-1f1b6bd8669c admin admin] PATH_INFO: `/v3/projects/7ff75a5c52d0496ebf01a505bcfb9d78/users/9e75c9a9f52640bc8606b680456aaf88/roles/55ba49fe29884e64b57c3ad13188d554` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:52:09.355418 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09c74f0-bfc8-4de9-82a8-1f1b6bd8669c admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ff75a5c52d0496ebf01a505bcfb9d78, user_id=9e75c9a9f52640bc8606b680456aaf88, role_id=55ba49fe29884e64b57c3ad13188d554)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:52:09.359242 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09c74f0-bfc8-4de9-82a8-1f1b6bd8669c admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:52:09.374360 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1050/2108] 10.222.0.58 () {60 vars in 1482 bytes} [Tue Oct 12 16:52:09 2021] PUT /identity/v3/projects/7ff75a5c52d0496ebf01a505bcfb9d78/users/9e75c9a9f52640bc8606b680456aaf88/roles/55ba49fe29884e64b57c3ad13188d554 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 16:52:09.385951 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc17e05-3a8b-47fd-8f2a-cbb583622208 None None] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:52:09.386240 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc17e05-3a8b-47fd-8f2a-cbb583622208 None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:52:09.386517 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc17e05-3a8b-47fd-8f2a-cbb583622208 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:52:09.394728 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-d496bab8-5fab-46d1-870e-7025ad5e5048 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '707abf6752314320bb947dd67452b3a7', 'request_id': 'req-d496bab8-5fab-46d1-870e-7025ad5e5048'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:52:09.400331 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-d496bab8-5fab-46d1-870e-7025ad5e5048 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '707abf6752314320bb947dd67452b3a7', 'request_id': 'req-d496bab8-5fab-46d1-870e-7025ad5e5048'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:52:09.407487 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-d496bab8-5fab-46d1-870e-7025ad5e5048 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '707abf6752314320bb947dd67452b3a7', 'request_id': 'req-d496bab8-5fab-46d1-870e-7025ad5e5048'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:52:09.414917 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.auth.core [None req-1fc17e05-3a8b-47fd-8f2a-cbb583622208 None None] MFA Rules not processed for user `9e75c9a9f52640bc8606b680456aaf88`. Rule list: `[]` (Enabled: `True`). {{(pid=85205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:52:09.416249 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-1fc17e05-3a8b-47fd-8f2a-cbb583622208 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:52:09.421998 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-d496bab8-5fab-46d1-870e-7025ad5e5048 admin admin] The token cache is being invalidate because project 707abf6752314320bb947dd67452b3a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=85204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 16:52:09.422192 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-d496bab8-5fab-46d1-870e-7025ad5e5048 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:52:09.422772 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-d496bab8-5fab-46d1-870e-7025ad5e5048 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:52:09.429848 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1059/2109] 10.222.0.58 () {58 vars in 1232 bytes} [Tue Oct 12 16:52:09 2021] DELETE /identity/v3/projects/707abf6752314320bb947dd67452b3a7 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 16:52:09.431728 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6dbeee-0309-4123-9321-404d46aa33b8 None None] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:52:09.432139 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6dbeee-0309-4123-9321-404d46aa33b8 None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:52:09.432494 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6dbeee-0309-4123-9321-404d46aa33b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:52:09.451874 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.auth.core [None req-fc6dbeee-0309-4123-9321-404d46aa33b8 None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:52:09.453213 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-fc6dbeee-0309-4123-9321-404d46aa33b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:52:09.496600 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1051/2110] 10.222.0.58 () {58 vars in 957 bytes} [Tue Oct 12 16:52:09 2021] POST /identity/v3/auth/tokens => generated 3411 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:52:09.506320 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc17e05-3a8b-47fd-8f2a-cbb583622208 None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:52:09.508068 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-1fc17e05-3a8b-47fd-8f2a-cbb583622208 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:52:09.517830 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1060/2111] 10.222.0.58 () {58 vars in 957 bytes} [Tue Oct 12 16:52:09 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:52:09.525164 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1af640c-0a7b-4234-9d5e-ce5632d8aead None None] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:52:09.525454 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1af640c-0a7b-4234-9d5e-ce5632d8aead None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:52:09.525757 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1af640c-0a7b-4234-9d5e-ce5632d8aead None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:52:09.546341 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.auth.core [None req-b1af640c-0a7b-4234-9d5e-ce5632d8aead None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:52:09.547594 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-b1af640c-0a7b-4234-9d5e-ce5632d8aead None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:52:09.561053 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1061/2112] 10.222.0.58 () {58 vars in 957 bytes} [Tue Oct 12 16:52:09 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:52:09.563094 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1af640c-0a7b-4234-9d5e-ce5632d8aead None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:52:09.573294 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1af640c-0a7b-4234-9d5e-ce5632d8aead None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:52:09.578996 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e57662b-19bd-4a7c-9793-6319bf4c8cd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:52:09.580187 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e57662b-19bd-4a7c-9793-6319bf4c8cd5 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:52:09.580631 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e57662b-19bd-4a7c-9793-6319bf4c8cd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:52:09.580988 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e57662b-19bd-4a7c-9793-6319bf4c8cd5 admin admin] PATH_INFO: `/v3/domains` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:52:09.582148 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e57662b-19bd-4a7c-9793-6319bf4c8cd5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:52:09.582599 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e57662b-19bd-4a7c-9793-6319bf4c8cd5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:52:09.584747 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e57662b-19bd-4a7c-9793-6319bf4c8cd5 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:52:09.595602 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc17e05-3a8b-47fd-8f2a-cbb583622208 None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:52:09.600279 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca8bb7b-0313-410c-92b0-5e8184741fe1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04704222b3d64a33a6c092fc641ccbb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:52:09.601183 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca8bb7b-0313-410c-92b0-5e8184741fe1 service cinder] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:52:09.601482 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca8bb7b-0313-410c-92b0-5e8184741fe1 service cinder] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:52:09.601940 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca8bb7b-0313-410c-92b0-5e8184741fe1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:52:09.603945 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1062/2113] 10.222.0.58 () {58 vars in 1152 bytes} [Tue Oct 12 16:52:09 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:52:09.608683 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e57662b-19bd-4a7c-9793-6319bf4c8cd5 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:52:09.611469 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca8bb7b-0313-410c-92b0-5e8184741fe1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:52:09.612890 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca8bb7b-0313-410c-92b0-5e8184741fe1 service cinder] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:52:09.617841 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e57662b-19bd-4a7c-9793-6319bf4c8cd5 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:52:09.621815 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1052/2114] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Oct 12 16:52:09 2021] GET /identity/v3/auth/tokens => generated 3411 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 12 16:52:09.622986 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63e7c19-e10f-416a-9280-bbc5cd1dd6ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:52:09.623663 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63e7c19-e10f-416a-9280-bbc5cd1dd6ee admin admin] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:52:09.623977 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63e7c19-e10f-416a-9280-bbc5cd1dd6ee admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:52:09.624247 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63e7c19-e10f-416a-9280-bbc5cd1dd6ee admin admin] PATH_INFO: `/v3/projects` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:52:09.624950 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63e7c19-e10f-416a-9280-bbc5cd1dd6ee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:52:09.626960 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63e7c19-e10f-416a-9280-bbc5cd1dd6ee admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:52:09.653067 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1063/2115] 10.222.0.58 () {60 vars in 1152 bytes} [Tue Oct 12 16:52:09 2021] POST /identity/v3/projects => generated 373 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 16:52:09.657698 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca8bb7b-0313-410c-92b0-5e8184741fe1 service cinder] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:52:09.669463 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca8bb7b-0313-410c-92b0-5e8184741fe1 service cinder] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:52:09.725662 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff49450-7888-48fd-9267-d2a4567b762e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:52:09.726427 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff49450-7888-48fd-9267-d2a4567b762e admin admin] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:52:09.726777 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff49450-7888-48fd-9267-d2a4567b762e admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:52:09.727114 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff49450-7888-48fd-9267-d2a4567b762e admin admin] PATH_INFO: `/v3/users` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:52:09.727892 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff49450-7888-48fd-9267-d2a4567b762e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:52:09.729849 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff49450-7888-48fd-9267-d2a4567b762e admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:52:09.753402 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1053/2116] 10.222.0.58 () {60 vars in 1143 bytes} [Tue Oct 12 16:52:09 2021] POST /identity/v3/users => generated 287 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:52:09.757293 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63e7c19-e10f-416a-9280-bbc5cd1dd6ee admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:52:09.768042 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63e7c19-e10f-416a-9280-bbc5cd1dd6ee admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:52:09.772831 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c413e6c0-89ea-4644-801e-d672149c046f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:52:09.773495 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c413e6c0-89ea-4644-801e-d672149c046f admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:52:09.773777 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c413e6c0-89ea-4644-801e-d672149c046f admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:52:09.774084 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c413e6c0-89ea-4644-801e-d672149c046f admin admin] PATH_INFO: `/v3/roles` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:52:09.775079 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c413e6c0-89ea-4644-801e-d672149c046f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:52:09.776667 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c413e6c0-89ea-4644-801e-d672149c046f admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:52:09.788228 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1064/2117] 10.222.0.58 () {58 vars in 1121 bytes} [Tue Oct 12 16:52:09 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:52:09.792307 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff49450-7888-48fd-9267-d2a4567b762e admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:52:09.807211 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff49450-7888-48fd-9267-d2a4567b762e admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:52:09.815625 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84a05a1-d72e-41f7-adb0-2112ccaa65e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:52:09.816896 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84a05a1-d72e-41f7-adb0-2112ccaa65e2 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:52:09.816896 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84a05a1-d72e-41f7-adb0-2112ccaa65e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:52:09.817074 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84a05a1-d72e-41f7-adb0-2112ccaa65e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:52:09.817795 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84a05a1-d72e-41f7-adb0-2112ccaa65e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:52:09.819601 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84a05a1-d72e-41f7-adb0-2112ccaa65e2 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:52:09.831536 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1054/2118] 10.222.0.58 () {58 vars in 1121 bytes} [Tue Oct 12 16:52:09 2021] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 16:52:09.835920 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c413e6c0-89ea-4644-801e-d672149c046f admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:52:09.847529 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c413e6c0-89ea-4644-801e-d672149c046f admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:52:09.857038 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff397c1-e8fc-4f9e-b821-6725b80cf4aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:52:09.858105 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff397c1-e8fc-4f9e-b821-6725b80cf4aa admin admin] REQUEST_METHOD: `PUT` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:52:09.858492 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff397c1-e8fc-4f9e-b821-6725b80cf4aa admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:52:09.858775 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff397c1-e8fc-4f9e-b821-6725b80cf4aa admin admin] PATH_INFO: `/v3/projects/8121321d3eef4620acf63504a9edc43f/users/dc31a321214744d48bc75160daede09d/roles/55ba49fe29884e64b57c3ad13188d554` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:52:09.882040 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff397c1-e8fc-4f9e-b821-6725b80cf4aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=8121321d3eef4620acf63504a9edc43f, user_id=dc31a321214744d48bc75160daede09d, role_id=55ba49fe29884e64b57c3ad13188d554)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:52:09.884989 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff397c1-e8fc-4f9e-b821-6725b80cf4aa admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:52:09.901571 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1065/2119] 10.222.0.58 () {60 vars in 1482 bytes} [Tue Oct 12 16:52:09 2021] PUT /identity/v3/projects/8121321d3eef4620acf63504a9edc43f/users/dc31a321214744d48bc75160daede09d/roles/55ba49fe29884e64b57c3ad13188d554 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:52:09.912706 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb599457-33dc-4280-b92f-5ae789c2bb09 None None] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:52:09.912999 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb599457-33dc-4280-b92f-5ae789c2bb09 None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:52:09.913284 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb599457-33dc-4280-b92f-5ae789c2bb09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:52:09.946400 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.auth.core [None req-bb599457-33dc-4280-b92f-5ae789c2bb09 None None] MFA Rules not processed for user `dc31a321214744d48bc75160daede09d`. Rule list: `[]` (Enabled: `True`). {{(pid=85205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:52:09.949343 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-bb599457-33dc-4280-b92f-5ae789c2bb09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:52:10.013031 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1055/2120] 10.222.0.58 () {58 vars in 957 bytes} [Tue Oct 12 16:52:09 2021] POST /identity/v3/auth/tokens => generated 3393 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:52:10.025532 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff397c1-e8fc-4f9e-b821-6725b80cf4aa admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:52:10.077497 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff397c1-e8fc-4f9e-b821-6725b80cf4aa admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:52:10.081008 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ce7a0d-e176-4afe-97cb-ecff5a98b052 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04704222b3d64a33a6c092fc641ccbb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:52:10.081650 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ce7a0d-e176-4afe-97cb-ecff5a98b052 service cinder] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:52:10.081960 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ce7a0d-e176-4afe-97cb-ecff5a98b052 service cinder] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:52:10.082234 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ce7a0d-e176-4afe-97cb-ecff5a98b052 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:52:10.090228 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ce7a0d-e176-4afe-97cb-ecff5a98b052 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:52:10.092258 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ce7a0d-e176-4afe-97cb-ecff5a98b052 service cinder] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:52:10.100623 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1066/2121] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Oct 12 16:52:10 2021] GET /identity/v3/auth/tokens => generated 3393 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:52:11.737804 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b016ab0-8e2e-4be3-91eb-426fc4948efa None None] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:52:11.738304 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b016ab0-8e2e-4be3-91eb-426fc4948efa None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:52:11.738409 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b016ab0-8e2e-4be3-91eb-426fc4948efa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:52:11.757563 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f10fe1-756e-43e3-94d0-d35d3bb83096 None None] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:52:11.758049 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f10fe1-756e-43e3-94d0-d35d3bb83096 None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:52:11.758563 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f10fe1-756e-43e3-94d0-d35d3bb83096 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:52:11.776058 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.auth.core [None req-1b016ab0-8e2e-4be3-91eb-426fc4948efa None None] MFA Rules not processed for user `7b7a1c26e06f45e68291dd72d3f5d5ba`. Rule list: `[]` (Enabled: `True`). {{(pid=85205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:52:11.777638 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-1b016ab0-8e2e-4be3-91eb-426fc4948efa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:52:11.779917 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.auth.core [None req-b1f10fe1-756e-43e3-94d0-d35d3bb83096 None None] MFA Rules not processed for user `387a65d2bfb142499c9b3b0ac946f48b`. Rule list: `[]` (Enabled: `True`). {{(pid=85204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:52:11.781283 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-b1f10fe1-756e-43e3-94d0-d35d3bb83096 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:52:11.849616 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1067/2122] 10.222.0.58 () {58 vars in 1009 bytes} [Tue Oct 12 16:52:11 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:52:11.863065 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f10fe1-756e-43e3-94d0-d35d3bb83096 None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:52:11.864786 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-b1f10fe1-756e-43e3-94d0-d35d3bb83096 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:52:11.865229 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1056/2123] 10.222.0.58 () {58 vars in 957 bytes} [Tue Oct 12 16:52:11 2021] POST /identity/v3/auth/tokens => generated 3403 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:52:11.942216 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f10fe1-756e-43e3-94d0-d35d3bb83096 None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:52:11.947740 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5976d60c-f9c6-4399-a4ed-221a00084fb0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdeb0a451344c9987b4134b957ffa22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:52:11.948395 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5976d60c-f9c6-4399-a4ed-221a00084fb0 service swift] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:52:11.948683 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5976d60c-f9c6-4399-a4ed-221a00084fb0 service swift] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:52:11.948960 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5976d60c-f9c6-4399-a4ed-221a00084fb0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:52:11.957513 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5976d60c-f9c6-4399-a4ed-221a00084fb0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:52:11.959108 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5976d60c-f9c6-4399-a4ed-221a00084fb0 service swift] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:52:11.967676 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1068/2124] 10.222.0.58 () {60 vars in 1384 bytes} [Tue Oct 12 16:52:11 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 12 16:52:12.503428 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fee8d5-92c8-48cb-8699-161284c0fdeb None None] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:52:12.504510 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fee8d5-92c8-48cb-8699-161284c0fdeb None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:52:12.504510 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fee8d5-92c8-48cb-8699-161284c0fdeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:52:12.542823 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.auth.core [None req-15fee8d5-92c8-48cb-8699-161284c0fdeb None None] MFA Rules not processed for user `dc31a321214744d48bc75160daede09d`. Rule list: `[]` (Enabled: `True`). {{(pid=85205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:52:12.544219 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-15fee8d5-92c8-48cb-8699-161284c0fdeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:52:12.557401 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1057/2125] 10.222.0.58 () {58 vars in 957 bytes} [Tue Oct 12 16:52:12 2021] POST /identity/v3/auth/tokens => generated 3393 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:52:17.226901 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4133c70-149b-46a4-be7d-4eafcaaa51c3 None None] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:52:17.227512 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4133c70-149b-46a4-be7d-4eafcaaa51c3 None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:52:17.227512 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4133c70-149b-46a4-be7d-4eafcaaa51c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:52:17.247277 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.auth.core [None req-d4133c70-149b-46a4-be7d-4eafcaaa51c3 None None] MFA Rules not processed for user `fac2e7e3088b4863b65bd9310b878229`. Rule list: `[]` (Enabled: `True`). {{(pid=85204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:52:17.248416 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-d4133c70-149b-46a4-be7d-4eafcaaa51c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:52:17.313837 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1069/2126] 10.222.0.58 () {58 vars in 957 bytes} [Tue Oct 12 16:52:17 2021] POST /identity/v3/auth/tokens => generated 3403 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:52:30.667566 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fee8d5-92c8-48cb-8699-161284c0fdeb None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:52:30.668961 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-15fee8d5-92c8-48cb-8699-161284c0fdeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:52:30.761850 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fee8d5-92c8-48cb-8699-161284c0fdeb None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:52:30.767806 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e4e214-2ee4-4dbc-a3bf-72be45a8e4aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:52:30.768687 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e4e214-2ee4-4dbc-a3bf-72be45a8e4aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:52:30.768972 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e4e214-2ee4-4dbc-a3bf-72be45a8e4aa admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:52:30.769245 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e4e214-2ee4-4dbc-a3bf-72be45a8e4aa admin admin] PATH_INFO: `/v3/users/9e75c9a9f52640bc8606b680456aaf88` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:52:30.770896 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e4e214-2ee4-4dbc-a3bf-72be45a8e4aa admin admin] RBAC: Authorizing `identity:delete_user(user_id=9e75c9a9f52640bc8606b680456aaf88)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:52:30.772730 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e4e214-2ee4-4dbc-a3bf-72be45a8e4aa admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:52:30.850232 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-83e4e214-2ee4-4dbc-a3bf-72be45a8e4aa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9e75c9a9f52640bc8606b680456aaf88'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:52:30.866618 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-83e4e214-2ee4-4dbc-a3bf-72be45a8e4aa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9e75c9a9f52640bc8606b680456aaf88'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:52:30.878692 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-83e4e214-2ee4-4dbc-a3bf-72be45a8e4aa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9e75c9a9f52640bc8606b680456aaf88'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:52:30.879294 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c31ebd6-1119-4802-8be1-ca88aae26a25 None None] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:52:30.879926 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c31ebd6-1119-4802-8be1-ca88aae26a25 None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:52:30.879926 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c31ebd6-1119-4802-8be1-ca88aae26a25 None None] PATH_INFO: `/` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:52:30.881635 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1070/2127] 10.222.0.58 () {54 vars in 921 bytes} [Tue Oct 12 16:52:30 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 12 16:52:30.890424 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-83e4e214-2ee4-4dbc-a3bf-72be45a8e4aa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9e75c9a9f52640bc8606b680456aaf88'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:52:30.891382 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-83e4e214-2ee4-4dbc-a3bf-72be45a8e4aa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9e75c9a9f52640bc8606b680456aaf88'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:52:30.894854 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d6d4bd-34af-4d96-b74e-89ca77264934 None None] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:52:30.895352 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d6d4bd-34af-4d96-b74e-89ca77264934 None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:52:30.895805 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d6d4bd-34af-4d96-b74e-89ca77264934 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:52:30.902004 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1058/2128] 10.222.0.58 () {58 vars in 1223 bytes} [Tue Oct 12 16:52:30 2021] DELETE /identity/v3/users/9e75c9a9f52640bc8606b680456aaf88 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:52:30.903954 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bebe61f-6e33-473a-a8e0-9316d65ebf85 None None] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:52:30.904353 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bebe61f-6e33-473a-a8e0-9316d65ebf85 None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:52:30.905246 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bebe61f-6e33-473a-a8e0-9316d65ebf85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:52:30.928632 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.auth.core [None req-9bebe61f-6e33-473a-a8e0-9316d65ebf85 None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:52:30.930278 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-9bebe61f-6e33-473a-a8e0-9316d65ebf85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:52:31.026732 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1059/2129] 10.222.0.58 () {58 vars in 957 bytes} [Tue Oct 12 16:52:30 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:52:31.065263 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bebe61f-6e33-473a-a8e0-9316d65ebf85 None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:52:31.067295 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-9bebe61f-6e33-473a-a8e0-9316d65ebf85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:52:31.070000 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.auth.core [None req-01d6d4bd-34af-4d96-b74e-89ca77264934 None None] MFA Rules not processed for user `29d30b574eec4ad3990d77d235c8b424`. Rule list: `[]` (Enabled: `True`). {{(pid=85204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:52:31.072806 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-01d6d4bd-34af-4d96-b74e-89ca77264934 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:52:31.145314 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bebe61f-6e33-473a-a8e0-9316d65ebf85 None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:52:31.156414 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcd706a-a7f2-4b09-84e5-b81bdb4eb139 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e65f6d0598e4c539134292b86fb43d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:52:31.156414 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcd706a-a7f2-4b09-84e5-b81bdb4eb139 service neutron] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:52:31.156870 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcd706a-a7f2-4b09-84e5-b81bdb4eb139 service neutron] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:52:31.156990 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcd706a-a7f2-4b09-84e5-b81bdb4eb139 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:52:31.177442 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcd706a-a7f2-4b09-84e5-b81bdb4eb139 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:52:31.178903 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcd706a-a7f2-4b09-84e5-b81bdb4eb139 service neutron] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:52:31.192850 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1060/2130] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Oct 12 16:52:31 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 12 16:52:31.277796 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1071/2131] 10.222.0.58 () {58 vars in 1018 bytes} [Tue Oct 12 16:52:30 2021] POST /identity/v3/auth/tokens => generated 3515 bytes in 384 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:52:31.291996 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcd706a-a7f2-4b09-84e5-b81bdb4eb139 service neutron] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:52:31.293454 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-4bcd706a-a7f2-4b09-84e5-b81bdb4eb139 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:52:31.366960 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcd706a-a7f2-4b09-84e5-b81bdb4eb139 service neutron] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:52:31.370888 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f79900-04e9-4771-b02f-3416e955ba44 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ff84015069041f2bf33e3fd55b92e44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:52:31.371538 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f79900-04e9-4771-b02f-3416e955ba44 service glance] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:52:31.371823 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f79900-04e9-4771-b02f-3416e955ba44 service glance] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:52:31.372126 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f79900-04e9-4771-b02f-3416e955ba44 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:52:31.382900 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f79900-04e9-4771-b02f-3416e955ba44 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:52:31.384368 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f79900-04e9-4771-b02f-3416e955ba44 service glance] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:52:31.397908 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1061/2132] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Oct 12 16:52:31 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:52:31.475203 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0d651c-22ee-48e0-8df5-bd5f2e824b5e None None] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:52:31.475493 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0d651c-22ee-48e0-8df5-bd5f2e824b5e None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:52:31.476057 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0d651c-22ee-48e0-8df5-bd5f2e824b5e None None] PATH_INFO: `/` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:52:31.477835 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1072/2133] 10.222.0.58 () {54 vars in 921 bytes} [Tue Oct 12 16:52:31 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:52:31.483392 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96b1e32-9d9a-4e00-b98d-a49fe7cf062b None None] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:52:31.483767 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96b1e32-9d9a-4e00-b98d-a49fe7cf062b None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:52:31.484114 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96b1e32-9d9a-4e00-b98d-a49fe7cf062b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:52:31.502399 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.auth.core [None req-f96b1e32-9d9a-4e00-b98d-a49fe7cf062b None None] MFA Rules not processed for user `6e65f6d0598e4c539134292b86fb43d2`. Rule list: `[]` (Enabled: `True`). {{(pid=85205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:52:31.503624 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-f96b1e32-9d9a-4e00-b98d-a49fe7cf062b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:52:31.510264 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1062/2134] 10.222.0.58 () {58 vars in 1018 bytes} [Tue Oct 12 16:52:31 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:52:31.523594 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0d651c-22ee-48e0-8df5-bd5f2e824b5e None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:52:31.535434 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0d651c-22ee-48e0-8df5-bd5f2e824b5e None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:52:31.539079 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bc9a6d-36b7-4cbe-b55c-a1ceb7655768 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e65f6d0598e4c539134292b86fb43d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:52:31.539748 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bc9a6d-36b7-4cbe-b55c-a1ceb7655768 service neutron] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:52:31.540055 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bc9a6d-36b7-4cbe-b55c-a1ceb7655768 service neutron] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:52:31.540330 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bc9a6d-36b7-4cbe-b55c-a1ceb7655768 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:52:31.552395 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96b1e32-9d9a-4e00-b98d-a49fe7cf062b None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:52:31.553907 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bc9a6d-36b7-4cbe-b55c-a1ceb7655768 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:52:31.554231 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-f96b1e32-9d9a-4e00-b98d-a49fe7cf062b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:52:31.555675 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bc9a6d-36b7-4cbe-b55c-a1ceb7655768 service neutron] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:52:31.565432 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1073/2135] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Oct 12 16:52:31 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 12 16:52:31.596368 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96b1e32-9d9a-4e00-b98d-a49fe7cf062b None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:52:31.606256 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53328a6-ac1c-4aa3-96d0-d8efce829059 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:52:31.607257 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53328a6-ac1c-4aa3-96d0-d8efce829059 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:52:31.608072 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53328a6-ac1c-4aa3-96d0-d8efce829059 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:52:31.608350 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53328a6-ac1c-4aa3-96d0-d8efce829059 admin admin] PATH_INFO: `/v3/projects/7ff75a5c52d0496ebf01a505bcfb9d78` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:52:31.609563 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53328a6-ac1c-4aa3-96d0-d8efce829059 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ff75a5c52d0496ebf01a505bcfb9d78)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:52:31.611509 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53328a6-ac1c-4aa3-96d0-d8efce829059 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:52:31.666162 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-e53328a6-ac1c-4aa3-96d0-d8efce829059 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ff75a5c52d0496ebf01a505bcfb9d78', 'request_id': 'req-e53328a6-ac1c-4aa3-96d0-d8efce829059'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:52:31.672318 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-e53328a6-ac1c-4aa3-96d0-d8efce829059 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ff75a5c52d0496ebf01a505bcfb9d78', 'request_id': 'req-e53328a6-ac1c-4aa3-96d0-d8efce829059'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:52:31.679098 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-e53328a6-ac1c-4aa3-96d0-d8efce829059 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ff75a5c52d0496ebf01a505bcfb9d78', 'request_id': 'req-e53328a6-ac1c-4aa3-96d0-d8efce829059'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:52:31.694012 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-e53328a6-ac1c-4aa3-96d0-d8efce829059 admin admin] The token cache is being invalidate because project 7ff75a5c52d0496ebf01a505bcfb9d78 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=85205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 16:52:31.694546 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-e53328a6-ac1c-4aa3-96d0-d8efce829059 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:52:31.695337 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-e53328a6-ac1c-4aa3-96d0-d8efce829059 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:52:31.702723 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1063/2136] 10.222.0.58 () {58 vars in 1232 bytes} [Tue Oct 12 16:52:31 2021] DELETE /identity/v3/projects/7ff75a5c52d0496ebf01a505bcfb9d78 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 16:52:32.963875 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bc9a6d-36b7-4cbe-b55c-a1ceb7655768 service neutron] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:52:32.965468 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-98bc9a6d-36b7-4cbe-b55c-a1ceb7655768 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:52:32.977563 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bc9a6d-36b7-4cbe-b55c-a1ceb7655768 service neutron] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:52:33.025588 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f75f165-5fd4-48b0-a333-a25eed43144f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e65f6d0598e4c539134292b86fb43d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:52:33.026267 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f75f165-5fd4-48b0-a333-a25eed43144f service neutron] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:52:33.026552 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f75f165-5fd4-48b0-a333-a25eed43144f service neutron] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:52:33.026828 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f75f165-5fd4-48b0-a333-a25eed43144f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:52:33.028609 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-1f75f165-5fd4-48b0-a333-a25eed43144f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:52:33.089221 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f75f165-5fd4-48b0-a333-a25eed43144f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:52:33.090674 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f75f165-5fd4-48b0-a333-a25eed43144f service neutron] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:52:33.100329 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1074/2137] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Oct 12 16:52:32 2021] GET /identity/v3/auth/tokens => generated 3466 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:52:33.104117 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d668e7d3-ae41-4978-8cdf-fb686fdda125 None None] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:52:33.104586 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d668e7d3-ae41-4978-8cdf-fb686fdda125 None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:52:33.104711 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d668e7d3-ae41-4978-8cdf-fb686fdda125 None None] PATH_INFO: `/` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:52:33.106411 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1064/2138] 10.222.0.58 () {54 vars in 960 bytes} [Tue Oct 12 16:52:33 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:52:33.112537 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58364ed5-190c-43b5-a546-764f818b62c5 None None] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:52:33.112846 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58364ed5-190c-43b5-a546-764f818b62c5 None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:52:33.113123 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58364ed5-190c-43b5-a546-764f818b62c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:52:33.163002 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.auth.core [None req-58364ed5-190c-43b5-a546-764f818b62c5 None None] MFA Rules not processed for user `4102412c40bc4745bba8c31f1caf9788`. Rule list: `[]` (Enabled: `True`). {{(pid=85204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:52:33.164358 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-58364ed5-190c-43b5-a546-764f818b62c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:52:33.233356 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1075/2139] 10.222.0.58 () {58 vars in 1057 bytes} [Tue Oct 12 16:52:33 2021] POST /identity/v3/auth/tokens => generated 3451 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:52:33.241830 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d668e7d3-ae41-4978-8cdf-fb686fdda125 None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:52:33.257731 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d668e7d3-ae41-4978-8cdf-fb686fdda125 None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:52:33.263435 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5178057-e5a0-448f-accb-0b696305ff60 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4102412c40bc4745bba8c31f1caf9788', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:52:33.264294 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5178057-e5a0-448f-accb-0b696305ff60 service placement] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:52:33.264577 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5178057-e5a0-448f-accb-0b696305ff60 service placement] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:52:33.265038 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5178057-e5a0-448f-accb-0b696305ff60 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:52:33.266846 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-c5178057-e5a0-448f-accb-0b696305ff60 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:52:33.278724 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5178057-e5a0-448f-accb-0b696305ff60 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:52:33.280313 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5178057-e5a0-448f-accb-0b696305ff60 service placement] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:52:33.291987 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1065/2140] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Oct 12 16:52:33 2021] GET /identity/v3/auth/tokens => generated 3451 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:52:35.070725 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43287bdc-0a39-4c9f-a0dc-864da1653578 None None] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:52:35.071225 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43287bdc-0a39-4c9f-a0dc-864da1653578 None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:52:35.071430 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43287bdc-0a39-4c9f-a0dc-864da1653578 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:52:35.088968 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.auth.core [None req-43287bdc-0a39-4c9f-a0dc-864da1653578 None None] MFA Rules not processed for user `387a65d2bfb142499c9b3b0ac946f48b`. Rule list: `[]` (Enabled: `True`). {{(pid=85204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:52:35.090199 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-43287bdc-0a39-4c9f-a0dc-864da1653578 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:52:35.164739 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1076/2141] 10.222.0.58 () {58 vars in 1009 bytes} [Tue Oct 12 16:52:35 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:52:35.179308 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5178057-e5a0-448f-accb-0b696305ff60 service placement] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:52:35.180752 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-c5178057-e5a0-448f-accb-0b696305ff60 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:52:35.250273 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5178057-e5a0-448f-accb-0b696305ff60 service placement] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:52:35.255368 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f38c43-02d1-43bc-92ad-00c1c97c2a86 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdeb0a451344c9987b4134b957ffa22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:52:35.256049 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f38c43-02d1-43bc-92ad-00c1c97c2a86 service swift] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:52:35.256338 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f38c43-02d1-43bc-92ad-00c1c97c2a86 service swift] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:52:35.256617 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f38c43-02d1-43bc-92ad-00c1c97c2a86 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:52:35.264742 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f38c43-02d1-43bc-92ad-00c1c97c2a86 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:52:35.266417 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f38c43-02d1-43bc-92ad-00c1c97c2a86 service swift] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:52:35.274391 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1066/2142] 10.222.0.58 () {60 vars in 1384 bytes} [Tue Oct 12 16:52:35 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 12 16:52:56.773857 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2873d5c5-cdf4-4c3b-a6c2-b1e8484ce818 None None] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:52:56.774396 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2873d5c5-cdf4-4c3b-a6c2-b1e8484ce818 None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:52:56.774497 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2873d5c5-cdf4-4c3b-a6c2-b1e8484ce818 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:52:56.820557 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.auth.core [None req-2873d5c5-cdf4-4c3b-a6c2-b1e8484ce818 None None] MFA Rules not processed for user `387a65d2bfb142499c9b3b0ac946f48b`. Rule list: `[]` (Enabled: `True`). {{(pid=85204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:52:56.821768 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-2873d5c5-cdf4-4c3b-a6c2-b1e8484ce818 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:52:56.838091 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1077/2143] 10.222.0.58 () {58 vars in 1009 bytes} [Tue Oct 12 16:52:56 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:52:56.860019 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f38c43-02d1-43bc-92ad-00c1c97c2a86 service swift] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:52:56.880280 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f38c43-02d1-43bc-92ad-00c1c97c2a86 service swift] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:52:56.885177 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4c2f29-d5e9-4e8f-9cd8-742aecda4a50 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdeb0a451344c9987b4134b957ffa22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:52:56.885798 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4c2f29-d5e9-4e8f-9cd8-742aecda4a50 service swift] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:52:56.886107 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4c2f29-d5e9-4e8f-9cd8-742aecda4a50 service swift] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:52:56.886381 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4c2f29-d5e9-4e8f-9cd8-742aecda4a50 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:52:56.894697 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4c2f29-d5e9-4e8f-9cd8-742aecda4a50 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:52:56.896231 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4c2f29-d5e9-4e8f-9cd8-742aecda4a50 service swift] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:52:56.903875 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1067/2144] 10.222.0.58 () {60 vars in 1384 bytes} [Tue Oct 12 16:52:56 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 12 16:52:57.485522 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed14fb0-13a8-4764-a4d7-88b034467411 None None] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:52:57.485811 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed14fb0-13a8-4764-a4d7-88b034467411 None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:52:57.486120 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed14fb0-13a8-4764-a4d7-88b034467411 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:52:57.503582 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.auth.core [None req-fed14fb0-13a8-4764-a4d7-88b034467411 None None] MFA Rules not processed for user `387a65d2bfb142499c9b3b0ac946f48b`. Rule list: `[]` (Enabled: `True`). {{(pid=85204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:52:57.504770 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-fed14fb0-13a8-4764-a4d7-88b034467411 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:52:57.511862 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1078/2145] 10.222.0.58 () {58 vars in 1009 bytes} [Tue Oct 12 16:52:57 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:52:57.524413 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4c2f29-d5e9-4e8f-9cd8-742aecda4a50 service swift] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:52:57.535038 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4c2f29-d5e9-4e8f-9cd8-742aecda4a50 service swift] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:52:57.540291 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173d7963-aa19-4e6d-8dae-00ee40a23254 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdeb0a451344c9987b4134b957ffa22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:52:57.540928 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173d7963-aa19-4e6d-8dae-00ee40a23254 service swift] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:52:57.541218 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173d7963-aa19-4e6d-8dae-00ee40a23254 service swift] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:52:57.541499 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173d7963-aa19-4e6d-8dae-00ee40a23254 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:52:57.550199 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173d7963-aa19-4e6d-8dae-00ee40a23254 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:52:57.551744 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173d7963-aa19-4e6d-8dae-00ee40a23254 service swift] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:52:57.559570 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1068/2146] 10.222.0.58 () {60 vars in 1384 bytes} [Tue Oct 12 16:52:57 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 12 16:52:57.897653 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5f6d2e-eeac-4389-b274-6235dad88b76 None None] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:52:57.898131 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5f6d2e-eeac-4389-b274-6235dad88b76 None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:52:57.898238 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5f6d2e-eeac-4389-b274-6235dad88b76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:52:57.915859 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.auth.core [None req-4f5f6d2e-eeac-4389-b274-6235dad88b76 None None] MFA Rules not processed for user `387a65d2bfb142499c9b3b0ac946f48b`. Rule list: `[]` (Enabled: `True`). {{(pid=85204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:52:57.917041 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-4f5f6d2e-eeac-4389-b274-6235dad88b76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:52:57.924048 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1079/2147] 10.222.0.58 () {58 vars in 967 bytes} [Tue Oct 12 16:52:57 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:52:57.936376 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173d7963-aa19-4e6d-8dae-00ee40a23254 service swift] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:52:57.946580 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173d7963-aa19-4e6d-8dae-00ee40a23254 service swift] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:52:57.951675 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92eb35e2-707c-4804-b73f-0b0b5b46cd12 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdeb0a451344c9987b4134b957ffa22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:52:57.952326 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92eb35e2-707c-4804-b73f-0b0b5b46cd12 service swift] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:52:57.953108 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92eb35e2-707c-4804-b73f-0b0b5b46cd12 service swift] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:52:57.953386 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92eb35e2-707c-4804-b73f-0b0b5b46cd12 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:52:57.961449 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92eb35e2-707c-4804-b73f-0b0b5b46cd12 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:52:57.963059 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92eb35e2-707c-4804-b73f-0b0b5b46cd12 service swift] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:52:57.971648 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1069/2148] 10.222.0.58 () {60 vars in 1384 bytes} [Tue Oct 12 16:52:57 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 12 16:53:00.101836 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5f6d2e-eeac-4389-b274-6235dad88b76 None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:00.103328 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-4f5f6d2e-eeac-4389-b274-6235dad88b76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:00.170993 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5f6d2e-eeac-4389-b274-6235dad88b76 None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:00.177009 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb88cc7-d2bb-45eb-85f2-11734cc1c879 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:00.177908 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb88cc7-d2bb-45eb-85f2-11734cc1c879 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:00.178204 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb88cc7-d2bb-45eb-85f2-11734cc1c879 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:00.178483 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb88cc7-d2bb-45eb-85f2-11734cc1c879 admin admin] PATH_INFO: `/v3/users/dc31a321214744d48bc75160daede09d` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:00.179715 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb88cc7-d2bb-45eb-85f2-11734cc1c879 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dc31a321214744d48bc75160daede09d)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:00.181628 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb88cc7-d2bb-45eb-85f2-11734cc1c879 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:00.236802 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-5fb88cc7-d2bb-45eb-85f2-11734cc1c879 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dc31a321214744d48bc75160daede09d'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:53:00.249279 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-5fb88cc7-d2bb-45eb-85f2-11734cc1c879 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dc31a321214744d48bc75160daede09d'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:53:00.256970 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-5fb88cc7-d2bb-45eb-85f2-11734cc1c879 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dc31a321214744d48bc75160daede09d'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:53:00.264209 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-5fb88cc7-d2bb-45eb-85f2-11734cc1c879 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dc31a321214744d48bc75160daede09d'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:53:00.264853 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-5fb88cc7-d2bb-45eb-85f2-11734cc1c879 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dc31a321214744d48bc75160daede09d'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:53:00.270886 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1080/2149] 10.222.0.58 () {58 vars in 1223 bytes} [Tue Oct 12 16:53:00 2021] DELETE /identity/v3/users/dc31a321214744d48bc75160daede09d => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:53:00.275334 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29ecff1-e04b-4972-b716-c29aa8143c97 None None] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:00.275829 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29ecff1-e04b-4972-b716-c29aa8143c97 None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:00.275932 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29ecff1-e04b-4972-b716-c29aa8143c97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:00.293395 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.auth.core [None req-f29ecff1-e04b-4972-b716-c29aa8143c97 None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:53:00.294527 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-f29ecff1-e04b-4972-b716-c29aa8143c97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:00.352441 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1070/2150] 10.222.0.58 () {58 vars in 957 bytes} [Tue Oct 12 16:53:00 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:53:00.362853 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb88cc7-d2bb-45eb-85f2-11734cc1c879 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:00.364291 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-5fb88cc7-d2bb-45eb-85f2-11734cc1c879 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:00.419704 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb88cc7-d2bb-45eb-85f2-11734cc1c879 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:00.424003 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e58bc6-97da-4f9b-bf76-7867202547de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e65f6d0598e4c539134292b86fb43d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:00.424665 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e58bc6-97da-4f9b-bf76-7867202547de service neutron] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:00.424963 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e58bc6-97da-4f9b-bf76-7867202547de service neutron] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:00.425239 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e58bc6-97da-4f9b-bf76-7867202547de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:00.434057 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e58bc6-97da-4f9b-bf76-7867202547de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:00.435478 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e58bc6-97da-4f9b-bf76-7867202547de service neutron] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:00.444660 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1081/2151] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Oct 12 16:53:00 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:53:00.619421 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29ecff1-e04b-4972-b716-c29aa8143c97 None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:00.621129 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-f29ecff1-e04b-4972-b716-c29aa8143c97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:00.634635 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29ecff1-e04b-4972-b716-c29aa8143c97 None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:00.639793 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2008c9a-f2f0-40f8-89bf-9fbc1beb4051 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:00.641227 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2008c9a-f2f0-40f8-89bf-9fbc1beb4051 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:00.641508 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2008c9a-f2f0-40f8-89bf-9fbc1beb4051 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:00.642019 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2008c9a-f2f0-40f8-89bf-9fbc1beb4051 admin admin] PATH_INFO: `/v3/projects/8121321d3eef4620acf63504a9edc43f` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:00.643430 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2008c9a-f2f0-40f8-89bf-9fbc1beb4051 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8121321d3eef4620acf63504a9edc43f)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:00.645505 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2008c9a-f2f0-40f8-89bf-9fbc1beb4051 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:00.697009 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-c2008c9a-f2f0-40f8-89bf-9fbc1beb4051 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8121321d3eef4620acf63504a9edc43f', 'request_id': 'req-c2008c9a-f2f0-40f8-89bf-9fbc1beb4051'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:53:00.703588 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-c2008c9a-f2f0-40f8-89bf-9fbc1beb4051 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8121321d3eef4620acf63504a9edc43f', 'request_id': 'req-c2008c9a-f2f0-40f8-89bf-9fbc1beb4051'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:53:00.711410 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-c2008c9a-f2f0-40f8-89bf-9fbc1beb4051 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8121321d3eef4620acf63504a9edc43f', 'request_id': 'req-c2008c9a-f2f0-40f8-89bf-9fbc1beb4051'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:53:00.728493 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-c2008c9a-f2f0-40f8-89bf-9fbc1beb4051 admin admin] The token cache is being invalidate because project 8121321d3eef4620acf63504a9edc43f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=85205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 16:53:00.728786 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-c2008c9a-f2f0-40f8-89bf-9fbc1beb4051 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:53:00.729423 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-c2008c9a-f2f0-40f8-89bf-9fbc1beb4051 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:53:00.731009 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1071/2152] 10.222.0.58 () {58 vars in 1232 bytes} [Tue Oct 12 16:53:00 2021] DELETE /identity/v3/projects/8121321d3eef4620acf63504a9edc43f => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:53:05.464147 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54aaa27-10b3-43fb-a2fb-55095bdc8016 None None] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:05.464602 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54aaa27-10b3-43fb-a2fb-55095bdc8016 None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:05.464691 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54aaa27-10b3-43fb-a2fb-55095bdc8016 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:05.481710 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.auth.core [None req-d54aaa27-10b3-43fb-a2fb-55095bdc8016 None None] MFA Rules not processed for user `387a65d2bfb142499c9b3b0ac946f48b`. Rule list: `[]` (Enabled: `True`). {{(pid=85204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:53:05.482929 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-d54aaa27-10b3-43fb-a2fb-55095bdc8016 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:05.536492 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1082/2153] 10.222.0.58 () {58 vars in 967 bytes} [Tue Oct 12 16:53:05 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:53:05.549545 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2008c9a-f2f0-40f8-89bf-9fbc1beb4051 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:05.550990 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-c2008c9a-f2f0-40f8-89bf-9fbc1beb4051 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:05.627788 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2008c9a-f2f0-40f8-89bf-9fbc1beb4051 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:05.632668 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e986fd02-720e-4966-bc0a-7ed8079f262f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdeb0a451344c9987b4134b957ffa22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:05.633300 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e986fd02-720e-4966-bc0a-7ed8079f262f service swift] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:05.633586 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e986fd02-720e-4966-bc0a-7ed8079f262f service swift] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:05.633867 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e986fd02-720e-4966-bc0a-7ed8079f262f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:05.641625 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e986fd02-720e-4966-bc0a-7ed8079f262f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:05.643222 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e986fd02-720e-4966-bc0a-7ed8079f262f service swift] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:05.650938 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1072/2154] 10.222.0.58 () {60 vars in 1384 bytes} [Tue Oct 12 16:53:05 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 12 16:54:25.899283 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54aaa27-10b3-43fb-a2fb-55095bdc8016 None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:54:25.900668 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-d54aaa27-10b3-43fb-a2fb-55095bdc8016 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:54:25.970793 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54aaa27-10b3-43fb-a2fb-55095bdc8016 None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:54:25.976244 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fc8467-77c0-4f5f-a7a7-81aa0852d91f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29d30b574eec4ad3990d77d235c8b424', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:54:25.976883 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fc8467-77c0-4f5f-a7a7-81aa0852d91f service nova] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:54:25.977168 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fc8467-77c0-4f5f-a7a7-81aa0852d91f service nova] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:54:25.977447 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fc8467-77c0-4f5f-a7a7-81aa0852d91f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:54:25.979196 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-11fc8467-77c0-4f5f-a7a7-81aa0852d91f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:54:26.033631 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fc8467-77c0-4f5f-a7a7-81aa0852d91f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:54:26.035263 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fc8467-77c0-4f5f-a7a7-81aa0852d91f service nova] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:54:26.043979 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1083/2155] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Oct 12 16:54:25 2021] GET /identity/v3/auth/tokens => generated 3411 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:54:30.762004 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e986fd02-720e-4966-bc0a-7ed8079f262f service swift] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:54:30.774050 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e986fd02-720e-4966-bc0a-7ed8079f262f service swift] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:54:30.779622 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cccd3c2-253a-462b-9024-f1cd7cd63bc2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29d30b574eec4ad3990d77d235c8b424', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:54:30.780248 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cccd3c2-253a-462b-9024-f1cd7cd63bc2 service nova] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:54:30.780531 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cccd3c2-253a-462b-9024-f1cd7cd63bc2 service nova] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:54:30.780808 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cccd3c2-253a-462b-9024-f1cd7cd63bc2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:54:30.782547 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-2cccd3c2-253a-462b-9024-f1cd7cd63bc2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:54:30.838291 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cccd3c2-253a-462b-9024-f1cd7cd63bc2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:54:30.839857 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cccd3c2-253a-462b-9024-f1cd7cd63bc2 service nova] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:54:30.848570 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1073/2156] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Oct 12 16:54:30 2021] GET /identity/v3/auth/tokens => generated 3407 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 12 16:54:31.687676 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fc8467-77c0-4f5f-a7a7-81aa0852d91f service nova] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:54:31.689148 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-11fc8467-77c0-4f5f-a7a7-81aa0852d91f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:54:31.762672 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fc8467-77c0-4f5f-a7a7-81aa0852d91f service nova] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:54:31.766251 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6af39a-116d-4a75-819b-f8ec17af2419 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04704222b3d64a33a6c092fc641ccbb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:54:31.766888 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6af39a-116d-4a75-819b-f8ec17af2419 service cinder] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:54:31.767165 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6af39a-116d-4a75-819b-f8ec17af2419 service cinder] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:54:31.767433 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6af39a-116d-4a75-819b-f8ec17af2419 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:54:31.769669 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-5c6af39a-116d-4a75-819b-f8ec17af2419 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:54:31.828088 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6af39a-116d-4a75-819b-f8ec17af2419 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:54:31.829612 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6af39a-116d-4a75-819b-f8ec17af2419 service cinder] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:54:31.839248 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1084/2157] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Oct 12 16:54:31 2021] GET /identity/v3/auth/tokens => generated 3397 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:54:46.304788 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cccd3c2-253a-462b-9024-f1cd7cd63bc2 service nova] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:54:46.306241 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-2cccd3c2-253a-462b-9024-f1cd7cd63bc2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:54:46.359217 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cccd3c2-253a-462b-9024-f1cd7cd63bc2 service nova] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:54:46.363146 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837fbd45-6c63-4f59-9280-14b1289397a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e65f6d0598e4c539134292b86fb43d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:54:46.363803 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837fbd45-6c63-4f59-9280-14b1289397a5 service neutron] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:54:46.364089 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837fbd45-6c63-4f59-9280-14b1289397a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:54:46.364367 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837fbd45-6c63-4f59-9280-14b1289397a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:54:46.366183 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-837fbd45-6c63-4f59-9280-14b1289397a5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:54:46.379944 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837fbd45-6c63-4f59-9280-14b1289397a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:54:46.381345 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837fbd45-6c63-4f59-9280-14b1289397a5 service neutron] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:54:46.392712 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1074/2158] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Oct 12 16:54:46 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:54:48.912756 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6af39a-116d-4a75-819b-f8ec17af2419 service cinder] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:54:48.926488 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6af39a-116d-4a75-819b-f8ec17af2419 service cinder] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:54:48.933025 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadc7ee5-7647-4a7b-8cc8-708715ab1e1a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29d30b574eec4ad3990d77d235c8b424', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:54:48.934216 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadc7ee5-7647-4a7b-8cc8-708715ab1e1a service nova] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:54:48.935279 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadc7ee5-7647-4a7b-8cc8-708715ab1e1a service nova] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:54:48.935600 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadc7ee5-7647-4a7b-8cc8-708715ab1e1a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:54:48.938477 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-fadc7ee5-7647-4a7b-8cc8-708715ab1e1a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:54:48.952401 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadc7ee5-7647-4a7b-8cc8-708715ab1e1a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:54:48.954533 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadc7ee5-7647-4a7b-8cc8-708715ab1e1a service nova] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:54:48.965914 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1085/2159] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Oct 12 16:54:48 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:54:49.799867 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837fbd45-6c63-4f59-9280-14b1289397a5 service neutron] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:54:49.811253 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837fbd45-6c63-4f59-9280-14b1289397a5 service neutron] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:54:49.815882 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f1b3ae-0db7-4d99-a345-f4ae4c019a68 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e65f6d0598e4c539134292b86fb43d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:54:49.816647 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f1b3ae-0db7-4d99-a345-f4ae4c019a68 service neutron] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:54:49.817047 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f1b3ae-0db7-4d99-a345-f4ae4c019a68 service neutron] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:54:49.817424 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f1b3ae-0db7-4d99-a345-f4ae4c019a68 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:54:49.819433 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-65f1b3ae-0db7-4d99-a345-f4ae4c019a68 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:54:49.841275 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f1b3ae-0db7-4d99-a345-f4ae4c019a68 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:54:49.842909 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f1b3ae-0db7-4d99-a345-f4ae4c019a68 service neutron] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:54:49.855981 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1075/2160] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Oct 12 16:54:49 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:55:26.977479 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadc7ee5-7647-4a7b-8cc8-708715ab1e1a service nova] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:55:26.978990 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-fadc7ee5-7647-4a7b-8cc8-708715ab1e1a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:55:26.990207 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadc7ee5-7647-4a7b-8cc8-708715ab1e1a service nova] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:55:26.993931 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d794b84b-e854-48b7-aeb8-67a558eb45b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e65f6d0598e4c539134292b86fb43d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:55:26.994579 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d794b84b-e854-48b7-aeb8-67a558eb45b8 service neutron] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:55:26.994861 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d794b84b-e854-48b7-aeb8-67a558eb45b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:55:26.995140 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d794b84b-e854-48b7-aeb8-67a558eb45b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:55:26.997144 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-d794b84b-e854-48b7-aeb8-67a558eb45b8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:55:27.006627 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d794b84b-e854-48b7-aeb8-67a558eb45b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:55:27.007977 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d794b84b-e854-48b7-aeb8-67a558eb45b8 service neutron] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:55:27.015920 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1086/2161] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Oct 12 16:55:26 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:55:30.266273 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f1b3ae-0db7-4d99-a345-f4ae4c019a68 service neutron] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:55:30.277593 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f1b3ae-0db7-4d99-a345-f4ae4c019a68 service neutron] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:55:30.283696 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9468ee80-5436-4f86-9465-096aaefe7e76 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29d30b574eec4ad3990d77d235c8b424', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:55:30.284333 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9468ee80-5436-4f86-9465-096aaefe7e76 service nova] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:55:30.284622 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9468ee80-5436-4f86-9465-096aaefe7e76 service nova] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:55:30.284906 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9468ee80-5436-4f86-9465-096aaefe7e76 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:55:30.286714 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-9468ee80-5436-4f86-9465-096aaefe7e76 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:55:30.345714 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9468ee80-5436-4f86-9465-096aaefe7e76 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:55:30.347294 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9468ee80-5436-4f86-9465-096aaefe7e76 service nova] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:55:30.355970 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1076/2162] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Oct 12 16:55:30 2021] GET /identity/v3/auth/tokens => generated 3403 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:55:55.311572 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d794b84b-e854-48b7-aeb8-67a558eb45b8 service neutron] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:55:55.312983 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-d794b84b-e854-48b7-aeb8-67a558eb45b8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:55:55.328877 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d794b84b-e854-48b7-aeb8-67a558eb45b8 service neutron] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:55:55.335057 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7676c6-b1d8-47fc-9bd0-148c150c68f9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29d30b574eec4ad3990d77d235c8b424', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:55:55.335694 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7676c6-b1d8-47fc-9bd0-148c150c68f9 service nova] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:55:55.335978 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7676c6-b1d8-47fc-9bd0-148c150c68f9 service nova] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:55:55.336256 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7676c6-b1d8-47fc-9bd0-148c150c68f9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:55:55.337987 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-bb7676c6-b1d8-47fc-9bd0-148c150c68f9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:55:55.393951 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7676c6-b1d8-47fc-9bd0-148c150c68f9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:55:55.395518 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7676c6-b1d8-47fc-9bd0-148c150c68f9 service nova] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:55:55.404138 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1087/2163] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Oct 12 16:55:55 2021] GET /identity/v3/auth/tokens => generated 3397 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:55:58.913061 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9468ee80-5436-4f86-9465-096aaefe7e76 service nova] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:55:58.914558 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-9468ee80-5436-4f86-9465-096aaefe7e76 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:55:58.926370 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9468ee80-5436-4f86-9465-096aaefe7e76 service nova] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:55:58.930179 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8679c757-b0c3-4414-9763-b1d99f1d6465 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04704222b3d64a33a6c092fc641ccbb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:55:58.930890 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8679c757-b0c3-4414-9763-b1d99f1d6465 service cinder] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:55:58.931265 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8679c757-b0c3-4414-9763-b1d99f1d6465 service cinder] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:55:58.931597 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8679c757-b0c3-4414-9763-b1d99f1d6465 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:55:58.933410 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-8679c757-b0c3-4414-9763-b1d99f1d6465 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:55:58.991433 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8679c757-b0c3-4414-9763-b1d99f1d6465 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:55:58.992850 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8679c757-b0c3-4414-9763-b1d99f1d6465 service cinder] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:55:59.002433 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1077/2164] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Oct 12 16:55:58 2021] GET /identity/v3/auth/tokens => generated 3403 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:56:49.947315 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8f3a82-9b0c-41b6-a258-9932b2ebb5fa None None] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:56:49.947835 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8f3a82-9b0c-41b6-a258-9932b2ebb5fa None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:56:49.947936 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8f3a82-9b0c-41b6-a258-9932b2ebb5fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:56:49.964759 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.auth.core [None req-3a8f3a82-9b0c-41b6-a258-9932b2ebb5fa None None] MFA Rules not processed for user `9920dccb47544863ae7e8c0162c77c35`. Rule list: `[]` (Enabled: `True`). {{(pid=85204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:56:49.965981 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-3a8f3a82-9b0c-41b6-a258-9932b2ebb5fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:56:49.972684 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1088/2165] 10.222.0.58 () {58 vars in 957 bytes} [Tue Oct 12 16:56:49 2021] POST /identity/v3/auth/tokens => generated 3397 bytes in 26 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:56:50.271670 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8679c757-b0c3-4414-9763-b1d99f1d6465 service cinder] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:56:50.281220 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8679c757-b0c3-4414-9763-b1d99f1d6465 service cinder] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:56:50.284764 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09684614-2d43-43ed-a52f-651e0ec95a47 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e65f6d0598e4c539134292b86fb43d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:56:50.285395 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09684614-2d43-43ed-a52f-651e0ec95a47 service neutron] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:56:50.285679 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09684614-2d43-43ed-a52f-651e0ec95a47 service neutron] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:56:50.285995 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09684614-2d43-43ed-a52f-651e0ec95a47 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:56:50.287748 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-09684614-2d43-43ed-a52f-651e0ec95a47 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:56:50.297842 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09684614-2d43-43ed-a52f-651e0ec95a47 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:56:50.299287 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09684614-2d43-43ed-a52f-651e0ec95a47 service neutron] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:56:50.307118 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1078/2166] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Oct 12 16:56:50 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:58:31.278168 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8f3a82-9b0c-41b6-a258-9932b2ebb5fa None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:58:31.279638 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-3a8f3a82-9b0c-41b6-a258-9932b2ebb5fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:58:31.345104 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8f3a82-9b0c-41b6-a258-9932b2ebb5fa None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:58:31.350411 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a34dd09-9af7-4322-a2da-9d477a123e73 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4102412c40bc4745bba8c31f1caf9788', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:58:31.351053 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a34dd09-9af7-4322-a2da-9d477a123e73 service placement] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:58:31.351337 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a34dd09-9af7-4322-a2da-9d477a123e73 service placement] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:58:31.351613 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a34dd09-9af7-4322-a2da-9d477a123e73 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:58:31.353392 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-2a34dd09-9af7-4322-a2da-9d477a123e73 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:58:31.364885 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a34dd09-9af7-4322-a2da-9d477a123e73 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:58:31.366486 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a34dd09-9af7-4322-a2da-9d477a123e73 service placement] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:58:31.377381 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1089/2167] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Oct 12 16:58:31 2021] GET /identity/v3/auth/tokens => generated 3451 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:59:26.161579 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09684614-2d43-43ed-a52f-651e0ec95a47 service neutron] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:59:26.171646 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09684614-2d43-43ed-a52f-651e0ec95a47 service neutron] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:59:26.176544 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deeeb68e-fab1-41c0-b2d1-d0b49707fec7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04704222b3d64a33a6c092fc641ccbb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:59:26.177174 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deeeb68e-fab1-41c0-b2d1-d0b49707fec7 service cinder] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:59:26.177452 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deeeb68e-fab1-41c0-b2d1-d0b49707fec7 service cinder] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:59:26.177725 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deeeb68e-fab1-41c0-b2d1-d0b49707fec7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:59:26.186571 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deeeb68e-fab1-41c0-b2d1-d0b49707fec7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:59:26.187954 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deeeb68e-fab1-41c0-b2d1-d0b49707fec7 service cinder] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:59:26.213374 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1079/2168] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Oct 12 16:59:26 2021] GET /identity/v3/auth/tokens => generated 3411 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:59:30.908237 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a34dd09-9af7-4322-a2da-9d477a123e73 service placement] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:59:30.921645 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a34dd09-9af7-4322-a2da-9d477a123e73 service placement] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:59:30.928378 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4947deaa-3591-415d-8d4b-44e6b33085c4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29d30b574eec4ad3990d77d235c8b424', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:59:30.929019 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4947deaa-3591-415d-8d4b-44e6b33085c4 service nova] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:59:30.929784 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4947deaa-3591-415d-8d4b-44e6b33085c4 service nova] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:59:30.929784 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4947deaa-3591-415d-8d4b-44e6b33085c4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:59:30.938695 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4947deaa-3591-415d-8d4b-44e6b33085c4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:59:30.940253 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4947deaa-3591-415d-8d4b-44e6b33085c4 service nova] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:59:30.966289 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1090/2169] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Oct 12 16:59:30 2021] GET /identity/v3/auth/tokens => generated 3407 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:59:32.733242 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deeeb68e-fab1-41c0-b2d1-d0b49707fec7 service cinder] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:59:32.745338 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deeeb68e-fab1-41c0-b2d1-d0b49707fec7 service cinder] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:59:32.751136 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7e01e9-5b7a-4cb5-be20-7866e1c62f8c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29d30b574eec4ad3990d77d235c8b424', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:59:32.751771 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7e01e9-5b7a-4cb5-be20-7866e1c62f8c service nova] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:59:32.752058 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7e01e9-5b7a-4cb5-be20-7866e1c62f8c service nova] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:59:32.752333 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7e01e9-5b7a-4cb5-be20-7866e1c62f8c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:59:32.760099 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7e01e9-5b7a-4cb5-be20-7866e1c62f8c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:59:32.761651 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7e01e9-5b7a-4cb5-be20-7866e1c62f8c service nova] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:59:32.788655 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1080/2170] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Oct 12 16:59:32 2021] GET /identity/v3/auth/tokens => generated 3397 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 17:00:30.372041 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4947deaa-3591-415d-8d4b-44e6b33085c4 service nova] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:00:30.381533 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4947deaa-3591-415d-8d4b-44e6b33085c4 service nova] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:00:30.385106 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1311ff-682c-4070-9d1a-dc92e64db055 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04704222b3d64a33a6c092fc641ccbb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:00:30.385739 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1311ff-682c-4070-9d1a-dc92e64db055 service cinder] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:00:30.386072 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1311ff-682c-4070-9d1a-dc92e64db055 service cinder] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:00:30.386338 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1311ff-682c-4070-9d1a-dc92e64db055 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:00:30.395002 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1311ff-682c-4070-9d1a-dc92e64db055 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:00:30.396403 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1311ff-682c-4070-9d1a-dc92e64db055 service cinder] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:00:30.404957 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1091/2171] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Oct 12 17:00:30 2021] GET /identity/v3/auth/tokens => generated 3403 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 17:00:34.952156 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7e01e9-5b7a-4cb5-be20-7866e1c62f8c service nova] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:00:34.961167 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7e01e9-5b7a-4cb5-be20-7866e1c62f8c service nova] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:00:34.964750 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab36c12e-1f2a-48ed-b1d0-342effb88363 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e65f6d0598e4c539134292b86fb43d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:00:34.965410 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab36c12e-1f2a-48ed-b1d0-342effb88363 service neutron] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:00:34.965695 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab36c12e-1f2a-48ed-b1d0-342effb88363 service neutron] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:00:34.966008 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab36c12e-1f2a-48ed-b1d0-342effb88363 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:00:34.972959 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab36c12e-1f2a-48ed-b1d0-342effb88363 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:00:34.974391 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab36c12e-1f2a-48ed-b1d0-342effb88363 service neutron] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:00:34.981943 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1081/2172] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Oct 12 17:00:34 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 30 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 17:00:55.052713 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1311ff-682c-4070-9d1a-dc92e64db055 service cinder] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:00:55.061124 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1311ff-682c-4070-9d1a-dc92e64db055 service cinder] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:00:55.064688 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b376b0-d065-4bc5-93d9-2203108c61e5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04704222b3d64a33a6c092fc641ccbb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:00:55.065316 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b376b0-d065-4bc5-93d9-2203108c61e5 service cinder] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:00:55.065596 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b376b0-d065-4bc5-93d9-2203108c61e5 service cinder] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:00:55.065868 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b376b0-d065-4bc5-93d9-2203108c61e5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:00:55.073669 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b376b0-d065-4bc5-93d9-2203108c61e5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:00:55.075102 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b376b0-d065-4bc5-93d9-2203108c61e5 service cinder] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:00:55.102528 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1092/2173] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Oct 12 17:00:55 2021] GET /identity/v3/auth/tokens => generated 3397 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 17:00:59.954581 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab36c12e-1f2a-48ed-b1d0-342effb88363 service neutron] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:00:59.963565 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab36c12e-1f2a-48ed-b1d0-342effb88363 service neutron] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:00:59.967401 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f38656-4216-4626-81eb-940b222f2060 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04704222b3d64a33a6c092fc641ccbb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:00:59.968019 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f38656-4216-4626-81eb-940b222f2060 service cinder] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:00:59.968299 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f38656-4216-4626-81eb-940b222f2060 service cinder] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:00:59.968570 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f38656-4216-4626-81eb-940b222f2060 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:00:59.977144 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f38656-4216-4626-81eb-940b222f2060 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:00:59.978570 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f38656-4216-4626-81eb-940b222f2060 service cinder] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:01:00.004767 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1082/2174] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Oct 12 17:00:59 2021] GET /identity/v3/auth/tokens => generated 3403 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 17:02:52.087538 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b376b0-d065-4bc5-93d9-2203108c61e5 service cinder] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:02:52.128931 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b376b0-d065-4bc5-93d9-2203108c61e5 service cinder] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:02:52.133150 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86708745-2955-4c95-a616-3993ec8b9b6f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e65f6d0598e4c539134292b86fb43d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:02:52.133804 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86708745-2955-4c95-a616-3993ec8b9b6f service neutron] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:02:52.134124 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86708745-2955-4c95-a616-3993ec8b9b6f service neutron] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:02:52.134402 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86708745-2955-4c95-a616-3993ec8b9b6f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:02:52.136199 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-86708745-2955-4c95-a616-3993ec8b9b6f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:02:52.245704 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86708745-2955-4c95-a616-3993ec8b9b6f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:02:52.247167 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86708745-2955-4c95-a616-3993ec8b9b6f service neutron] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:02:52.267253 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1093/2175] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Oct 12 17:02:52 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 17:02:58.857222 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f38656-4216-4626-81eb-940b222f2060 service cinder] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:02:58.859674 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-20f38656-4216-4626-81eb-940b222f2060 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:02:58.900631 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f38656-4216-4626-81eb-940b222f2060 service cinder] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:02:58.905369 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716e9c62-1935-4bb0-8534-82bd50e8e64c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:02:58.906291 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716e9c62-1935-4bb0-8534-82bd50e8e64c admin admin] REQUEST_METHOD: `DELETE` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:02:58.906580 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716e9c62-1935-4bb0-8534-82bd50e8e64c admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:02:58.906915 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716e9c62-1935-4bb0-8534-82bd50e8e64c admin admin] PATH_INFO: `/v3/users/9920dccb47544863ae7e8c0162c77c35` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:02:58.922348 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716e9c62-1935-4bb0-8534-82bd50e8e64c admin admin] RBAC: Authorizing `identity:delete_user(user_id=9920dccb47544863ae7e8c0162c77c35)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:02:58.924326 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716e9c62-1935-4bb0-8534-82bd50e8e64c admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:02:58.971353 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-716e9c62-1935-4bb0-8534-82bd50e8e64c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9920dccb47544863ae7e8c0162c77c35'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:02:58.983264 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-716e9c62-1935-4bb0-8534-82bd50e8e64c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9920dccb47544863ae7e8c0162c77c35'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:02:58.990080 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-716e9c62-1935-4bb0-8534-82bd50e8e64c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9920dccb47544863ae7e8c0162c77c35'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:02:58.996902 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-716e9c62-1935-4bb0-8534-82bd50e8e64c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9920dccb47544863ae7e8c0162c77c35'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:02:58.997551 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-716e9c62-1935-4bb0-8534-82bd50e8e64c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9920dccb47544863ae7e8c0162c77c35'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:02:59.004286 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1083/2176] 10.222.0.58 () {58 vars in 1223 bytes} [Tue Oct 12 17:02:58 2021] DELETE /identity/v3/users/9920dccb47544863ae7e8c0162c77c35 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 17:02:59.184124 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86708745-2955-4c95-a616-3993ec8b9b6f service neutron] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:02:59.194617 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86708745-2955-4c95-a616-3993ec8b9b6f service neutron] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:02:59.249361 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0384fe35-ab9d-4aaf-b799-04412b58cca5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:02:59.250257 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0384fe35-ab9d-4aaf-b799-04412b58cca5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:02:59.250539 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0384fe35-ab9d-4aaf-b799-04412b58cca5 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:02:59.250812 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0384fe35-ab9d-4aaf-b799-04412b58cca5 admin admin] PATH_INFO: `/v3/projects/fa94f0777efa4b4ab427769cdbbb82f6` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:02:59.252019 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0384fe35-ab9d-4aaf-b799-04412b58cca5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fa94f0777efa4b4ab427769cdbbb82f6)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:02:59.254421 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0384fe35-ab9d-4aaf-b799-04412b58cca5 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:02:59.297418 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-0384fe35-ab9d-4aaf-b799-04412b58cca5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa94f0777efa4b4ab427769cdbbb82f6', 'request_id': 'req-0384fe35-ab9d-4aaf-b799-04412b58cca5'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:02:59.302842 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-0384fe35-ab9d-4aaf-b799-04412b58cca5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa94f0777efa4b4ab427769cdbbb82f6', 'request_id': 'req-0384fe35-ab9d-4aaf-b799-04412b58cca5'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:02:59.308597 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-0384fe35-ab9d-4aaf-b799-04412b58cca5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa94f0777efa4b4ab427769cdbbb82f6', 'request_id': 'req-0384fe35-ab9d-4aaf-b799-04412b58cca5'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:02:59.320456 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-0384fe35-ab9d-4aaf-b799-04412b58cca5 admin admin] The token cache is being invalidate because project fa94f0777efa4b4ab427769cdbbb82f6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=85204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 17:02:59.320747 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-0384fe35-ab9d-4aaf-b799-04412b58cca5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:02:59.321365 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-0384fe35-ab9d-4aaf-b799-04412b58cca5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:02:59.322876 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1094/2177] 10.222.0.58 () {58 vars in 1232 bytes} [Tue Oct 12 17:02:59 2021] DELETE /identity/v3/projects/fa94f0777efa4b4ab427769cdbbb82f6 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 17:02:59.326801 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716e9c62-1935-4bb0-8534-82bd50e8e64c admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:02:59.328415 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-716e9c62-1935-4bb0-8534-82bd50e8e64c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:02:59.341767 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716e9c62-1935-4bb0-8534-82bd50e8e64c admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:02:59.398537 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6580aac-e994-4abb-9218-0b9099eccbda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:02:59.399399 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6580aac-e994-4abb-9218-0b9099eccbda admin admin] REQUEST_METHOD: `DELETE` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:02:59.399683 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6580aac-e994-4abb-9218-0b9099eccbda admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:02:59.399957 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6580aac-e994-4abb-9218-0b9099eccbda admin admin] PATH_INFO: `/v3/users/872958f683df4a478d07aadc8ea3405b` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:02:59.412578 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6580aac-e994-4abb-9218-0b9099eccbda admin admin] RBAC: Authorizing `identity:delete_user(user_id=872958f683df4a478d07aadc8ea3405b)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:02:59.414444 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6580aac-e994-4abb-9218-0b9099eccbda admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:02:59.458807 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-e6580aac-e994-4abb-9218-0b9099eccbda admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '872958f683df4a478d07aadc8ea3405b'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:02:59.470290 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-e6580aac-e994-4abb-9218-0b9099eccbda admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '872958f683df4a478d07aadc8ea3405b'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:02:59.477503 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-e6580aac-e994-4abb-9218-0b9099eccbda admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '872958f683df4a478d07aadc8ea3405b'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:02:59.484379 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-e6580aac-e994-4abb-9218-0b9099eccbda admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '872958f683df4a478d07aadc8ea3405b'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:02:59.485047 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-e6580aac-e994-4abb-9218-0b9099eccbda admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '872958f683df4a478d07aadc8ea3405b'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:02:59.490764 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1084/2178] 10.222.0.58 () {58 vars in 1223 bytes} [Tue Oct 12 17:02:59 2021] DELETE /identity/v3/users/872958f683df4a478d07aadc8ea3405b => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 17:02:59.658847 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0384fe35-ab9d-4aaf-b799-04412b58cca5 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:02:59.660488 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-0384fe35-ab9d-4aaf-b799-04412b58cca5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:02:59.672887 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0384fe35-ab9d-4aaf-b799-04412b58cca5 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:02:59.731543 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf45b5e2-652f-445f-a528-fea803ad8867 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:02:59.732396 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf45b5e2-652f-445f-a528-fea803ad8867 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:02:59.732681 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf45b5e2-652f-445f-a528-fea803ad8867 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:02:59.732957 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf45b5e2-652f-445f-a528-fea803ad8867 admin admin] PATH_INFO: `/v3/projects/54b5aeef626c4860b1bef7af31feddee` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:02:59.744059 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf45b5e2-652f-445f-a528-fea803ad8867 admin admin] RBAC: Authorizing `identity:delete_project(project_id=54b5aeef626c4860b1bef7af31feddee)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:02:59.746150 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf45b5e2-652f-445f-a528-fea803ad8867 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:02:59.788805 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-cf45b5e2-652f-445f-a528-fea803ad8867 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '54b5aeef626c4860b1bef7af31feddee', 'request_id': 'req-cf45b5e2-652f-445f-a528-fea803ad8867'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:02:59.793994 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-cf45b5e2-652f-445f-a528-fea803ad8867 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '54b5aeef626c4860b1bef7af31feddee', 'request_id': 'req-cf45b5e2-652f-445f-a528-fea803ad8867'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:02:59.800102 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-cf45b5e2-652f-445f-a528-fea803ad8867 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '54b5aeef626c4860b1bef7af31feddee', 'request_id': 'req-cf45b5e2-652f-445f-a528-fea803ad8867'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:02:59.812354 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-cf45b5e2-652f-445f-a528-fea803ad8867 admin admin] The token cache is being invalidate because project 54b5aeef626c4860b1bef7af31feddee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=85204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 17:02:59.812637 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-cf45b5e2-652f-445f-a528-fea803ad8867 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:02:59.813255 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-cf45b5e2-652f-445f-a528-fea803ad8867 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:02:59.814795 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1095/2179] 10.222.0.58 () {58 vars in 1232 bytes} [Tue Oct 12 17:02:59 2021] DELETE /identity/v3/projects/54b5aeef626c4860b1bef7af31feddee => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 17:03:37.869482 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6580aac-e994-4abb-9218-0b9099eccbda admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:03:37.870964 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-e6580aac-e994-4abb-9218-0b9099eccbda admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:03:37.957581 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6580aac-e994-4abb-9218-0b9099eccbda admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:03:38.013668 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad980f9-b00e-4059-aa63-cbbfc2a1143d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4102412c40bc4745bba8c31f1caf9788', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:03:38.014348 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad980f9-b00e-4059-aa63-cbbfc2a1143d service placement] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:03:38.014631 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad980f9-b00e-4059-aa63-cbbfc2a1143d service placement] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:03:38.014911 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad980f9-b00e-4059-aa63-cbbfc2a1143d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:03:38.016942 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-bad980f9-b00e-4059-aa63-cbbfc2a1143d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:03:38.027737 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad980f9-b00e-4059-aa63-cbbfc2a1143d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:03:38.029332 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad980f9-b00e-4059-aa63-cbbfc2a1143d service placement] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:03:38.038959 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1085/2180] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Oct 12 17:03:37 2021] GET /identity/v3/auth/tokens => generated 3451 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 17:04:26.231702 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf45b5e2-652f-445f-a528-fea803ad8867 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:04:26.233191 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-cf45b5e2-652f-445f-a528-fea803ad8867 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:04:26.287539 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf45b5e2-652f-445f-a528-fea803ad8867 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:04:26.291160 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dbef6b-7098-4318-8c0e-f68e0df02bf3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04704222b3d64a33a6c092fc641ccbb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:04:26.291798 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dbef6b-7098-4318-8c0e-f68e0df02bf3 service cinder] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:04:26.292081 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dbef6b-7098-4318-8c0e-f68e0df02bf3 service cinder] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:04:26.292353 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dbef6b-7098-4318-8c0e-f68e0df02bf3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:04:26.294143 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-d2dbef6b-7098-4318-8c0e-f68e0df02bf3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:04:26.358777 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2dbef6b-7098-4318-8c0e-f68e0df02bf3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:04:26.360256 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2dbef6b-7098-4318-8c0e-f68e0df02bf3 service cinder] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:04:26.368731 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1096/2181] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Oct 12 17:04:26 2021] GET /identity/v3/auth/tokens => generated 3411 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 17:04:31.357693 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad980f9-b00e-4059-aa63-cbbfc2a1143d service placement] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:04:31.359218 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-bad980f9-b00e-4059-aa63-cbbfc2a1143d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:04:31.370529 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad980f9-b00e-4059-aa63-cbbfc2a1143d service placement] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:04:31.374090 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d68c5e-ec14-4cda-9815-190732d80ee5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04704222b3d64a33a6c092fc641ccbb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:04:31.374714 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d68c5e-ec14-4cda-9815-190732d80ee5 service cinder] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:04:31.374994 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d68c5e-ec14-4cda-9815-190732d80ee5 service cinder] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:04:31.375268 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d68c5e-ec14-4cda-9815-190732d80ee5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:04:31.376914 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-10d68c5e-ec14-4cda-9815-190732d80ee5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:04:31.445408 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d68c5e-ec14-4cda-9815-190732d80ee5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:04:31.446833 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d68c5e-ec14-4cda-9815-190732d80ee5 service cinder] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:04:31.455987 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1086/2182] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Oct 12 17:04:31 2021] GET /identity/v3/auth/tokens => generated 3407 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 17:04:32.754643 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dbef6b-7098-4318-8c0e-f68e0df02bf3 service cinder] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:04:32.756075 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-d2dbef6b-7098-4318-8c0e-f68e0df02bf3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:04:32.851095 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dbef6b-7098-4318-8c0e-f68e0df02bf3 service cinder] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:04:32.857101 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c991a7e-8748-4699-b91e-ba7b529faf4d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29d30b574eec4ad3990d77d235c8b424', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:04:32.857743 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c991a7e-8748-4699-b91e-ba7b529faf4d service nova] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:04:32.858063 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c991a7e-8748-4699-b91e-ba7b529faf4d service nova] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:04:32.858339 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c991a7e-8748-4699-b91e-ba7b529faf4d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:04:32.860096 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-7c991a7e-8748-4699-b91e-ba7b529faf4d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:04:32.927479 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c991a7e-8748-4699-b91e-ba7b529faf4d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:04:32.928363 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c991a7e-8748-4699-b91e-ba7b529faf4d service nova] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:04:32.937833 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1097/2183] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Oct 12 17:04:32 2021] GET /identity/v3/auth/tokens => generated 3397 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 17:05:00.481996 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d68c5e-ec14-4cda-9815-190732d80ee5 service cinder] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:05:00.483952 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-10d68c5e-ec14-4cda-9815-190732d80ee5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:05:00.547472 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d68c5e-ec14-4cda-9815-190732d80ee5 service cinder] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:05:00.551024 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cc7d99-3786-457e-9104-0de5f7d585a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e65f6d0598e4c539134292b86fb43d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:05:00.551650 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cc7d99-3786-457e-9104-0de5f7d585a6 service neutron] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:05:00.551928 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cc7d99-3786-457e-9104-0de5f7d585a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:05:00.552202 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cc7d99-3786-457e-9104-0de5f7d585a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:05:00.553921 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-67cc7d99-3786-457e-9104-0de5f7d585a6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:05:00.566387 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cc7d99-3786-457e-9104-0de5f7d585a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:05:00.567761 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cc7d99-3786-457e-9104-0de5f7d585a6 service neutron] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:05:00.578593 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1087/2184] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Oct 12 17:05:00 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 17:05:01.705688 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c991a7e-8748-4699-b91e-ba7b529faf4d service nova] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:05:01.707144 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-7c991a7e-8748-4699-b91e-ba7b529faf4d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:05:01.722112 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c991a7e-8748-4699-b91e-ba7b529faf4d service nova] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:05:01.727747 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf6e5fe-7ca1-4336-b1a2-74ee25267679 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29d30b574eec4ad3990d77d235c8b424', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:05:01.729847 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf6e5fe-7ca1-4336-b1a2-74ee25267679 service nova] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:05:01.730665 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf6e5fe-7ca1-4336-b1a2-74ee25267679 service nova] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:05:01.730841 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf6e5fe-7ca1-4336-b1a2-74ee25267679 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:05:01.733667 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-0bf6e5fe-7ca1-4336-b1a2-74ee25267679 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:05:01.747310 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf6e5fe-7ca1-4336-b1a2-74ee25267679 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:05:01.749079 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf6e5fe-7ca1-4336-b1a2-74ee25267679 service nova] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:05:01.760331 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1098/2185] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Oct 12 17:05:01 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 12 17:05:02.860815 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cc7d99-3786-457e-9104-0de5f7d585a6 service neutron] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:05:02.869202 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cc7d99-3786-457e-9104-0de5f7d585a6 service neutron] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:05:02.873499 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112926ba-c923-4cb7-8183-decbcbc73fff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e65f6d0598e4c539134292b86fb43d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:05:02.874164 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112926ba-c923-4cb7-8183-decbcbc73fff service neutron] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:05:02.874450 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112926ba-c923-4cb7-8183-decbcbc73fff service neutron] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:05:02.874726 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112926ba-c923-4cb7-8183-decbcbc73fff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:05:02.876480 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-112926ba-c923-4cb7-8183-decbcbc73fff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:05:02.889812 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112926ba-c923-4cb7-8183-decbcbc73fff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:05:02.891232 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112926ba-c923-4cb7-8183-decbcbc73fff service neutron] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:05:02.901594 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1088/2186] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Oct 12 17:05:02 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 17:05:30.627782 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf6e5fe-7ca1-4336-b1a2-74ee25267679 service nova] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:05:30.645967 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf6e5fe-7ca1-4336-b1a2-74ee25267679 service nova] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:05:30.649492 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9098163-7008-4a74-8c2c-87a332cb455f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04704222b3d64a33a6c092fc641ccbb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:05:30.650151 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9098163-7008-4a74-8c2c-87a332cb455f service cinder] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:05:30.650431 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9098163-7008-4a74-8c2c-87a332cb455f service cinder] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:05:30.650702 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9098163-7008-4a74-8c2c-87a332cb455f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:05:30.652441 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-c9098163-7008-4a74-8c2c-87a332cb455f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:05:30.735475 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9098163-7008-4a74-8c2c-87a332cb455f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:05:30.736884 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9098163-7008-4a74-8c2c-87a332cb455f service cinder] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:05:30.754719 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1099/2187] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Oct 12 17:05:30 2021] GET /identity/v3/auth/tokens => generated 3403 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 17:05:39.931783 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112926ba-c923-4cb7-8183-decbcbc73fff service neutron] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:05:39.933284 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-112926ba-c923-4cb7-8183-decbcbc73fff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:05:39.944323 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112926ba-c923-4cb7-8183-decbcbc73fff service neutron] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:05:39.947962 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3204576-7cbf-4755-a1c5-573c26972b62 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e65f6d0598e4c539134292b86fb43d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:05:39.948604 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3204576-7cbf-4755-a1c5-573c26972b62 service neutron] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:05:39.948888 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3204576-7cbf-4755-a1c5-573c26972b62 service neutron] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:05:39.949165 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3204576-7cbf-4755-a1c5-573c26972b62 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:05:39.950922 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-d3204576-7cbf-4755-a1c5-573c26972b62 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:05:39.959752 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3204576-7cbf-4755-a1c5-573c26972b62 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:05:39.961146 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3204576-7cbf-4755-a1c5-573c26972b62 service neutron] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:05:39.968662 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1089/2188] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Oct 12 17:05:39 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 17:06:00.729390 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9098163-7008-4a74-8c2c-87a332cb455f service cinder] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:06:00.741324 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9098163-7008-4a74-8c2c-87a332cb455f service cinder] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:06:00.746624 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14241a6e-6e3d-401b-ba2d-7d1c3690ca24 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29d30b574eec4ad3990d77d235c8b424', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:06:00.747255 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14241a6e-6e3d-401b-ba2d-7d1c3690ca24 service nova] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:06:00.747552 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14241a6e-6e3d-401b-ba2d-7d1c3690ca24 service nova] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:06:00.747804 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14241a6e-6e3d-401b-ba2d-7d1c3690ca24 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:06:00.749543 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-14241a6e-6e3d-401b-ba2d-7d1c3690ca24 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:06:00.816148 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14241a6e-6e3d-401b-ba2d-7d1c3690ca24 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:06:00.817724 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14241a6e-6e3d-401b-ba2d-7d1c3690ca24 service nova] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:06:00.826415 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1100/2189] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Oct 12 17:06:00 2021] GET /identity/v3/auth/tokens => generated 3403 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 17:07:02.118782 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b6da0b-2d56-44dc-9e84-a6e180f566ff None None] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:07:02.119382 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b6da0b-2d56-44dc-9e84-a6e180f566ff None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:07:02.119382 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b6da0b-2d56-44dc-9e84-a6e180f566ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:07:02.146148 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.auth.core [None req-25b6da0b-2d56-44dc-9e84-a6e180f566ff None None] MFA Rules not processed for user `fac2e7e3088b4863b65bd9310b878229`. Rule list: `[]` (Enabled: `True`). {{(pid=85205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 17:07:02.147358 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-25b6da0b-2d56-44dc-9e84-a6e180f566ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:07:02.155465 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1090/2190] 10.222.0.58 () {58 vars in 957 bytes} [Tue Oct 12 17:07:02 2021] POST /identity/v3/auth/tokens => generated 3403 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 17:07:02.413790 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14241a6e-6e3d-401b-ba2d-7d1c3690ca24 service nova] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:07:02.423517 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14241a6e-6e3d-401b-ba2d-7d1c3690ca24 service nova] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:07:02.427068 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36d9ee7-1be0-43ab-8aa7-75252ea145fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e65f6d0598e4c539134292b86fb43d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:07:02.427696 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36d9ee7-1be0-43ab-8aa7-75252ea145fb service neutron] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:07:02.427974 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36d9ee7-1be0-43ab-8aa7-75252ea145fb service neutron] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:07:02.428244 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36d9ee7-1be0-43ab-8aa7-75252ea145fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:07:02.430025 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-c36d9ee7-1be0-43ab-8aa7-75252ea145fb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:07:02.438942 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36d9ee7-1be0-43ab-8aa7-75252ea145fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:07:02.440332 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36d9ee7-1be0-43ab-8aa7-75252ea145fb service neutron] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:07:02.447835 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1101/2191] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Oct 12 17:07:02 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 17:07:02.754838 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b6da0b-2d56-44dc-9e84-a6e180f566ff None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:07:02.756298 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-25b6da0b-2d56-44dc-9e84-a6e180f566ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:07:02.771296 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b6da0b-2d56-44dc-9e84-a6e180f566ff None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:07:02.776929 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d07cdb-bfdf-4607-8656-e8dbf1fa20bb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4102412c40bc4745bba8c31f1caf9788', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:07:02.777566 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d07cdb-bfdf-4607-8656-e8dbf1fa20bb service placement] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:07:02.777846 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d07cdb-bfdf-4607-8656-e8dbf1fa20bb service placement] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:07:02.778150 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d07cdb-bfdf-4607-8656-e8dbf1fa20bb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:07:02.779884 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-86d07cdb-bfdf-4607-8656-e8dbf1fa20bb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:07:02.791285 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d07cdb-bfdf-4607-8656-e8dbf1fa20bb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:07:02.792835 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d07cdb-bfdf-4607-8656-e8dbf1fa20bb service placement] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:07:02.809618 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1091/2192] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Oct 12 17:07:02 2021] GET /identity/v3/auth/tokens => generated 3451 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 17:07:10.695940 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36d9ee7-1be0-43ab-8aa7-75252ea145fb service neutron] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:07:10.710966 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36d9ee7-1be0-43ab-8aa7-75252ea145fb service neutron] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:07:10.717174 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b47433-9f4c-4895-aebf-5784f14d049b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29d30b574eec4ad3990d77d235c8b424', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:07:10.717945 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b47433-9f4c-4895-aebf-5784f14d049b service nova] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:07:10.718296 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b47433-9f4c-4895-aebf-5784f14d049b service nova] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:07:10.718634 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b47433-9f4c-4895-aebf-5784f14d049b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:07:10.720464 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-87b47433-9f4c-4895-aebf-5784f14d049b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:07:10.733711 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b47433-9f4c-4895-aebf-5784f14d049b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:07:10.735523 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b47433-9f4c-4895-aebf-5784f14d049b service nova] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:07:10.750522 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1102/2193] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Oct 12 17:07:10 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 17:07:53.772721 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6c47f7-b7ca-485e-9d7d-2ffaad39dd2a None None] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:07:53.773241 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6c47f7-b7ca-485e-9d7d-2ffaad39dd2a None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:07:53.773361 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6c47f7-b7ca-485e-9d7d-2ffaad39dd2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:07:53.799360 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.auth.core [None req-3e6c47f7-b7ca-485e-9d7d-2ffaad39dd2a None None] MFA Rules not processed for user `69c3a35689e540b09d83fd072d5011b7`. Rule list: `[]` (Enabled: `True`). {{(pid=85205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 17:07:53.800566 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-3e6c47f7-b7ca-485e-9d7d-2ffaad39dd2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:07:53.807699 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1092/2194] 10.222.0.58 () {58 vars in 957 bytes} [Tue Oct 12 17:07:53 2021] POST /identity/v3/auth/tokens => generated 3407 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 17:08:06.043159 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b47433-9f4c-4895-aebf-5784f14d049b service nova] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:08:06.056504 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b47433-9f4c-4895-aebf-5784f14d049b service nova] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:08:06.062285 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac499c2-69a7-4b90-8c64-60ad818e9561 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29d30b574eec4ad3990d77d235c8b424', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:08:06.062928 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac499c2-69a7-4b90-8c64-60ad818e9561 service nova] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:08:06.063209 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac499c2-69a7-4b90-8c64-60ad818e9561 service nova] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:08:06.063483 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac499c2-69a7-4b90-8c64-60ad818e9561 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:08:06.065231 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-0ac499c2-69a7-4b90-8c64-60ad818e9561 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:08:06.078373 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac499c2-69a7-4b90-8c64-60ad818e9561 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:08:06.079934 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac499c2-69a7-4b90-8c64-60ad818e9561 service nova] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:08:06.092073 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1103/2195] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Oct 12 17:08:06 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 17:08:46.265929 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6c47f7-b7ca-485e-9d7d-2ffaad39dd2a None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:08:46.280739 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6c47f7-b7ca-485e-9d7d-2ffaad39dd2a None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:08:46.288076 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261b8948-8db0-4cc1-ad3c-f141895eca4a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4102412c40bc4745bba8c31f1caf9788', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:08:46.288719 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261b8948-8db0-4cc1-ad3c-f141895eca4a service placement] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:08:46.289005 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261b8948-8db0-4cc1-ad3c-f141895eca4a service placement] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:08:46.289280 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261b8948-8db0-4cc1-ad3c-f141895eca4a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:08:46.300167 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261b8948-8db0-4cc1-ad3c-f141895eca4a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:08:46.301724 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261b8948-8db0-4cc1-ad3c-f141895eca4a service placement] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:08:46.311225 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1093/2196] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Oct 12 17:08:46 2021] GET /identity/v3/auth/tokens => generated 3451 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 17:09:26.711251 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac499c2-69a7-4b90-8c64-60ad818e9561 service nova] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:09:26.721013 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac499c2-69a7-4b90-8c64-60ad818e9561 service nova] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:09:26.724588 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7667517-0191-4d37-bb7e-003c436be4d4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04704222b3d64a33a6c092fc641ccbb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:09:26.725217 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7667517-0191-4d37-bb7e-003c436be4d4 service cinder] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:09:26.725501 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7667517-0191-4d37-bb7e-003c436be4d4 service cinder] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:09:26.725773 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7667517-0191-4d37-bb7e-003c436be4d4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:09:26.733993 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7667517-0191-4d37-bb7e-003c436be4d4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:09:26.735383 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7667517-0191-4d37-bb7e-003c436be4d4 service cinder] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:09:26.762454 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1104/2197] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Oct 12 17:09:26 2021] GET /identity/v3/auth/tokens => generated 3411 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 17:09:32.355142 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261b8948-8db0-4cc1-ad3c-f141895eca4a service placement] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:09:32.364857 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261b8948-8db0-4cc1-ad3c-f141895eca4a service placement] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:09:32.368416 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6e8774-e0a0-4faa-9ec4-de4275e6a8f9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04704222b3d64a33a6c092fc641ccbb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:09:32.369050 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6e8774-e0a0-4faa-9ec4-de4275e6a8f9 service cinder] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:09:32.369321 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6e8774-e0a0-4faa-9ec4-de4275e6a8f9 service cinder] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:09:32.369612 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6e8774-e0a0-4faa-9ec4-de4275e6a8f9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:09:32.378619 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6e8774-e0a0-4faa-9ec4-de4275e6a8f9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:09:32.380687 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6e8774-e0a0-4faa-9ec4-de4275e6a8f9 service cinder] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:09:32.406491 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1094/2198] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Oct 12 17:09:32 2021] GET /identity/v3/auth/tokens => generated 3407 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 17:09:33.153311 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7667517-0191-4d37-bb7e-003c436be4d4 service cinder] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:09:33.162210 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7667517-0191-4d37-bb7e-003c436be4d4 service cinder] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:09:33.165793 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcfb8dd-28d3-43b8-84f2-a8b56a3032fc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04704222b3d64a33a6c092fc641ccbb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:09:33.166631 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcfb8dd-28d3-43b8-84f2-a8b56a3032fc service cinder] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:09:33.166917 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcfb8dd-28d3-43b8-84f2-a8b56a3032fc service cinder] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:09:33.167193 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcfb8dd-28d3-43b8-84f2-a8b56a3032fc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:09:33.175335 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcfb8dd-28d3-43b8-84f2-a8b56a3032fc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:09:33.176745 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcfb8dd-28d3-43b8-84f2-a8b56a3032fc service cinder] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:09:33.202497 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1105/2199] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Oct 12 17:09:33 2021] GET /identity/v3/auth/tokens => generated 3397 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 17:10:30.961687 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6e8774-e0a0-4faa-9ec4-de4275e6a8f9 service cinder] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:10:30.969992 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6e8774-e0a0-4faa-9ec4-de4275e6a8f9 service cinder] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:10:30.973615 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ab5006-3993-4b75-83f0-b5b2c00183f3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04704222b3d64a33a6c092fc641ccbb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:10:30.974288 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ab5006-3993-4b75-83f0-b5b2c00183f3 service cinder] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:10:30.974559 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ab5006-3993-4b75-83f0-b5b2c00183f3 service cinder] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:10:30.974839 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ab5006-3993-4b75-83f0-b5b2c00183f3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:10:30.983346 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ab5006-3993-4b75-83f0-b5b2c00183f3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:10:30.984733 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ab5006-3993-4b75-83f0-b5b2c00183f3 service cinder] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:10:30.993898 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1095/2200] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Oct 12 17:10:30 2021] GET /identity/v3/auth/tokens => generated 3403 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 17:10:43.953444 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcfb8dd-28d3-43b8-84f2-a8b56a3032fc service cinder] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:10:43.962438 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcfb8dd-28d3-43b8-84f2-a8b56a3032fc service cinder] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:10:43.966008 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb6aa4f-6499-46af-b61c-76b4c7054124 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e65f6d0598e4c539134292b86fb43d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:10:43.966640 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb6aa4f-6499-46af-b61c-76b4c7054124 service neutron] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:10:43.966923 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb6aa4f-6499-46af-b61c-76b4c7054124 service neutron] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:10:43.967196 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb6aa4f-6499-46af-b61c-76b4c7054124 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:10:43.974601 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb6aa4f-6499-46af-b61c-76b4c7054124 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:10:43.975997 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb6aa4f-6499-46af-b61c-76b4c7054124 service neutron] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:10:43.983775 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1106/2201] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Oct 12 17:10:43 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 31 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 17:10:59.786894 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ab5006-3993-4b75-83f0-b5b2c00183f3 service cinder] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:10:59.795896 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ab5006-3993-4b75-83f0-b5b2c00183f3 service cinder] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:10:59.799618 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42720bd9-51f9-4fa1-97ba-bceba2170ddb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04704222b3d64a33a6c092fc641ccbb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:10:59.800242 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42720bd9-51f9-4fa1-97ba-bceba2170ddb service cinder] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:10:59.800525 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42720bd9-51f9-4fa1-97ba-bceba2170ddb service cinder] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:10:59.800800 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42720bd9-51f9-4fa1-97ba-bceba2170ddb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:10:59.808947 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42720bd9-51f9-4fa1-97ba-bceba2170ddb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:10:59.811000 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42720bd9-51f9-4fa1-97ba-bceba2170ddb service cinder] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:10:59.819884 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1096/2202] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Oct 12 17:10:59 2021] GET /identity/v3/auth/tokens => generated 3403 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 17:11:08.900113 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb6aa4f-6499-46af-b61c-76b4c7054124 service neutron] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:11:08.909402 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb6aa4f-6499-46af-b61c-76b4c7054124 service neutron] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:11:08.912980 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fdd417-9f98-4cbc-943c-a45877ea3f4b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e65f6d0598e4c539134292b86fb43d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:11:08.913632 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fdd417-9f98-4cbc-943c-a45877ea3f4b service neutron] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:11:08.913948 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fdd417-9f98-4cbc-943c-a45877ea3f4b service neutron] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:11:08.914224 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fdd417-9f98-4cbc-943c-a45877ea3f4b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:11:08.924237 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fdd417-9f98-4cbc-943c-a45877ea3f4b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:11:08.925624 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fdd417-9f98-4cbc-943c-a45877ea3f4b service neutron] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:11:08.936153 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1107/2203] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Oct 12 17:11:08 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 17:11:10.100518 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42720bd9-51f9-4fa1-97ba-bceba2170ddb service cinder] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:11:10.110014 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42720bd9-51f9-4fa1-97ba-bceba2170ddb service cinder] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:11:10.114036 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b059c19c-ecb2-4c0b-8aed-ba2e0058b873 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e65f6d0598e4c539134292b86fb43d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:11:10.114699 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b059c19c-ecb2-4c0b-8aed-ba2e0058b873 service neutron] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:11:10.114982 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b059c19c-ecb2-4c0b-8aed-ba2e0058b873 service neutron] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:11:10.115282 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b059c19c-ecb2-4c0b-8aed-ba2e0058b873 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:11:10.125849 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b059c19c-ecb2-4c0b-8aed-ba2e0058b873 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:11:10.127297 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b059c19c-ecb2-4c0b-8aed-ba2e0058b873 service neutron] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:11:10.137931 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1097/2204] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Oct 12 17:11:10 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 17:11:10.463829 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fdd417-9f98-4cbc-943c-a45877ea3f4b service neutron] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:11:10.476344 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fdd417-9f98-4cbc-943c-a45877ea3f4b service neutron] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:11:10.481829 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a31200-039d-4b64-aa7a-3cbfd6aa6529 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29d30b574eec4ad3990d77d235c8b424', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:11:10.482508 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a31200-039d-4b64-aa7a-3cbfd6aa6529 service nova] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:11:10.482861 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a31200-039d-4b64-aa7a-3cbfd6aa6529 service nova] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:11:10.483103 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a31200-039d-4b64-aa7a-3cbfd6aa6529 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:11:10.493526 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a31200-039d-4b64-aa7a-3cbfd6aa6529 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:11:10.495200 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a31200-039d-4b64-aa7a-3cbfd6aa6529 service nova] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:11:10.507164 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1108/2205] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Oct 12 17:11:10 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 12 17:13:13.846843 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052f4101-d190-4d9f-9c1c-4ac24c859575 None None] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:13:13.847409 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052f4101-d190-4d9f-9c1c-4ac24c859575 None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:13:13.847409 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052f4101-d190-4d9f-9c1c-4ac24c859575 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:13:13.883512 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.auth.core [None req-052f4101-d190-4d9f-9c1c-4ac24c859575 None None] MFA Rules not processed for user `aef11be7bb50427fb18d1ff2d29e9fac`. Rule list: `[]` (Enabled: `True`). {{(pid=85205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 17:13:13.885147 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-052f4101-d190-4d9f-9c1c-4ac24c859575 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:13:13.909441 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1098/2206] 10.222.0.58 () {58 vars in 957 bytes} [Tue Oct 12 17:13:13 2021] POST /identity/v3/auth/tokens => generated 3397 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 17:13:14.203310 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a31200-039d-4b64-aa7a-3cbfd6aa6529 service nova] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:13:14.240357 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a31200-039d-4b64-aa7a-3cbfd6aa6529 service nova] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:13:14.244020 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fa9b1a-6e2f-455f-8bff-4bcb956a87f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e65f6d0598e4c539134292b86fb43d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:13:14.244661 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fa9b1a-6e2f-455f-8bff-4bcb956a87f3 service neutron] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:13:14.244946 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fa9b1a-6e2f-455f-8bff-4bcb956a87f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:13:14.245223 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fa9b1a-6e2f-455f-8bff-4bcb956a87f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:13:14.247011 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-57fa9b1a-6e2f-455f-8bff-4bcb956a87f3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:13:14.256803 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fa9b1a-6e2f-455f-8bff-4bcb956a87f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:13:14.258182 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fa9b1a-6e2f-455f-8bff-4bcb956a87f3 service neutron] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:13:14.265662 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1109/2207] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Oct 12 17:13:14 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 17:13:14.573263 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052f4101-d190-4d9f-9c1c-4ac24c859575 None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:13:14.591619 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052f4101-d190-4d9f-9c1c-4ac24c859575 None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:13:14.596777 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832e3c82-7fea-4a5d-b59d-51ffcda99ab8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4102412c40bc4745bba8c31f1caf9788', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:13:14.597450 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832e3c82-7fea-4a5d-b59d-51ffcda99ab8 service placement] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:13:14.597734 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832e3c82-7fea-4a5d-b59d-51ffcda99ab8 service placement] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:13:14.598028 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832e3c82-7fea-4a5d-b59d-51ffcda99ab8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:13:14.606691 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832e3c82-7fea-4a5d-b59d-51ffcda99ab8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:13:14.608260 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832e3c82-7fea-4a5d-b59d-51ffcda99ab8 service placement] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:13:14.618791 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1099/2208] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Oct 12 17:13:14 2021] GET /identity/v3/auth/tokens => generated 3451 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 17:13:22.730842 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fa9b1a-6e2f-455f-8bff-4bcb956a87f3 service neutron] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:13:22.743898 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fa9b1a-6e2f-455f-8bff-4bcb956a87f3 service neutron] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:13:22.749761 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ace7e76-f008-4550-a7aa-27d4bbd71d4c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29d30b574eec4ad3990d77d235c8b424', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:13:22.750451 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ace7e76-f008-4550-a7aa-27d4bbd71d4c service nova] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:13:22.750725 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ace7e76-f008-4550-a7aa-27d4bbd71d4c service nova] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:13:22.751003 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ace7e76-f008-4550-a7aa-27d4bbd71d4c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:13:22.760132 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ace7e76-f008-4550-a7aa-27d4bbd71d4c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:13:22.761685 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ace7e76-f008-4550-a7aa-27d4bbd71d4c service nova] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:13:22.773335 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1110/2209] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Oct 12 17:13:22 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 17:13:26.208948 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832e3c82-7fea-4a5d-b59d-51ffcda99ab8 service placement] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:13:26.220797 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832e3c82-7fea-4a5d-b59d-51ffcda99ab8 service placement] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:13:26.226831 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967530ec-62d2-4a41-9b87-321400b23106 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29d30b574eec4ad3990d77d235c8b424', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:13:26.227473 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967530ec-62d2-4a41-9b87-321400b23106 service nova] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:13:26.227757 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967530ec-62d2-4a41-9b87-321400b23106 service nova] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:13:26.228028 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967530ec-62d2-4a41-9b87-321400b23106 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:13:26.238319 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967530ec-62d2-4a41-9b87-321400b23106 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:13:26.240146 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967530ec-62d2-4a41-9b87-321400b23106 service nova] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:13:26.250948 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1100/2210] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Oct 12 17:13:26 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 17:13:50.287085 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ace7e76-f008-4550-a7aa-27d4bbd71d4c service nova] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:13:50.357178 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ace7e76-f008-4550-a7aa-27d4bbd71d4c service nova] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:13:50.362727 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b719b827-a7f9-480f-ae02-0b56424115db service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4102412c40bc4745bba8c31f1caf9788', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:13:50.363358 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b719b827-a7f9-480f-ae02-0b56424115db service placement] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:13:50.363640 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b719b827-a7f9-480f-ae02-0b56424115db service placement] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:13:50.363917 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b719b827-a7f9-480f-ae02-0b56424115db service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:13:50.365762 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-b719b827-a7f9-480f-ae02-0b56424115db service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:13:50.388251 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b719b827-a7f9-480f-ae02-0b56424115db service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:13:50.389800 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b719b827-a7f9-480f-ae02-0b56424115db service placement] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:13:50.399467 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1111/2211] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Oct 12 17:13:50 2021] GET /identity/v3/auth/tokens => generated 3451 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 17:14:27.167749 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967530ec-62d2-4a41-9b87-321400b23106 service nova] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:14:27.225431 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967530ec-62d2-4a41-9b87-321400b23106 service nova] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:14:27.229052 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef38dd13-91cf-489e-851b-0774879aec26 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04704222b3d64a33a6c092fc641ccbb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:14:27.229691 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef38dd13-91cf-489e-851b-0774879aec26 service cinder] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:14:27.230001 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef38dd13-91cf-489e-851b-0774879aec26 service cinder] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:14:27.230279 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef38dd13-91cf-489e-851b-0774879aec26 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:14:27.232172 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-ef38dd13-91cf-489e-851b-0774879aec26 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:14:27.299894 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef38dd13-91cf-489e-851b-0774879aec26 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:14:27.301304 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef38dd13-91cf-489e-851b-0774879aec26 service cinder] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:14:27.310272 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1101/2212] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Oct 12 17:14:27 2021] GET /identity/v3/auth/tokens => generated 3411 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 17:14:31.486767 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b719b827-a7f9-480f-ae02-0b56424115db service placement] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:14:31.488380 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-b719b827-a7f9-480f-ae02-0b56424115db service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:14:31.515379 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b719b827-a7f9-480f-ae02-0b56424115db service placement] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:14:31.518991 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa2941e-da03-4778-acd4-e055aaa765a1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04704222b3d64a33a6c092fc641ccbb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:14:31.519630 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa2941e-da03-4778-acd4-e055aaa765a1 service cinder] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:14:31.519914 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa2941e-da03-4778-acd4-e055aaa765a1 service cinder] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:14:31.520189 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa2941e-da03-4778-acd4-e055aaa765a1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:14:31.522151 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-5fa2941e-da03-4778-acd4-e055aaa765a1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:14:31.591132 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa2941e-da03-4778-acd4-e055aaa765a1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:14:31.592573 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa2941e-da03-4778-acd4-e055aaa765a1 service cinder] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:14:31.601305 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1112/2213] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Oct 12 17:14:31 2021] GET /identity/v3/auth/tokens => generated 3407 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 17:14:32.478522 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef38dd13-91cf-489e-851b-0774879aec26 service cinder] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:14:32.486914 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef38dd13-91cf-489e-851b-0774879aec26 service cinder] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:14:32.490563 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3024eca0-9970-441d-af8b-ba6fe0fd3d5e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04704222b3d64a33a6c092fc641ccbb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:14:32.491198 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3024eca0-9970-441d-af8b-ba6fe0fd3d5e service cinder] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:14:32.491482 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3024eca0-9970-441d-af8b-ba6fe0fd3d5e service cinder] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:14:32.491758 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3024eca0-9970-441d-af8b-ba6fe0fd3d5e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:14:32.500369 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3024eca0-9970-441d-af8b-ba6fe0fd3d5e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:14:32.501756 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3024eca0-9970-441d-af8b-ba6fe0fd3d5e service cinder] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:14:32.510413 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1102/2214] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Oct 12 17:14:32 2021] GET /identity/v3/auth/tokens => generated 3397 bytes in 32 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 17:15:31.150953 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa2941e-da03-4778-acd4-e055aaa765a1 service cinder] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:15:31.152523 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-5fa2941e-da03-4778-acd4-e055aaa765a1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:15:31.172871 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa2941e-da03-4778-acd4-e055aaa765a1 service cinder] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:15:31.176657 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec3384e-6779-45a8-9001-de35f29f6f61 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04704222b3d64a33a6c092fc641ccbb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:15:31.177301 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec3384e-6779-45a8-9001-de35f29f6f61 service cinder] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:15:31.177585 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec3384e-6779-45a8-9001-de35f29f6f61 service cinder] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:15:31.177861 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec3384e-6779-45a8-9001-de35f29f6f61 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:15:31.179758 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-1ec3384e-6779-45a8-9001-de35f29f6f61 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:15:31.269049 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec3384e-6779-45a8-9001-de35f29f6f61 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:15:31.270542 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec3384e-6779-45a8-9001-de35f29f6f61 service cinder] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:15:31.288424 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1113/2215] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Oct 12 17:15:31 2021] GET /identity/v3/auth/tokens => generated 3403 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 17:16:00.097190 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3024eca0-9970-441d-af8b-ba6fe0fd3d5e service cinder] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:16:00.114742 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3024eca0-9970-441d-af8b-ba6fe0fd3d5e service cinder] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:16:00.118374 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac618c4-0201-44e7-ba75-5b67dc6f444a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04704222b3d64a33a6c092fc641ccbb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:16:00.119004 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac618c4-0201-44e7-ba75-5b67dc6f444a service cinder] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:16:00.119285 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac618c4-0201-44e7-ba75-5b67dc6f444a service cinder] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:16:00.119556 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac618c4-0201-44e7-ba75-5b67dc6f444a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:16:00.127640 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac618c4-0201-44e7-ba75-5b67dc6f444a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:16:00.129029 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac618c4-0201-44e7-ba75-5b67dc6f444a service cinder] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:16:00.155215 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1103/2216] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Oct 12 17:16:00 2021] GET /identity/v3/auth/tokens => generated 3403 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 17:16:49.903543 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec3384e-6779-45a8-9001-de35f29f6f61 service cinder] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:16:49.905010 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-1ec3384e-6779-45a8-9001-de35f29f6f61 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:16:49.972362 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec3384e-6779-45a8-9001-de35f29f6f61 service cinder] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:16:49.976180 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c566f37-8855-4520-924d-ff2e0ac982d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e65f6d0598e4c539134292b86fb43d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:16:49.976831 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c566f37-8855-4520-924d-ff2e0ac982d9 service neutron] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:16:49.977126 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c566f37-8855-4520-924d-ff2e0ac982d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:16:49.977393 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c566f37-8855-4520-924d-ff2e0ac982d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:16:49.979278 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-5c566f37-8855-4520-924d-ff2e0ac982d9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:16:49.988760 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c566f37-8855-4520-924d-ff2e0ac982d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:16:49.990230 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c566f37-8855-4520-924d-ff2e0ac982d9 service neutron] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:16:49.997784 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1114/2217] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Oct 12 17:16:49 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 17:17:01.192508 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac618c4-0201-44e7-ba75-5b67dc6f444a service cinder] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:17:01.194242 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-cac618c4-0201-44e7-ba75-5b67dc6f444a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:17:01.206522 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac618c4-0201-44e7-ba75-5b67dc6f444a service cinder] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:17:01.210183 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1ad35a-c062-4621-b227-fb13d534086b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e65f6d0598e4c539134292b86fb43d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:17:01.210867 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1ad35a-c062-4621-b227-fb13d534086b service neutron] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:17:01.211147 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1ad35a-c062-4621-b227-fb13d534086b service neutron] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:17:01.211425 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1ad35a-c062-4621-b227-fb13d534086b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:17:01.213299 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-6d1ad35a-c062-4621-b227-fb13d534086b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:17:01.298576 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1ad35a-c062-4621-b227-fb13d534086b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:17:01.299988 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1ad35a-c062-4621-b227-fb13d534086b service neutron] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:17:01.319635 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1104/2218] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Oct 12 17:17:01 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 17:17:02.281555 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c566f37-8855-4520-924d-ff2e0ac982d9 service neutron] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:17:02.285386 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-5c566f37-8855-4520-924d-ff2e0ac982d9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:17:02.317529 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c566f37-8855-4520-924d-ff2e0ac982d9 service neutron] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:17:02.323627 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a5f76b-efae-4d9d-9282-f1869a01fcec service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29d30b574eec4ad3990d77d235c8b424', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:17:02.324354 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a5f76b-efae-4d9d-9282-f1869a01fcec service nova] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:17:02.324711 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a5f76b-efae-4d9d-9282-f1869a01fcec service nova] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:17:02.325052 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a5f76b-efae-4d9d-9282-f1869a01fcec service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:17:02.327045 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-32a5f76b-efae-4d9d-9282-f1869a01fcec service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:17:02.342255 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a5f76b-efae-4d9d-9282-f1869a01fcec service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:17:02.343865 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a5f76b-efae-4d9d-9282-f1869a01fcec service nova] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:17:02.355632 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1115/2219] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Oct 12 17:17:02 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 17:17:03.736788 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1ad35a-c062-4621-b227-fb13d534086b service neutron] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:17:03.745322 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1ad35a-c062-4621-b227-fb13d534086b service neutron] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:17:03.748912 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499c5e9c-9021-4b00-a542-447716b5395b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e65f6d0598e4c539134292b86fb43d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:17:03.749545 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499c5e9c-9021-4b00-a542-447716b5395b service neutron] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:17:03.749827 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499c5e9c-9021-4b00-a542-447716b5395b service neutron] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:17:03.750136 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499c5e9c-9021-4b00-a542-447716b5395b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:17:03.752527 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-499c5e9c-9021-4b00-a542-447716b5395b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:17:03.765540 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499c5e9c-9021-4b00-a542-447716b5395b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:17:03.767584 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499c5e9c-9021-4b00-a542-447716b5395b service neutron] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:17:03.778009 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1105/2220] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Oct 12 17:17:03 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 17:18:52.181822 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a5f76b-efae-4d9d-9282-f1869a01fcec service nova] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:18:52.183265 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-32a5f76b-efae-4d9d-9282-f1869a01fcec service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:18:52.196982 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a5f76b-efae-4d9d-9282-f1869a01fcec service nova] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:18:52.201761 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6f86c4-92a4-46a7-8f0d-12e17c746f70 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4102412c40bc4745bba8c31f1caf9788', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:18:52.202424 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6f86c4-92a4-46a7-8f0d-12e17c746f70 service placement] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:18:52.202705 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6f86c4-92a4-46a7-8f0d-12e17c746f70 service placement] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:18:52.202978 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6f86c4-92a4-46a7-8f0d-12e17c746f70 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:18:52.211633 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6f86c4-92a4-46a7-8f0d-12e17c746f70 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:18:52.213226 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6f86c4-92a4-46a7-8f0d-12e17c746f70 service placement] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:18:52.223069 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1116/2221] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Oct 12 17:18:52 2021] GET /identity/v3/auth/tokens => generated 3451 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 17:19:06.403825 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499c5e9c-9021-4b00-a542-447716b5395b service neutron] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:19:06.412366 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499c5e9c-9021-4b00-a542-447716b5395b service neutron] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:19:06.416094 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6c172f-0ad1-4f21-a4a5-ca683fe0f3c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e65f6d0598e4c539134292b86fb43d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:19:06.416723 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6c172f-0ad1-4f21-a4a5-ca683fe0f3c9 service neutron] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:19:06.417007 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6c172f-0ad1-4f21-a4a5-ca683fe0f3c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:19:06.417284 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6c172f-0ad1-4f21-a4a5-ca683fe0f3c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:19:06.419158 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-9a6c172f-0ad1-4f21-a4a5-ca683fe0f3c9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:19:06.500133 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6c172f-0ad1-4f21-a4a5-ca683fe0f3c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:19:06.501540 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6c172f-0ad1-4f21-a4a5-ca683fe0f3c9 service neutron] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:19:06.520053 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1106/2222] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Oct 12 17:19:06 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 17:19:09.087966 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6f86c4-92a4-46a7-8f0d-12e17c746f70 service placement] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:19:09.089426 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-1a6f86c4-92a4-46a7-8f0d-12e17c746f70 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:19:09.104637 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6f86c4-92a4-46a7-8f0d-12e17c746f70 service placement] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:19:09.110197 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0addd5-f180-4b54-8945-0571e790abea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:19:09.111122 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0addd5-f180-4b54-8945-0571e790abea admin admin] REQUEST_METHOD: `DELETE` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:19:09.111394 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0addd5-f180-4b54-8945-0571e790abea admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:19:09.111812 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0addd5-f180-4b54-8945-0571e790abea admin admin] PATH_INFO: `/v3/users/c5d7300383ce48df8ec1fe078e1fa789` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:19:09.112881 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0addd5-f180-4b54-8945-0571e790abea admin admin] RBAC: Authorizing `identity:delete_user(user_id=c5d7300383ce48df8ec1fe078e1fa789)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:19:09.114865 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0addd5-f180-4b54-8945-0571e790abea admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:19:09.163865 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-6d0addd5-f180-4b54-8945-0571e790abea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c5d7300383ce48df8ec1fe078e1fa789'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:19:09.175624 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-6d0addd5-f180-4b54-8945-0571e790abea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c5d7300383ce48df8ec1fe078e1fa789'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:19:09.182369 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-6d0addd5-f180-4b54-8945-0571e790abea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c5d7300383ce48df8ec1fe078e1fa789'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:19:09.189323 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-6d0addd5-f180-4b54-8945-0571e790abea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c5d7300383ce48df8ec1fe078e1fa789'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:19:09.189976 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-6d0addd5-f180-4b54-8945-0571e790abea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c5d7300383ce48df8ec1fe078e1fa789'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:19:09.195911 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1117/2223] 10.222.0.58 () {58 vars in 1223 bytes} [Tue Oct 12 17:19:09 2021] DELETE /identity/v3/users/c5d7300383ce48df8ec1fe078e1fa789 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 17:19:09.370771 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6c172f-0ad1-4f21-a4a5-ca683fe0f3c9 service neutron] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:19:09.393113 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6c172f-0ad1-4f21-a4a5-ca683fe0f3c9 service neutron] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:19:09.454436 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2868bc4e-fee5-4746-a43f-367121090426 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:19:09.455290 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2868bc4e-fee5-4746-a43f-367121090426 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:19:09.455568 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2868bc4e-fee5-4746-a43f-367121090426 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:19:09.455841 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2868bc4e-fee5-4746-a43f-367121090426 admin admin] PATH_INFO: `/v3/projects/949f49aec9be41038c1b0d4443109b7d` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:19:09.457081 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2868bc4e-fee5-4746-a43f-367121090426 admin admin] RBAC: Authorizing `identity:delete_project(project_id=949f49aec9be41038c1b0d4443109b7d)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:19:09.458981 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2868bc4e-fee5-4746-a43f-367121090426 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:19:09.504033 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-2868bc4e-fee5-4746-a43f-367121090426 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '949f49aec9be41038c1b0d4443109b7d', 'request_id': 'req-2868bc4e-fee5-4746-a43f-367121090426'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:19:09.509281 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-2868bc4e-fee5-4746-a43f-367121090426 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '949f49aec9be41038c1b0d4443109b7d', 'request_id': 'req-2868bc4e-fee5-4746-a43f-367121090426'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:19:09.515432 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-2868bc4e-fee5-4746-a43f-367121090426 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '949f49aec9be41038c1b0d4443109b7d', 'request_id': 'req-2868bc4e-fee5-4746-a43f-367121090426'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:19:09.528867 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-2868bc4e-fee5-4746-a43f-367121090426 admin admin] The token cache is being invalidate because project 949f49aec9be41038c1b0d4443109b7d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=85205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 17:19:09.529159 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-2868bc4e-fee5-4746-a43f-367121090426 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:19:09.529815 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-2868bc4e-fee5-4746-a43f-367121090426 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:19:09.531375 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1107/2224] 10.222.0.58 () {58 vars in 1232 bytes} [Tue Oct 12 17:19:09 2021] DELETE /identity/v3/projects/949f49aec9be41038c1b0d4443109b7d => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 17:19:09.538470 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b943032f-a1aa-48e9-ae66-a1948add946a None None] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:19:09.538775 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b943032f-a1aa-48e9-ae66-a1948add946a None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:19:09.539242 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b943032f-a1aa-48e9-ae66-a1948add946a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:19:09.593708 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.auth.core [None req-b943032f-a1aa-48e9-ae66-a1948add946a None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 17:19:09.595540 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-b943032f-a1aa-48e9-ae66-a1948add946a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:19:09.658222 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1118/2225] 10.222.0.58 () {58 vars in 957 bytes} [Tue Oct 12 17:19:09 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 17:19:09.666070 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df896276-789a-4c4b-9fb9-d1d473fd1f9d None None] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:19:09.666447 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df896276-789a-4c4b-9fb9-d1d473fd1f9d None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:19:09.666931 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df896276-789a-4c4b-9fb9-d1d473fd1f9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:19:09.685801 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.auth.core [None req-df896276-789a-4c4b-9fb9-d1d473fd1f9d None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 17:19:09.687291 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-df896276-789a-4c4b-9fb9-d1d473fd1f9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:19:09.695374 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1108/2226] 10.222.0.58 () {58 vars in 957 bytes} [Tue Oct 12 17:19:09 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 17:19:09.699519 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b943032f-a1aa-48e9-ae66-a1948add946a None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:19:09.709131 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b943032f-a1aa-48e9-ae66-a1948add946a None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:19:09.713987 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f536ebe0-2278-484e-a106-c0d7b8251c64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:19:09.714523 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f536ebe0-2278-484e-a106-c0d7b8251c64 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:19:09.714806 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f536ebe0-2278-484e-a106-c0d7b8251c64 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:19:09.715080 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f536ebe0-2278-484e-a106-c0d7b8251c64 admin admin] PATH_INFO: `/v3/domains` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:19:09.715823 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f536ebe0-2278-484e-a106-c0d7b8251c64 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 17:19:09.716133 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f536ebe0-2278-484e-a106-c0d7b8251c64 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:19:09.717712 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f536ebe0-2278-484e-a106-c0d7b8251c64 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:19:09.730117 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1119/2227] 10.222.0.58 () {58 vars in 1152 bytes} [Tue Oct 12 17:19:09 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 17:19:09.734282 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df896276-789a-4c4b-9fb9-d1d473fd1f9d None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:19:09.744453 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df896276-789a-4c4b-9fb9-d1d473fd1f9d None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:19:09.749124 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f95047-072b-41f9-8afe-35115f2f7b14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:19:09.749926 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f95047-072b-41f9-8afe-35115f2f7b14 admin admin] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:19:09.750451 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f95047-072b-41f9-8afe-35115f2f7b14 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:19:09.750726 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f95047-072b-41f9-8afe-35115f2f7b14 admin admin] PATH_INFO: `/v3/projects` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:19:09.751447 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f95047-072b-41f9-8afe-35115f2f7b14 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:19:09.753615 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f95047-072b-41f9-8afe-35115f2f7b14 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:19:09.790725 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1109/2228] 10.222.0.58 () {60 vars in 1152 bytes} [Tue Oct 12 17:19:09 2021] POST /identity/v3/projects => generated 369 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 17:19:09.791798 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f536ebe0-2278-484e-a106-c0d7b8251c64 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:19:09.802431 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f536ebe0-2278-484e-a106-c0d7b8251c64 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:19:09.854987 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755c9d73-7c26-473a-b05a-c30b1511898b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:19:09.855647 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755c9d73-7c26-473a-b05a-c30b1511898b admin admin] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:19:09.855931 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755c9d73-7c26-473a-b05a-c30b1511898b admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:19:09.856206 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755c9d73-7c26-473a-b05a-c30b1511898b admin admin] PATH_INFO: `/v3/users` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:19:09.856911 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755c9d73-7c26-473a-b05a-c30b1511898b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:19:09.858832 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755c9d73-7c26-473a-b05a-c30b1511898b admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:19:09.878354 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1120/2229] 10.222.0.58 () {60 vars in 1143 bytes} [Tue Oct 12 17:19:09 2021] POST /identity/v3/users => generated 285 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 17:19:09.882570 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f95047-072b-41f9-8afe-35115f2f7b14 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:19:09.893206 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f95047-072b-41f9-8afe-35115f2f7b14 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:19:09.898144 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08c1435-4e08-4ca5-9f19-91cf9f4cf6f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:19:09.898797 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08c1435-4e08-4ca5-9f19-91cf9f4cf6f8 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:19:09.899083 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08c1435-4e08-4ca5-9f19-91cf9f4cf6f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:19:09.899361 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08c1435-4e08-4ca5-9f19-91cf9f4cf6f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:19:09.900107 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08c1435-4e08-4ca5-9f19-91cf9f4cf6f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:19:09.901733 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08c1435-4e08-4ca5-9f19-91cf9f4cf6f8 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:19:09.911924 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1110/2230] 10.222.0.58 () {58 vars in 1121 bytes} [Tue Oct 12 17:19:09 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 17:19:09.915721 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755c9d73-7c26-473a-b05a-c30b1511898b admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:19:09.925099 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755c9d73-7c26-473a-b05a-c30b1511898b admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:19:09.929621 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ea67b6-e441-4ae8-bb86-03f61118ce2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:19:09.930300 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ea67b6-e441-4ae8-bb86-03f61118ce2b admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:19:09.930579 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ea67b6-e441-4ae8-bb86-03f61118ce2b admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:19:09.930849 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ea67b6-e441-4ae8-bb86-03f61118ce2b admin admin] PATH_INFO: `/v3/roles` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:19:09.931570 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ea67b6-e441-4ae8-bb86-03f61118ce2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:19:09.933154 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ea67b6-e441-4ae8-bb86-03f61118ce2b admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:19:09.942469 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1121/2231] 10.222.0.58 () {58 vars in 1121 bytes} [Tue Oct 12 17:19:09 2021] GET /identity/v3/roles => generated 1420 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 17:19:09.946144 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08c1435-4e08-4ca5-9f19-91cf9f4cf6f8 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:19:09.956221 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08c1435-4e08-4ca5-9f19-91cf9f4cf6f8 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:19:09.960792 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3358ec6b-3e35-4e7e-9d5e-de00be36d868 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:19:09.961674 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3358ec6b-3e35-4e7e-9d5e-de00be36d868 admin admin] REQUEST_METHOD: `PUT` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:19:09.961995 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3358ec6b-3e35-4e7e-9d5e-de00be36d868 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:19:09.962305 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3358ec6b-3e35-4e7e-9d5e-de00be36d868 admin admin] PATH_INFO: `/v3/projects/bdb436a91b21496aad8d60654ea05dd9/users/c56873e974b54da09e8d5c19ed275a53/roles/55ba49fe29884e64b57c3ad13188d554` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:19:09.976745 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3358ec6b-3e35-4e7e-9d5e-de00be36d868 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bdb436a91b21496aad8d60654ea05dd9, user_id=c56873e974b54da09e8d5c19ed275a53, role_id=55ba49fe29884e64b57c3ad13188d554)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:19:09.979430 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3358ec6b-3e35-4e7e-9d5e-de00be36d868 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:19:09.992360 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1111/2232] 10.222.0.58 () {60 vars in 1482 bytes} [Tue Oct 12 17:19:09 2021] PUT /identity/v3/projects/bdb436a91b21496aad8d60654ea05dd9/users/c56873e974b54da09e8d5c19ed275a53/roles/55ba49fe29884e64b57c3ad13188d554 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 17:19:10.003249 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a9f353-4068-407e-a89d-347feb976b9a None None] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:19:10.003562 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a9f353-4068-407e-a89d-347feb976b9a None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:19:10.003840 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a9f353-4068-407e-a89d-347feb976b9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:19:10.029213 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.auth.core [None req-45a9f353-4068-407e-a89d-347feb976b9a None None] MFA Rules not processed for user `c56873e974b54da09e8d5c19ed275a53`. Rule list: `[]` (Enabled: `True`). {{(pid=85204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 17:19:10.030429 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-45a9f353-4068-407e-a89d-347feb976b9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:19:10.095200 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1122/2233] 10.222.0.58 () {58 vars in 957 bytes} [Tue Oct 12 17:19:10 2021] POST /identity/v3/auth/tokens => generated 3389 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 17:19:10.099583 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3358ec6b-3e35-4e7e-9d5e-de00be36d868 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:19:10.157652 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3358ec6b-3e35-4e7e-9d5e-de00be36d868 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:19:10.162251 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad43590-760e-4cdb-bca5-5a588ea34e4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:19:10.162901 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad43590-760e-4cdb-bca5-5a588ea34e4d admin admin] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:19:10.163186 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad43590-760e-4cdb-bca5-5a588ea34e4d admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:19:10.163465 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad43590-760e-4cdb-bca5-5a588ea34e4d admin admin] PATH_INFO: `/v3/projects` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:19:10.164173 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad43590-760e-4cdb-bca5-5a588ea34e4d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:19:10.166067 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad43590-760e-4cdb-bca5-5a588ea34e4d admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:19:10.191712 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1112/2234] 10.222.0.58 () {60 vars in 1152 bytes} [Tue Oct 12 17:19:10 2021] POST /identity/v3/projects => generated 369 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 17:19:10.195668 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a9f353-4068-407e-a89d-347feb976b9a None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:19:10.206764 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a9f353-4068-407e-a89d-347feb976b9a None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:19:10.258779 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e74a3c-9730-49f7-9357-09fb45a67ee0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:19:10.259465 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e74a3c-9730-49f7-9357-09fb45a67ee0 admin admin] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:19:10.259751 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e74a3c-9730-49f7-9357-09fb45a67ee0 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:19:10.260028 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e74a3c-9730-49f7-9357-09fb45a67ee0 admin admin] PATH_INFO: `/v3/users` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:19:10.260731 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e74a3c-9730-49f7-9357-09fb45a67ee0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:19:10.262652 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e74a3c-9730-49f7-9357-09fb45a67ee0 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:19:10.281769 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1123/2235] 10.222.0.58 () {60 vars in 1143 bytes} [Tue Oct 12 17:19:10 2021] POST /identity/v3/users => generated 291 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 17:19:10.285600 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad43590-760e-4cdb-bca5-5a588ea34e4d admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:19:10.295668 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad43590-760e-4cdb-bca5-5a588ea34e4d admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:19:10.300525 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc29bbf-f924-420c-bb08-070e17086ea1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:19:10.301178 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc29bbf-f924-420c-bb08-070e17086ea1 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:19:10.301461 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc29bbf-f924-420c-bb08-070e17086ea1 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:19:10.301736 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc29bbf-f924-420c-bb08-070e17086ea1 admin admin] PATH_INFO: `/v3/roles` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:19:10.302506 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc29bbf-f924-420c-bb08-070e17086ea1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:19:10.304082 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc29bbf-f924-420c-bb08-070e17086ea1 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:19:10.314763 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1113/2236] 10.222.0.58 () {58 vars in 1121 bytes} [Tue Oct 12 17:19:10 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 17:19:10.318618 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e74a3c-9730-49f7-9357-09fb45a67ee0 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:19:10.328040 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e74a3c-9730-49f7-9357-09fb45a67ee0 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:19:10.333123 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d184d2b9-af1a-4e61-861d-656a5c7540cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:19:10.334034 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d184d2b9-af1a-4e61-861d-656a5c7540cf admin admin] REQUEST_METHOD: `PUT` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:19:10.334312 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d184d2b9-af1a-4e61-861d-656a5c7540cf admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:19:10.334589 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d184d2b9-af1a-4e61-861d-656a5c7540cf admin admin] PATH_INFO: `/v3/projects/9eeda6257d9e497cb366986edfb0312e/users/8ff5406bf7f7442d977776455bd95135/roles/610824e4f50f4fb8954610e98c1de784` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:19:10.348558 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d184d2b9-af1a-4e61-861d-656a5c7540cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=9eeda6257d9e497cb366986edfb0312e, user_id=8ff5406bf7f7442d977776455bd95135, role_id=610824e4f50f4fb8954610e98c1de784)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:19:10.351176 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d184d2b9-af1a-4e61-861d-656a5c7540cf admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:19:10.363925 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1124/2237] 10.222.0.58 () {60 vars in 1482 bytes} [Tue Oct 12 17:19:10 2021] PUT /identity/v3/projects/9eeda6257d9e497cb366986edfb0312e/users/8ff5406bf7f7442d977776455bd95135/roles/610824e4f50f4fb8954610e98c1de784 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 17:19:10.367710 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc29bbf-f924-420c-bb08-070e17086ea1 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:19:10.378297 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc29bbf-f924-420c-bb08-070e17086ea1 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:19:10.431092 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a02a98c-3c0c-4b5a-9f73-a84443002b8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:19:10.431755 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a02a98c-3c0c-4b5a-9f73-a84443002b8c admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:19:10.432038 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a02a98c-3c0c-4b5a-9f73-a84443002b8c admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:19:10.432444 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a02a98c-3c0c-4b5a-9f73-a84443002b8c admin admin] PATH_INFO: `/v3/roles` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:19:10.433186 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a02a98c-3c0c-4b5a-9f73-a84443002b8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:19:10.434805 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a02a98c-3c0c-4b5a-9f73-a84443002b8c admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:19:10.444590 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1114/2238] 10.222.0.58 () {58 vars in 1121 bytes} [Tue Oct 12 17:19:10 2021] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 17:19:10.448961 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d184d2b9-af1a-4e61-861d-656a5c7540cf admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:19:10.459567 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d184d2b9-af1a-4e61-861d-656a5c7540cf admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:19:10.464201 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaaf3919-79b3-405f-b860-c8e2004fccfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:19:10.465068 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaf3919-79b3-405f-b860-c8e2004fccfa admin admin] REQUEST_METHOD: `PUT` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:19:10.465352 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaf3919-79b3-405f-b860-c8e2004fccfa admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:19:10.465631 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaf3919-79b3-405f-b860-c8e2004fccfa admin admin] PATH_INFO: `/v3/projects/9eeda6257d9e497cb366986edfb0312e/users/8ff5406bf7f7442d977776455bd95135/roles/610824e4f50f4fb8954610e98c1de784` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:19:10.467636 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaaf3919-79b3-405f-b860-c8e2004fccfa admin admin] RBAC: Authorizing `identity:create_grant(project_id=9eeda6257d9e497cb366986edfb0312e, user_id=8ff5406bf7f7442d977776455bd95135, role_id=610824e4f50f4fb8954610e98c1de784)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:19:10.470312 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaaf3919-79b3-405f-b860-c8e2004fccfa admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:19:10.480574 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1125/2239] 10.222.0.58 () {60 vars in 1482 bytes} [Tue Oct 12 17:19:10 2021] PUT /identity/v3/projects/9eeda6257d9e497cb366986edfb0312e/users/8ff5406bf7f7442d977776455bd95135/roles/610824e4f50f4fb8954610e98c1de784 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 17:19:10.490375 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726154c9-02b2-400a-b722-a85bcf8555f5 None None] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:19:10.490663 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726154c9-02b2-400a-b722-a85bcf8555f5 None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:19:10.490964 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726154c9-02b2-400a-b722-a85bcf8555f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:19:10.517845 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.auth.core [None req-726154c9-02b2-400a-b722-a85bcf8555f5 None None] MFA Rules not processed for user `8ff5406bf7f7442d977776455bd95135`. Rule list: `[]` (Enabled: `True`). {{(pid=85205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 17:19:10.519114 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-726154c9-02b2-400a-b722-a85bcf8555f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:19:10.582985 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1115/2240] 10.222.0.58 () {58 vars in 957 bytes} [Tue Oct 12 17:19:10 2021] POST /identity/v3/auth/tokens => generated 3456 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 17:19:10.593278 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaaf3919-79b3-405f-b860-c8e2004fccfa admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:19:10.595029 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-eaaf3919-79b3-405f-b860-c8e2004fccfa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:19:10.648703 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaaf3919-79b3-405f-b860-c8e2004fccfa admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:19:10.652542 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adb03f0-5e2e-4bb9-a152-b9b28ca5ca39 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04704222b3d64a33a6c092fc641ccbb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:19:10.653177 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adb03f0-5e2e-4bb9-a152-b9b28ca5ca39 service cinder] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:19:10.653462 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adb03f0-5e2e-4bb9-a152-b9b28ca5ca39 service cinder] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:19:10.653737 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adb03f0-5e2e-4bb9-a152-b9b28ca5ca39 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:19:10.665415 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adb03f0-5e2e-4bb9-a152-b9b28ca5ca39 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:19:10.666926 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adb03f0-5e2e-4bb9-a152-b9b28ca5ca39 service cinder] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:19:10.676908 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1126/2241] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Oct 12 17:19:10 2021] GET /identity/v3/auth/tokens => generated 3456 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 12 17:19:10.725860 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726154c9-02b2-400a-b722-a85bcf8555f5 None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:19:10.727319 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-726154c9-02b2-400a-b722-a85bcf8555f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:19:10.739723 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726154c9-02b2-400a-b722-a85bcf8555f5 None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:19:10.744778 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f28c46b-901b-4dec-9acd-82940f8cf0c9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04704222b3d64a33a6c092fc641ccbb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:19:10.745427 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f28c46b-901b-4dec-9acd-82940f8cf0c9 service cinder] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:19:10.745712 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f28c46b-901b-4dec-9acd-82940f8cf0c9 service cinder] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:19:10.746084 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f28c46b-901b-4dec-9acd-82940f8cf0c9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:19:10.803790 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f28c46b-901b-4dec-9acd-82940f8cf0c9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:19:10.805218 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f28c46b-901b-4dec-9acd-82940f8cf0c9 service cinder] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:19:10.820524 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1116/2242] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Oct 12 17:19:10 2021] GET /identity/v3/auth/tokens => generated 3389 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 17:19:14.004319 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adb03f0-5e2e-4bb9-a152-b9b28ca5ca39 service cinder] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:19:14.066336 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adb03f0-5e2e-4bb9-a152-b9b28ca5ca39 service cinder] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:19:14.071757 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffca12ac-5de6-4923-9d91-559ac1e23835 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:19:14.073208 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffca12ac-5de6-4923-9d91-559ac1e23835 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:19:14.073723 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffca12ac-5de6-4923-9d91-559ac1e23835 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:19:14.074260 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffca12ac-5de6-4923-9d91-559ac1e23835 admin admin] PATH_INFO: `/v3/users/c56873e974b54da09e8d5c19ed275a53` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:19:14.076048 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffca12ac-5de6-4923-9d91-559ac1e23835 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c56873e974b54da09e8d5c19ed275a53)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:19:14.078352 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffca12ac-5de6-4923-9d91-559ac1e23835 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:19:14.123054 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-ffca12ac-5de6-4923-9d91-559ac1e23835 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c56873e974b54da09e8d5c19ed275a53'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:19:14.135316 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-ffca12ac-5de6-4923-9d91-559ac1e23835 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c56873e974b54da09e8d5c19ed275a53'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:19:14.142372 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-ffca12ac-5de6-4923-9d91-559ac1e23835 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c56873e974b54da09e8d5c19ed275a53'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:19:14.149366 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-ffca12ac-5de6-4923-9d91-559ac1e23835 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c56873e974b54da09e8d5c19ed275a53'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:19:14.150002 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-ffca12ac-5de6-4923-9d91-559ac1e23835 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c56873e974b54da09e8d5c19ed275a53'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:19:14.155737 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1127/2243] 10.222.0.58 () {58 vars in 1223 bytes} [Tue Oct 12 17:19:14 2021] DELETE /identity/v3/users/c56873e974b54da09e8d5c19ed275a53 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 17:19:14.160247 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8c3f7c-da36-4903-abaa-9b67c971869c None None] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:19:14.160740 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8c3f7c-da36-4903-abaa-9b67c971869c None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:19:14.160868 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8c3f7c-da36-4903-abaa-9b67c971869c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:19:14.177170 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.auth.core [None req-3d8c3f7c-da36-4903-abaa-9b67c971869c None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 17:19:14.178402 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-3d8c3f7c-da36-4903-abaa-9b67c971869c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:19:14.233285 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1117/2244] 10.222.0.58 () {58 vars in 957 bytes} [Tue Oct 12 17:19:14 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 17:19:14.243032 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffca12ac-5de6-4923-9d91-559ac1e23835 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:19:14.244439 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-ffca12ac-5de6-4923-9d91-559ac1e23835 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:19:14.299007 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffca12ac-5de6-4923-9d91-559ac1e23835 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:19:14.302674 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613923fa-8ee1-496f-9300-8c4de908d0a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e65f6d0598e4c539134292b86fb43d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:19:14.303314 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613923fa-8ee1-496f-9300-8c4de908d0a4 service neutron] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:19:14.303597 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613923fa-8ee1-496f-9300-8c4de908d0a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:19:14.303873 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613923fa-8ee1-496f-9300-8c4de908d0a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:19:14.312668 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613923fa-8ee1-496f-9300-8c4de908d0a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:19:14.314767 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613923fa-8ee1-496f-9300-8c4de908d0a4 service neutron] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:19:14.324015 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1128/2245] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Oct 12 17:19:14 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 17:19:14.588354 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8c3f7c-da36-4903-abaa-9b67c971869c None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:19:14.589815 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-3d8c3f7c-da36-4903-abaa-9b67c971869c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:19:14.602930 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8c3f7c-da36-4903-abaa-9b67c971869c None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:19:14.608023 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f2304a-da67-40ee-bfaf-85b88ed395b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:19:14.608878 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f2304a-da67-40ee-bfaf-85b88ed395b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:19:14.609158 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f2304a-da67-40ee-bfaf-85b88ed395b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:19:14.609429 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f2304a-da67-40ee-bfaf-85b88ed395b3 admin admin] PATH_INFO: `/v3/projects/bdb436a91b21496aad8d60654ea05dd9` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:19:14.611176 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f2304a-da67-40ee-bfaf-85b88ed395b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bdb436a91b21496aad8d60654ea05dd9)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:19:14.613077 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f2304a-da67-40ee-bfaf-85b88ed395b3 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:19:14.657272 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-b2f2304a-da67-40ee-bfaf-85b88ed395b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bdb436a91b21496aad8d60654ea05dd9', 'request_id': 'req-b2f2304a-da67-40ee-bfaf-85b88ed395b3'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:19:14.662477 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-b2f2304a-da67-40ee-bfaf-85b88ed395b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bdb436a91b21496aad8d60654ea05dd9', 'request_id': 'req-b2f2304a-da67-40ee-bfaf-85b88ed395b3'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:19:14.668288 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-b2f2304a-da67-40ee-bfaf-85b88ed395b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bdb436a91b21496aad8d60654ea05dd9', 'request_id': 'req-b2f2304a-da67-40ee-bfaf-85b88ed395b3'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:19:14.681343 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-b2f2304a-da67-40ee-bfaf-85b88ed395b3 admin admin] The token cache is being invalidate because project bdb436a91b21496aad8d60654ea05dd9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=85205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 17:19:14.681628 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-b2f2304a-da67-40ee-bfaf-85b88ed395b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:19:14.682260 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-b2f2304a-da67-40ee-bfaf-85b88ed395b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:19:14.683797 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1118/2246] 10.222.0.58 () {58 vars in 1232 bytes} [Tue Oct 12 17:19:14 2021] DELETE /identity/v3/projects/bdb436a91b21496aad8d60654ea05dd9 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 17:19:14.687774 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613923fa-8ee1-496f-9300-8c4de908d0a4 service neutron] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:19:14.697074 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613923fa-8ee1-496f-9300-8c4de908d0a4 service neutron] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:19:14.756392 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee0f631-7f12-4c34-ba3e-15f8acb1b591 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:19:14.757521 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee0f631-7f12-4c34-ba3e-15f8acb1b591 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:19:14.758060 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee0f631-7f12-4c34-ba3e-15f8acb1b591 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:19:14.758446 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee0f631-7f12-4c34-ba3e-15f8acb1b591 admin admin] PATH_INFO: `/v3/users/8ff5406bf7f7442d977776455bd95135` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:19:14.760464 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee0f631-7f12-4c34-ba3e-15f8acb1b591 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ff5406bf7f7442d977776455bd95135)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:19:14.763560 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee0f631-7f12-4c34-ba3e-15f8acb1b591 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:19:14.809929 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-3ee0f631-7f12-4c34-ba3e-15f8acb1b591 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ff5406bf7f7442d977776455bd95135'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:19:14.821825 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-3ee0f631-7f12-4c34-ba3e-15f8acb1b591 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ff5406bf7f7442d977776455bd95135'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:19:14.828357 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-3ee0f631-7f12-4c34-ba3e-15f8acb1b591 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ff5406bf7f7442d977776455bd95135'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:19:14.835156 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-3ee0f631-7f12-4c34-ba3e-15f8acb1b591 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ff5406bf7f7442d977776455bd95135'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:19:14.835729 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-3ee0f631-7f12-4c34-ba3e-15f8acb1b591 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ff5406bf7f7442d977776455bd95135'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:19:14.841962 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1129/2247] 10.222.0.58 () {58 vars in 1223 bytes} [Tue Oct 12 17:19:14 2021] DELETE /identity/v3/users/8ff5406bf7f7442d977776455bd95135 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 17:19:15.118163 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f2304a-da67-40ee-bfaf-85b88ed395b3 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:19:15.119689 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-b2f2304a-da67-40ee-bfaf-85b88ed395b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:19:15.140264 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f2304a-da67-40ee-bfaf-85b88ed395b3 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:19:15.195461 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c021a0aa-05d7-4b22-9fae-bd83c870ee0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:19:15.196319 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c021a0aa-05d7-4b22-9fae-bd83c870ee0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:19:15.196608 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c021a0aa-05d7-4b22-9fae-bd83c870ee0c admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:19:15.196886 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c021a0aa-05d7-4b22-9fae-bd83c870ee0c admin admin] PATH_INFO: `/v3/projects/9eeda6257d9e497cb366986edfb0312e` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:19:15.198140 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c021a0aa-05d7-4b22-9fae-bd83c870ee0c admin admin] RBAC: Authorizing `identity:delete_project(project_id=9eeda6257d9e497cb366986edfb0312e)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:19:15.200017 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c021a0aa-05d7-4b22-9fae-bd83c870ee0c admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:19:15.244369 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-c021a0aa-05d7-4b22-9fae-bd83c870ee0c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9eeda6257d9e497cb366986edfb0312e', 'request_id': 'req-c021a0aa-05d7-4b22-9fae-bd83c870ee0c'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:19:15.249535 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-c021a0aa-05d7-4b22-9fae-bd83c870ee0c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9eeda6257d9e497cb366986edfb0312e', 'request_id': 'req-c021a0aa-05d7-4b22-9fae-bd83c870ee0c'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:19:15.255667 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-c021a0aa-05d7-4b22-9fae-bd83c870ee0c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9eeda6257d9e497cb366986edfb0312e', 'request_id': 'req-c021a0aa-05d7-4b22-9fae-bd83c870ee0c'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:19:15.268260 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-c021a0aa-05d7-4b22-9fae-bd83c870ee0c admin admin] The token cache is being invalidate because project 9eeda6257d9e497cb366986edfb0312e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=85205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 17:19:15.268549 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-c021a0aa-05d7-4b22-9fae-bd83c870ee0c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:19:15.269181 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-c021a0aa-05d7-4b22-9fae-bd83c870ee0c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:19:15.270765 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1119/2248] 10.222.0.58 () {58 vars in 1232 bytes} [Tue Oct 12 17:19:15 2021] DELETE /identity/v3/projects/9eeda6257d9e497cb366986edfb0312e => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 17:19:15.276368 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce535fd8-d824-4c8b-8187-3f927ed3178e None None] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:19:15.276840 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce535fd8-d824-4c8b-8187-3f927ed3178e None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:19:15.277109 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce535fd8-d824-4c8b-8187-3f927ed3178e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:19:15.294670 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.auth.core [None req-ce535fd8-d824-4c8b-8187-3f927ed3178e None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 17:19:15.295859 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-ce535fd8-d824-4c8b-8187-3f927ed3178e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:19:15.356758 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1130/2249] 10.222.0.58 () {58 vars in 957 bytes} [Tue Oct 12 17:19:15 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 17:19:15.365079 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f8aab8-2f73-4ac7-841c-f4db90e2d4bf None None] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:19:15.365303 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f8aab8-2f73-4ac7-841c-f4db90e2d4bf None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:19:15.365575 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f8aab8-2f73-4ac7-841c-f4db90e2d4bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:19:15.383535 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.auth.core [None req-39f8aab8-2f73-4ac7-841c-f4db90e2d4bf None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 17:19:15.384725 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-39f8aab8-2f73-4ac7-841c-f4db90e2d4bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:19:15.393568 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1120/2250] 10.222.0.58 () {58 vars in 957 bytes} [Tue Oct 12 17:19:15 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 17:19:15.397674 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce535fd8-d824-4c8b-8187-3f927ed3178e None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:19:15.407829 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce535fd8-d824-4c8b-8187-3f927ed3178e None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:19:15.412434 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c567f0-9dd8-4d48-8c06-ec2b637b4e46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:19:15.413084 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c567f0-9dd8-4d48-8c06-ec2b637b4e46 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:19:15.413366 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c567f0-9dd8-4d48-8c06-ec2b637b4e46 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:19:15.413646 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c567f0-9dd8-4d48-8c06-ec2b637b4e46 admin admin] PATH_INFO: `/v3/domains` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:19:15.414419 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c567f0-9dd8-4d48-8c06-ec2b637b4e46 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 17:19:15.414732 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c567f0-9dd8-4d48-8c06-ec2b637b4e46 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:19:15.416307 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c567f0-9dd8-4d48-8c06-ec2b637b4e46 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:19:15.429767 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1131/2251] 10.222.0.58 () {58 vars in 1152 bytes} [Tue Oct 12 17:19:15 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 17:19:15.433948 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f8aab8-2f73-4ac7-841c-f4db90e2d4bf None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:19:15.450124 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f8aab8-2f73-4ac7-841c-f4db90e2d4bf None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:19:15.457298 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eae8b85-dedc-4467-be96-17c98fba4001 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:19:15.458017 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eae8b85-dedc-4467-be96-17c98fba4001 admin admin] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:19:15.458345 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eae8b85-dedc-4467-be96-17c98fba4001 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:19:15.458676 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eae8b85-dedc-4467-be96-17c98fba4001 admin admin] PATH_INFO: `/v3/projects` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:19:15.459334 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eae8b85-dedc-4467-be96-17c98fba4001 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:19:15.461236 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eae8b85-dedc-4467-be96-17c98fba4001 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:19:15.487925 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1121/2252] 10.222.0.58 () {60 vars in 1152 bytes} [Tue Oct 12 17:19:15 2021] POST /identity/v3/projects => generated 387 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 17:19:15.492200 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c567f0-9dd8-4d48-8c06-ec2b637b4e46 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:19:15.502676 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c567f0-9dd8-4d48-8c06-ec2b637b4e46 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:19:15.555951 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63289f4b-5965-4f8f-9fd7-e66d10cc0615 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:19:15.556610 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63289f4b-5965-4f8f-9fd7-e66d10cc0615 admin admin] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:19:15.556894 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63289f4b-5965-4f8f-9fd7-e66d10cc0615 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:19:15.557170 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63289f4b-5965-4f8f-9fd7-e66d10cc0615 admin admin] PATH_INFO: `/v3/users` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:19:15.557861 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63289f4b-5965-4f8f-9fd7-e66d10cc0615 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:19:15.559764 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63289f4b-5965-4f8f-9fd7-e66d10cc0615 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:19:15.579684 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1132/2253] 10.222.0.58 () {60 vars in 1143 bytes} [Tue Oct 12 17:19:15 2021] POST /identity/v3/users => generated 294 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 17:19:15.583783 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eae8b85-dedc-4467-be96-17c98fba4001 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:19:15.593701 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eae8b85-dedc-4467-be96-17c98fba4001 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:19:15.598391 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0468b38f-a273-4392-8fad-a28bf1d468d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:19:15.599044 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0468b38f-a273-4392-8fad-a28bf1d468d8 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:19:15.599447 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0468b38f-a273-4392-8fad-a28bf1d468d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:19:15.599732 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0468b38f-a273-4392-8fad-a28bf1d468d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:19:15.600500 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0468b38f-a273-4392-8fad-a28bf1d468d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:19:15.602358 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0468b38f-a273-4392-8fad-a28bf1d468d8 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:19:15.612492 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1122/2254] 10.222.0.58 () {58 vars in 1121 bytes} [Tue Oct 12 17:19:15 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 17:19:15.616661 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63289f4b-5965-4f8f-9fd7-e66d10cc0615 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:19:15.626700 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63289f4b-5965-4f8f-9fd7-e66d10cc0615 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:19:15.631533 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e669264-64a6-4106-81d6-3beef50555a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:19:15.632182 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e669264-64a6-4106-81d6-3beef50555a8 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:19:15.632467 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e669264-64a6-4106-81d6-3beef50555a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:19:15.632747 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e669264-64a6-4106-81d6-3beef50555a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:19:15.633484 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e669264-64a6-4106-81d6-3beef50555a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:19:15.635108 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e669264-64a6-4106-81d6-3beef50555a8 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:19:15.648623 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1133/2255] 10.222.0.58 () {58 vars in 1121 bytes} [Tue Oct 12 17:19:15 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 17:19:15.649752 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0468b38f-a273-4392-8fad-a28bf1d468d8 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:19:15.659600 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0468b38f-a273-4392-8fad-a28bf1d468d8 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:19:15.664354 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75fedce-110d-42c2-8a7f-a072182fd19d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:19:15.665230 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75fedce-110d-42c2-8a7f-a072182fd19d admin admin] REQUEST_METHOD: `PUT` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:19:15.665517 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75fedce-110d-42c2-8a7f-a072182fd19d admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:19:15.665794 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75fedce-110d-42c2-8a7f-a072182fd19d admin admin] PATH_INFO: `/v3/projects/6faf035732f348929edcc38e305a4a1a/users/920afc682ec6448c9313104db56fc9bf/roles/55ba49fe29884e64b57c3ad13188d554` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:19:15.680721 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75fedce-110d-42c2-8a7f-a072182fd19d admin admin] RBAC: Authorizing `identity:create_grant(project_id=6faf035732f348929edcc38e305a4a1a, user_id=920afc682ec6448c9313104db56fc9bf, role_id=55ba49fe29884e64b57c3ad13188d554)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:19:15.683282 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75fedce-110d-42c2-8a7f-a072182fd19d admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:19:15.704552 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1123/2256] 10.222.0.58 () {60 vars in 1482 bytes} [Tue Oct 12 17:19:15 2021] PUT /identity/v3/projects/6faf035732f348929edcc38e305a4a1a/users/920afc682ec6448c9313104db56fc9bf/roles/55ba49fe29884e64b57c3ad13188d554 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 17:19:15.716006 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734527f4-0d59-453a-bfba-ea2cdd0fdc71 None None] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:19:15.716301 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734527f4-0d59-453a-bfba-ea2cdd0fdc71 None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:19:15.716582 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734527f4-0d59-453a-bfba-ea2cdd0fdc71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:19:15.743702 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.auth.core [None req-734527f4-0d59-453a-bfba-ea2cdd0fdc71 None None] MFA Rules not processed for user `920afc682ec6448c9313104db56fc9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=85204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 17:19:15.743921 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-734527f4-0d59-453a-bfba-ea2cdd0fdc71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:19:15.806754 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1134/2257] 10.222.0.58 () {58 vars in 957 bytes} [Tue Oct 12 17:19:15 2021] POST /identity/v3/auth/tokens => generated 3407 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 17:19:15.811024 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75fedce-110d-42c2-8a7f-a072182fd19d admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:19:15.874241 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75fedce-110d-42c2-8a7f-a072182fd19d admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:19:15.880147 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cd6275-8cbe-48f7-9b19-595427bbf914 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:19:15.880812 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cd6275-8cbe-48f7-9b19-595427bbf914 admin admin] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:19:15.881099 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cd6275-8cbe-48f7-9b19-595427bbf914 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:19:15.881374 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cd6275-8cbe-48f7-9b19-595427bbf914 admin admin] PATH_INFO: `/v3/projects` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:19:15.882121 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cd6275-8cbe-48f7-9b19-595427bbf914 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:19:15.883987 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cd6275-8cbe-48f7-9b19-595427bbf914 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:19:15.913952 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1124/2258] 10.222.0.58 () {60 vars in 1152 bytes} [Tue Oct 12 17:19:15 2021] POST /identity/v3/projects => generated 387 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 17:19:15.915279 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734527f4-0d59-453a-bfba-ea2cdd0fdc71 None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:19:15.926747 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734527f4-0d59-453a-bfba-ea2cdd0fdc71 None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:19:15.982114 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c600767-7b74-41d0-afad-63f4b0816548 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:19:15.982853 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c600767-7b74-41d0-afad-63f4b0816548 admin admin] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:19:15.983188 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c600767-7b74-41d0-afad-63f4b0816548 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:19:15.983465 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c600767-7b74-41d0-afad-63f4b0816548 admin admin] PATH_INFO: `/v3/users` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:19:15.984164 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c600767-7b74-41d0-afad-63f4b0816548 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:19:15.986693 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c600767-7b74-41d0-afad-63f4b0816548 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:19:16.007396 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1135/2259] 10.222.0.58 () {60 vars in 1143 bytes} [Tue Oct 12 17:19:15 2021] POST /identity/v3/users => generated 300 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 17:19:16.012640 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cd6275-8cbe-48f7-9b19-595427bbf914 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:19:16.024801 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cd6275-8cbe-48f7-9b19-595427bbf914 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:19:16.037480 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c56265f-472b-4ccc-b7b6-bd00dee4c351 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:19:16.038224 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c56265f-472b-4ccc-b7b6-bd00dee4c351 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:19:16.038508 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c56265f-472b-4ccc-b7b6-bd00dee4c351 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:19:16.038782 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c56265f-472b-4ccc-b7b6-bd00dee4c351 admin admin] PATH_INFO: `/v3/roles` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:19:16.039537 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c56265f-472b-4ccc-b7b6-bd00dee4c351 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:19:16.041148 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c56265f-472b-4ccc-b7b6-bd00dee4c351 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:19:16.053377 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1125/2260] 10.222.0.58 () {58 vars in 1121 bytes} [Tue Oct 12 17:19:16 2021] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 17:19:16.057675 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c600767-7b74-41d0-afad-63f4b0816548 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:19:16.073887 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c600767-7b74-41d0-afad-63f4b0816548 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:19:16.078668 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487782f8-7a83-4b7b-bce4-d88626c372df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:19:16.079559 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487782f8-7a83-4b7b-bce4-d88626c372df admin admin] REQUEST_METHOD: `PUT` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:19:16.079843 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487782f8-7a83-4b7b-bce4-d88626c372df admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:19:16.080120 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487782f8-7a83-4b7b-bce4-d88626c372df admin admin] PATH_INFO: `/v3/projects/df4d246acdcd466bb58e627eda08b6e4/users/df48e5955f654800aa19350d39c99977/roles/610824e4f50f4fb8954610e98c1de784` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:19:16.096037 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487782f8-7a83-4b7b-bce4-d88626c372df admin admin] RBAC: Authorizing `identity:create_grant(project_id=df4d246acdcd466bb58e627eda08b6e4, user_id=df48e5955f654800aa19350d39c99977, role_id=610824e4f50f4fb8954610e98c1de784)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:19:16.098701 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487782f8-7a83-4b7b-bce4-d88626c372df admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:19:16.117318 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1136/2261] 10.222.0.58 () {60 vars in 1482 bytes} [Tue Oct 12 17:19:16 2021] PUT /identity/v3/projects/df4d246acdcd466bb58e627eda08b6e4/users/df48e5955f654800aa19350d39c99977/roles/610824e4f50f4fb8954610e98c1de784 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 17:19:16.118719 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c56265f-472b-4ccc-b7b6-bd00dee4c351 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:19:16.131041 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c56265f-472b-4ccc-b7b6-bd00dee4c351 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:19:16.207772 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09b0f74-548c-434b-a1fb-1136f8099f12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:19:16.208481 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09b0f74-548c-434b-a1fb-1136f8099f12 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:19:16.208722 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09b0f74-548c-434b-a1fb-1136f8099f12 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:19:16.209000 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09b0f74-548c-434b-a1fb-1136f8099f12 admin admin] PATH_INFO: `/v3/roles` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:19:16.209757 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09b0f74-548c-434b-a1fb-1136f8099f12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:19:16.211526 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09b0f74-548c-434b-a1fb-1136f8099f12 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:19:16.224401 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1126/2262] 10.222.0.58 () {58 vars in 1121 bytes} [Tue Oct 12 17:19:16 2021] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 17:19:16.229041 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487782f8-7a83-4b7b-bce4-d88626c372df admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:19:16.240179 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487782f8-7a83-4b7b-bce4-d88626c372df admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:19:16.246185 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10539c63-d7c7-4358-a5d3-18378cdc23f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:19:16.247082 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10539c63-d7c7-4358-a5d3-18378cdc23f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:19:16.247364 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10539c63-d7c7-4358-a5d3-18378cdc23f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:19:16.247637 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10539c63-d7c7-4358-a5d3-18378cdc23f0 admin admin] PATH_INFO: `/v3/projects/df4d246acdcd466bb58e627eda08b6e4/users/df48e5955f654800aa19350d39c99977/roles/610824e4f50f4fb8954610e98c1de784` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:19:16.250189 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10539c63-d7c7-4358-a5d3-18378cdc23f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=df4d246acdcd466bb58e627eda08b6e4, user_id=df48e5955f654800aa19350d39c99977, role_id=610824e4f50f4fb8954610e98c1de784)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:19:16.253111 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10539c63-d7c7-4358-a5d3-18378cdc23f0 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:19:16.267546 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1137/2263] 10.222.0.58 () {60 vars in 1482 bytes} [Tue Oct 12 17:19:16 2021] PUT /identity/v3/projects/df4d246acdcd466bb58e627eda08b6e4/users/df48e5955f654800aa19350d39c99977/roles/610824e4f50f4fb8954610e98c1de784 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 17:19:16.278032 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7871a4d7-1935-499f-a68c-8618b62f3e65 None None] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:19:16.278593 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7871a4d7-1935-499f-a68c-8618b62f3e65 None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:19:16.279046 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7871a4d7-1935-499f-a68c-8618b62f3e65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:19:16.313492 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.auth.core [None req-7871a4d7-1935-499f-a68c-8618b62f3e65 None None] MFA Rules not processed for user `df48e5955f654800aa19350d39c99977`. Rule list: `[]` (Enabled: `True`). {{(pid=85205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 17:19:16.314859 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-7871a4d7-1935-499f-a68c-8618b62f3e65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:19:16.388054 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1127/2264] 10.222.0.58 () {58 vars in 957 bytes} [Tue Oct 12 17:19:16 2021] POST /identity/v3/auth/tokens => generated 3474 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 17:19:16.398072 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10539c63-d7c7-4358-a5d3-18378cdc23f0 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:19:16.399834 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-10539c63-d7c7-4358-a5d3-18378cdc23f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:19:16.453995 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10539c63-d7c7-4358-a5d3-18378cdc23f0 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:19:16.460606 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ac4a45-74f1-40ad-912f-8c077f0831e9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04704222b3d64a33a6c092fc641ccbb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:19:16.461268 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ac4a45-74f1-40ad-912f-8c077f0831e9 service cinder] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:19:16.461557 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ac4a45-74f1-40ad-912f-8c077f0831e9 service cinder] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:19:16.461836 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ac4a45-74f1-40ad-912f-8c077f0831e9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:19:16.471525 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ac4a45-74f1-40ad-912f-8c077f0831e9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:19:16.472958 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ac4a45-74f1-40ad-912f-8c077f0831e9 service cinder] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:19:16.483196 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1138/2265] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Oct 12 17:19:16 2021] GET /identity/v3/auth/tokens => generated 3474 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 17:19:16.509890 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7871a4d7-1935-499f-a68c-8618b62f3e65 None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:19:16.569417 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7871a4d7-1935-499f-a68c-8618b62f3e65 None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:19:16.574363 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05faadaf-b126-4174-a84e-b5c12bfeb6d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:19:16.575311 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05faadaf-b126-4174-a84e-b5c12bfeb6d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:19:16.575753 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05faadaf-b126-4174-a84e-b5c12bfeb6d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:19:16.576112 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05faadaf-b126-4174-a84e-b5c12bfeb6d7 admin admin] PATH_INFO: `/v3/users/920afc682ec6448c9313104db56fc9bf` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:19:16.577321 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05faadaf-b126-4174-a84e-b5c12bfeb6d7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=920afc682ec6448c9313104db56fc9bf)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:19:16.579751 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05faadaf-b126-4174-a84e-b5c12bfeb6d7 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:19:16.624323 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-05faadaf-b126-4174-a84e-b5c12bfeb6d7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '920afc682ec6448c9313104db56fc9bf'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:19:16.636513 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-05faadaf-b126-4174-a84e-b5c12bfeb6d7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '920afc682ec6448c9313104db56fc9bf'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:19:16.645398 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-05faadaf-b126-4174-a84e-b5c12bfeb6d7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '920afc682ec6448c9313104db56fc9bf'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:19:16.652651 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-05faadaf-b126-4174-a84e-b5c12bfeb6d7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '920afc682ec6448c9313104db56fc9bf'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:19:16.653316 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-05faadaf-b126-4174-a84e-b5c12bfeb6d7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '920afc682ec6448c9313104db56fc9bf'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:19:16.660097 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1128/2266] 10.222.0.58 () {58 vars in 1223 bytes} [Tue Oct 12 17:19:16 2021] DELETE /identity/v3/users/920afc682ec6448c9313104db56fc9bf => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 17:19:16.665145 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f60d713-d48a-4757-8bfc-59c71c56b9ae None None] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:19:16.665523 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f60d713-d48a-4757-8bfc-59c71c56b9ae None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:19:16.666125 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f60d713-d48a-4757-8bfc-59c71c56b9ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:19:16.685925 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.auth.core [None req-3f60d713-d48a-4757-8bfc-59c71c56b9ae None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 17:19:16.687150 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-3f60d713-d48a-4757-8bfc-59c71c56b9ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:19:16.742670 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1139/2267] 10.222.0.58 () {58 vars in 957 bytes} [Tue Oct 12 17:19:16 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 17:19:16.752699 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05faadaf-b126-4174-a84e-b5c12bfeb6d7 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:19:16.754133 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-05faadaf-b126-4174-a84e-b5c12bfeb6d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:19:16.808792 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05faadaf-b126-4174-a84e-b5c12bfeb6d7 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:19:16.812483 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790c05d4-b6f0-45cd-aad8-f270e333981e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e65f6d0598e4c539134292b86fb43d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:19:16.813130 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790c05d4-b6f0-45cd-aad8-f270e333981e service neutron] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:19:16.813416 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790c05d4-b6f0-45cd-aad8-f270e333981e service neutron] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:19:16.813693 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790c05d4-b6f0-45cd-aad8-f270e333981e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:19:16.822912 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790c05d4-b6f0-45cd-aad8-f270e333981e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:19:16.824328 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790c05d4-b6f0-45cd-aad8-f270e333981e service neutron] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:19:16.834094 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1129/2268] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Oct 12 17:19:16 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 17:19:17.090873 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f60d713-d48a-4757-8bfc-59c71c56b9ae None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:19:17.092471 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-3f60d713-d48a-4757-8bfc-59c71c56b9ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:19:17.109844 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f60d713-d48a-4757-8bfc-59c71c56b9ae None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:19:17.115025 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5687fc-5673-4a0c-9311-6af2170ef124 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:19:17.122305 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5687fc-5673-4a0c-9311-6af2170ef124 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:19:17.122603 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5687fc-5673-4a0c-9311-6af2170ef124 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:19:17.122884 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5687fc-5673-4a0c-9311-6af2170ef124 admin admin] PATH_INFO: `/v3/projects/6faf035732f348929edcc38e305a4a1a` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:19:17.124101 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5687fc-5673-4a0c-9311-6af2170ef124 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6faf035732f348929edcc38e305a4a1a)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:19:17.126525 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5687fc-5673-4a0c-9311-6af2170ef124 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:19:17.170687 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-5e5687fc-5673-4a0c-9311-6af2170ef124 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6faf035732f348929edcc38e305a4a1a', 'request_id': 'req-5e5687fc-5673-4a0c-9311-6af2170ef124'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:19:17.175874 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-5e5687fc-5673-4a0c-9311-6af2170ef124 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6faf035732f348929edcc38e305a4a1a', 'request_id': 'req-5e5687fc-5673-4a0c-9311-6af2170ef124'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:19:17.181789 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-5e5687fc-5673-4a0c-9311-6af2170ef124 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6faf035732f348929edcc38e305a4a1a', 'request_id': 'req-5e5687fc-5673-4a0c-9311-6af2170ef124'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:19:17.193647 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-5e5687fc-5673-4a0c-9311-6af2170ef124 admin admin] The token cache is being invalidate because project 6faf035732f348929edcc38e305a4a1a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=85204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 17:19:17.193961 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-5e5687fc-5673-4a0c-9311-6af2170ef124 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:19:17.194586 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-5e5687fc-5673-4a0c-9311-6af2170ef124 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:19:17.196083 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1140/2269] 10.222.0.58 () {58 vars in 1232 bytes} [Tue Oct 12 17:19:17 2021] DELETE /identity/v3/projects/6faf035732f348929edcc38e305a4a1a => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 17:19:17.200152 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790c05d4-b6f0-45cd-aad8-f270e333981e service neutron] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:19:17.211088 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790c05d4-b6f0-45cd-aad8-f270e333981e service neutron] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:19:17.265074 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cea1084-4bf4-4b60-8b7a-ed91a64f5404 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:19:17.265950 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cea1084-4bf4-4b60-8b7a-ed91a64f5404 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:19:17.266260 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cea1084-4bf4-4b60-8b7a-ed91a64f5404 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:19:17.266535 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cea1084-4bf4-4b60-8b7a-ed91a64f5404 admin admin] PATH_INFO: `/v3/users/df48e5955f654800aa19350d39c99977` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:19:17.267730 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cea1084-4bf4-4b60-8b7a-ed91a64f5404 admin admin] RBAC: Authorizing `identity:delete_user(user_id=df48e5955f654800aa19350d39c99977)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:19:17.269601 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cea1084-4bf4-4b60-8b7a-ed91a64f5404 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:19:17.313346 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-1cea1084-4bf4-4b60-8b7a-ed91a64f5404 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df48e5955f654800aa19350d39c99977'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:19:17.325401 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-1cea1084-4bf4-4b60-8b7a-ed91a64f5404 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df48e5955f654800aa19350d39c99977'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:19:17.334001 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-1cea1084-4bf4-4b60-8b7a-ed91a64f5404 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df48e5955f654800aa19350d39c99977'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:19:17.340568 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-1cea1084-4bf4-4b60-8b7a-ed91a64f5404 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df48e5955f654800aa19350d39c99977'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:19:17.341334 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-1cea1084-4bf4-4b60-8b7a-ed91a64f5404 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df48e5955f654800aa19350d39c99977'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:19:17.347570 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1130/2270] 10.222.0.58 () {58 vars in 1223 bytes} [Tue Oct 12 17:19:17 2021] DELETE /identity/v3/users/df48e5955f654800aa19350d39c99977 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 17:19:17.610846 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5687fc-5673-4a0c-9311-6af2170ef124 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:19:17.612245 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-5e5687fc-5673-4a0c-9311-6af2170ef124 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:19:17.625141 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5687fc-5673-4a0c-9311-6af2170ef124 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:19:17.679411 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81644a7-a9dd-4dd1-b77c-adf17050f882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:19:17.680211 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81644a7-a9dd-4dd1-b77c-adf17050f882 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:19:17.680493 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81644a7-a9dd-4dd1-b77c-adf17050f882 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:19:17.680769 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81644a7-a9dd-4dd1-b77c-adf17050f882 admin admin] PATH_INFO: `/v3/projects/df4d246acdcd466bb58e627eda08b6e4` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:19:17.682100 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81644a7-a9dd-4dd1-b77c-adf17050f882 admin admin] RBAC: Authorizing `identity:delete_project(project_id=df4d246acdcd466bb58e627eda08b6e4)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:19:17.683985 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81644a7-a9dd-4dd1-b77c-adf17050f882 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:19:17.728037 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-b81644a7-a9dd-4dd1-b77c-adf17050f882 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df4d246acdcd466bb58e627eda08b6e4', 'request_id': 'req-b81644a7-a9dd-4dd1-b77c-adf17050f882'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:19:17.733160 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-b81644a7-a9dd-4dd1-b77c-adf17050f882 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df4d246acdcd466bb58e627eda08b6e4', 'request_id': 'req-b81644a7-a9dd-4dd1-b77c-adf17050f882'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:19:17.738988 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-b81644a7-a9dd-4dd1-b77c-adf17050f882 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df4d246acdcd466bb58e627eda08b6e4', 'request_id': 'req-b81644a7-a9dd-4dd1-b77c-adf17050f882'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:19:17.751194 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-b81644a7-a9dd-4dd1-b77c-adf17050f882 admin admin] The token cache is being invalidate because project df4d246acdcd466bb58e627eda08b6e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=85204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 17:19:17.751477 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-b81644a7-a9dd-4dd1-b77c-adf17050f882 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:19:17.752353 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-b81644a7-a9dd-4dd1-b77c-adf17050f882 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:19:17.753865 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1141/2271] 10.222.0.58 () {58 vars in 1232 bytes} [Tue Oct 12 17:19:17 2021] DELETE /identity/v3/projects/df4d246acdcd466bb58e627eda08b6e4 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 17:19:17.759692 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c918a104-2bd7-4db7-8e7b-ce68e125bd27 None None] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:19:17.759986 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c918a104-2bd7-4db7-8e7b-ce68e125bd27 None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:19:17.760266 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c918a104-2bd7-4db7-8e7b-ce68e125bd27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:19:17.778028 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.auth.core [None req-c918a104-2bd7-4db7-8e7b-ce68e125bd27 None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 17:19:17.779230 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-c918a104-2bd7-4db7-8e7b-ce68e125bd27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:19:17.835489 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1131/2272] 10.222.0.58 () {58 vars in 957 bytes} [Tue Oct 12 17:19:17 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 17:19:17.843222 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec54b559-604a-4370-864e-3f9d3e2e95e9 None None] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:19:17.843517 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec54b559-604a-4370-864e-3f9d3e2e95e9 None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:19:17.843797 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec54b559-604a-4370-864e-3f9d3e2e95e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:19:17.861355 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.auth.core [None req-ec54b559-604a-4370-864e-3f9d3e2e95e9 None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 17:19:17.862605 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-ec54b559-604a-4370-864e-3f9d3e2e95e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:19:17.870649 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1142/2273] 10.222.0.58 () {58 vars in 957 bytes} [Tue Oct 12 17:19:17 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 17:19:17.874900 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c918a104-2bd7-4db7-8e7b-ce68e125bd27 None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:19:17.885158 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c918a104-2bd7-4db7-8e7b-ce68e125bd27 None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:19:17.890202 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d60abf-c4a3-40aa-b53c-f620a01801d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:19:17.890878 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d60abf-c4a3-40aa-b53c-f620a01801d4 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:19:17.891757 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d60abf-c4a3-40aa-b53c-f620a01801d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:19:17.892036 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d60abf-c4a3-40aa-b53c-f620a01801d4 admin admin] PATH_INFO: `/v3/domains` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:19:17.892781 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d60abf-c4a3-40aa-b53c-f620a01801d4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 17:19:17.893093 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d60abf-c4a3-40aa-b53c-f620a01801d4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:19:17.894747 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d60abf-c4a3-40aa-b53c-f620a01801d4 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:19:17.906309 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1132/2274] 10.222.0.58 () {58 vars in 1152 bytes} [Tue Oct 12 17:19:17 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 17:19:17.910362 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec54b559-604a-4370-864e-3f9d3e2e95e9 None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:19:17.919474 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec54b559-604a-4370-864e-3f9d3e2e95e9 None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:19:17.924626 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c8c860-cdcf-41b6-a311-c99d060f2d76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:19:17.925290 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c8c860-cdcf-41b6-a311-c99d060f2d76 admin admin] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:19:17.925574 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c8c860-cdcf-41b6-a311-c99d060f2d76 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:19:17.925848 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c8c860-cdcf-41b6-a311-c99d060f2d76 admin admin] PATH_INFO: `/v3/projects` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:19:17.926592 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c8c860-cdcf-41b6-a311-c99d060f2d76 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:19:17.928454 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c8c860-cdcf-41b6-a311-c99d060f2d76 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:19:17.954737 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1143/2275] 10.222.0.58 () {60 vars in 1152 bytes} [Tue Oct 12 17:19:17 2021] POST /identity/v3/projects => generated 389 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 17:19:17.958716 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d60abf-c4a3-40aa-b53c-f620a01801d4 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:19:17.968542 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d60abf-c4a3-40aa-b53c-f620a01801d4 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:19:18.025366 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e64f23-6d39-4019-a51d-4065af934e51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:19:18.026090 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e64f23-6d39-4019-a51d-4065af934e51 admin admin] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:19:18.026363 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e64f23-6d39-4019-a51d-4065af934e51 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:19:18.026642 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e64f23-6d39-4019-a51d-4065af934e51 admin admin] PATH_INFO: `/v3/users` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:19:18.027352 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e64f23-6d39-4019-a51d-4065af934e51 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:19:18.029228 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e64f23-6d39-4019-a51d-4065af934e51 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:19:18.048941 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1133/2276] 10.222.0.58 () {60 vars in 1143 bytes} [Tue Oct 12 17:19:17 2021] POST /identity/v3/users => generated 295 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 17:19:18.052968 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c8c860-cdcf-41b6-a311-c99d060f2d76 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:19:18.063504 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c8c860-cdcf-41b6-a311-c99d060f2d76 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:19:18.068058 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d74252-013a-44db-bb68-64fda4296f9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:19:18.068701 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d74252-013a-44db-bb68-64fda4296f9f admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:19:18.068982 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d74252-013a-44db-bb68-64fda4296f9f admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:19:18.069251 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d74252-013a-44db-bb68-64fda4296f9f admin admin] PATH_INFO: `/v3/roles` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:19:18.070010 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d74252-013a-44db-bb68-64fda4296f9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:19:18.071562 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d74252-013a-44db-bb68-64fda4296f9f admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:19:18.081457 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1144/2277] 10.222.0.58 () {58 vars in 1121 bytes} [Tue Oct 12 17:19:18 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 17:19:18.085217 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e64f23-6d39-4019-a51d-4065af934e51 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:19:18.094909 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e64f23-6d39-4019-a51d-4065af934e51 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:19:18.099585 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17abe80a-0891-46b0-82c6-41cad9a61d3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:19:18.100233 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17abe80a-0891-46b0-82c6-41cad9a61d3f admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:19:18.100520 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17abe80a-0891-46b0-82c6-41cad9a61d3f admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:19:18.100799 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17abe80a-0891-46b0-82c6-41cad9a61d3f admin admin] PATH_INFO: `/v3/roles` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:19:18.101533 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17abe80a-0891-46b0-82c6-41cad9a61d3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:19:18.103120 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17abe80a-0891-46b0-82c6-41cad9a61d3f admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:19:18.113536 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1134/2278] 10.222.0.58 () {58 vars in 1121 bytes} [Tue Oct 12 17:19:18 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 17:19:18.117488 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d74252-013a-44db-bb68-64fda4296f9f admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:19:18.128058 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d74252-013a-44db-bb68-64fda4296f9f admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:19:18.132680 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6221f6-36bc-467c-8ffd-68a18c75872d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:19:18.133561 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6221f6-36bc-467c-8ffd-68a18c75872d admin admin] REQUEST_METHOD: `PUT` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:19:18.133846 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6221f6-36bc-467c-8ffd-68a18c75872d admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:19:18.134155 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6221f6-36bc-467c-8ffd-68a18c75872d admin admin] PATH_INFO: `/v3/projects/f2d7d77c3c704bf9b85b9caf0030404f/users/23d2a7fb58644c38ae8cd7fa28bf32ed/roles/55ba49fe29884e64b57c3ad13188d554` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:19:18.148483 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6221f6-36bc-467c-8ffd-68a18c75872d admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2d7d77c3c704bf9b85b9caf0030404f, user_id=23d2a7fb58644c38ae8cd7fa28bf32ed, role_id=55ba49fe29884e64b57c3ad13188d554)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:19:18.151108 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6221f6-36bc-467c-8ffd-68a18c75872d admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:19:18.163987 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1145/2279] 10.222.0.58 () {60 vars in 1482 bytes} [Tue Oct 12 17:19:18 2021] PUT /identity/v3/projects/f2d7d77c3c704bf9b85b9caf0030404f/users/23d2a7fb58644c38ae8cd7fa28bf32ed/roles/55ba49fe29884e64b57c3ad13188d554 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 17:19:18.175261 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1314e89-ba04-44b5-a4e8-e2cb6900bab5 None None] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:19:18.175556 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1314e89-ba04-44b5-a4e8-e2cb6900bab5 None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:19:18.175839 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1314e89-ba04-44b5-a4e8-e2cb6900bab5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:19:18.201643 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.auth.core [None req-e1314e89-ba04-44b5-a4e8-e2cb6900bab5 None None] MFA Rules not processed for user `23d2a7fb58644c38ae8cd7fa28bf32ed`. Rule list: `[]` (Enabled: `True`). {{(pid=85205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 17:19:18.202886 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-e1314e89-ba04-44b5-a4e8-e2cb6900bab5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:19:18.265510 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1135/2280] 10.222.0.58 () {58 vars in 957 bytes} [Tue Oct 12 17:19:18 2021] POST /identity/v3/auth/tokens => generated 3409 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 17:19:18.270156 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6221f6-36bc-467c-8ffd-68a18c75872d admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:19:18.328839 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6221f6-36bc-467c-8ffd-68a18c75872d admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:19:18.333418 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5039f31-7036-472f-af0d-ea64f9df7dba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:19:18.334098 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5039f31-7036-472f-af0d-ea64f9df7dba admin admin] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:19:18.334383 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5039f31-7036-472f-af0d-ea64f9df7dba admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:19:18.334662 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5039f31-7036-472f-af0d-ea64f9df7dba admin admin] PATH_INFO: `/v3/projects` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:19:18.335367 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5039f31-7036-472f-af0d-ea64f9df7dba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:19:18.337229 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5039f31-7036-472f-af0d-ea64f9df7dba admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:19:18.361245 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1146/2281] 10.222.0.58 () {60 vars in 1152 bytes} [Tue Oct 12 17:19:18 2021] POST /identity/v3/projects => generated 389 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 17:19:18.365297 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1314e89-ba04-44b5-a4e8-e2cb6900bab5 None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:19:18.376212 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1314e89-ba04-44b5-a4e8-e2cb6900bab5 None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:19:18.431808 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b35e75-b883-4862-973d-e90421991a02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:19:18.432484 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b35e75-b883-4862-973d-e90421991a02 admin admin] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:19:18.432764 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b35e75-b883-4862-973d-e90421991a02 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:19:18.433037 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b35e75-b883-4862-973d-e90421991a02 admin admin] PATH_INFO: `/v3/users` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:19:18.433752 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b35e75-b883-4862-973d-e90421991a02 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:19:18.435667 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b35e75-b883-4862-973d-e90421991a02 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:19:18.455395 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1136/2282] 10.222.0.58 () {60 vars in 1143 bytes} [Tue Oct 12 17:19:18 2021] POST /identity/v3/users => generated 301 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 17:19:18.458630 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5039f31-7036-472f-af0d-ea64f9df7dba admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:19:18.468485 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5039f31-7036-472f-af0d-ea64f9df7dba admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:19:18.473448 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767ee957-7767-4c85-8401-e8f75f3cdd5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:19:18.474119 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767ee957-7767-4c85-8401-e8f75f3cdd5b admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:19:18.474402 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767ee957-7767-4c85-8401-e8f75f3cdd5b admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:19:18.474675 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767ee957-7767-4c85-8401-e8f75f3cdd5b admin admin] PATH_INFO: `/v3/roles` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:19:18.475538 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767ee957-7767-4c85-8401-e8f75f3cdd5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:19:18.477097 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767ee957-7767-4c85-8401-e8f75f3cdd5b admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:19:18.488402 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1147/2283] 10.222.0.58 () {58 vars in 1121 bytes} [Tue Oct 12 17:19:18 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 17:19:18.492391 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b35e75-b883-4862-973d-e90421991a02 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:19:18.502777 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b35e75-b883-4862-973d-e90421991a02 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:19:18.507773 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00ba061-1290-4d7f-b543-6580b1d154a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:19:18.508684 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00ba061-1290-4d7f-b543-6580b1d154a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:19:18.508795 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00ba061-1290-4d7f-b543-6580b1d154a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:19:18.509064 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00ba061-1290-4d7f-b543-6580b1d154a9 admin admin] PATH_INFO: `/v3/projects/02888ed5892b40db9e9987d8bea23d57/users/f29cc6d5716a4cfd8c245cfcba7a7980/roles/610824e4f50f4fb8954610e98c1de784` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:19:18.523859 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00ba061-1290-4d7f-b543-6580b1d154a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=02888ed5892b40db9e9987d8bea23d57, user_id=f29cc6d5716a4cfd8c245cfcba7a7980, role_id=610824e4f50f4fb8954610e98c1de784)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:19:18.526504 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00ba061-1290-4d7f-b543-6580b1d154a9 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:19:18.539160 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1137/2284] 10.222.0.58 () {60 vars in 1482 bytes} [Tue Oct 12 17:19:18 2021] PUT /identity/v3/projects/02888ed5892b40db9e9987d8bea23d57/users/f29cc6d5716a4cfd8c245cfcba7a7980/roles/610824e4f50f4fb8954610e98c1de784 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 17:19:18.543127 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767ee957-7767-4c85-8401-e8f75f3cdd5b admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:19:18.553361 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767ee957-7767-4c85-8401-e8f75f3cdd5b admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:19:18.605632 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a421af2-1461-4a27-995d-f16c6c29db62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:19:18.606362 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a421af2-1461-4a27-995d-f16c6c29db62 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:19:18.606651 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a421af2-1461-4a27-995d-f16c6c29db62 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:19:18.606932 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a421af2-1461-4a27-995d-f16c6c29db62 admin admin] PATH_INFO: `/v3/roles` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:19:18.607673 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a421af2-1461-4a27-995d-f16c6c29db62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:19:18.609267 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a421af2-1461-4a27-995d-f16c6c29db62 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:19:18.619232 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1148/2285] 10.222.0.58 () {58 vars in 1121 bytes} [Tue Oct 12 17:19:18 2021] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 17:19:18.623404 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00ba061-1290-4d7f-b543-6580b1d154a9 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:19:18.633608 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00ba061-1290-4d7f-b543-6580b1d154a9 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:19:18.638208 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94baba4d-b967-41be-bc6d-29092c7e8db8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:19:18.639076 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94baba4d-b967-41be-bc6d-29092c7e8db8 admin admin] REQUEST_METHOD: `PUT` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:19:18.639360 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94baba4d-b967-41be-bc6d-29092c7e8db8 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:19:18.639638 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94baba4d-b967-41be-bc6d-29092c7e8db8 admin admin] PATH_INFO: `/v3/projects/02888ed5892b40db9e9987d8bea23d57/users/f29cc6d5716a4cfd8c245cfcba7a7980/roles/610824e4f50f4fb8954610e98c1de784` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:19:18.641608 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94baba4d-b967-41be-bc6d-29092c7e8db8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=02888ed5892b40db9e9987d8bea23d57, user_id=f29cc6d5716a4cfd8c245cfcba7a7980, role_id=610824e4f50f4fb8954610e98c1de784)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:19:18.644227 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94baba4d-b967-41be-bc6d-29092c7e8db8 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:19:18.654397 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1138/2286] 10.222.0.58 () {60 vars in 1482 bytes} [Tue Oct 12 17:19:18 2021] PUT /identity/v3/projects/02888ed5892b40db9e9987d8bea23d57/users/f29cc6d5716a4cfd8c245cfcba7a7980/roles/610824e4f50f4fb8954610e98c1de784 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 17:19:18.664631 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7110fe-5d86-4f34-8dce-906a75afe30b None None] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:19:18.664923 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7110fe-5d86-4f34-8dce-906a75afe30b None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:19:18.665199 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7110fe-5d86-4f34-8dce-906a75afe30b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:19:18.690980 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.auth.core [None req-fb7110fe-5d86-4f34-8dce-906a75afe30b None None] MFA Rules not processed for user `f29cc6d5716a4cfd8c245cfcba7a7980`. Rule list: `[]` (Enabled: `True`). {{(pid=85204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 17:19:18.692180 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-fb7110fe-5d86-4f34-8dce-906a75afe30b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:19:18.759640 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1149/2287] 10.222.0.58 () {58 vars in 957 bytes} [Tue Oct 12 17:19:18 2021] POST /identity/v3/auth/tokens => generated 3476 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 17:19:18.769353 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94baba4d-b967-41be-bc6d-29092c7e8db8 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:19:18.771061 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-94baba4d-b967-41be-bc6d-29092c7e8db8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:19:18.827708 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94baba4d-b967-41be-bc6d-29092c7e8db8 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:19:18.832140 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8322e248-4536-4c9a-a804-0ea44d53fb09 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04704222b3d64a33a6c092fc641ccbb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:19:18.832778 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8322e248-4536-4c9a-a804-0ea44d53fb09 service cinder] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:19:18.833063 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8322e248-4536-4c9a-a804-0ea44d53fb09 service cinder] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:19:18.833339 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8322e248-4536-4c9a-a804-0ea44d53fb09 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:19:18.842304 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8322e248-4536-4c9a-a804-0ea44d53fb09 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:19:18.843757 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8322e248-4536-4c9a-a804-0ea44d53fb09 service cinder] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:19:18.853551 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1139/2288] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Oct 12 17:19:18 2021] GET /identity/v3/auth/tokens => generated 3476 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 17:19:18.966858 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7110fe-5d86-4f34-8dce-906a75afe30b None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:19:19.025846 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7110fe-5d86-4f34-8dce-906a75afe30b None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:19:19.030547 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa12e9d-4c33-4327-bec3-9f002013391f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:19:19.031411 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa12e9d-4c33-4327-bec3-9f002013391f admin admin] REQUEST_METHOD: `DELETE` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:19:19.032268 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa12e9d-4c33-4327-bec3-9f002013391f admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:19:19.032534 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa12e9d-4c33-4327-bec3-9f002013391f admin admin] PATH_INFO: `/v3/users/23d2a7fb58644c38ae8cd7fa28bf32ed` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:19:19.033809 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa12e9d-4c33-4327-bec3-9f002013391f admin admin] RBAC: Authorizing `identity:delete_user(user_id=23d2a7fb58644c38ae8cd7fa28bf32ed)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:19:19.035726 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa12e9d-4c33-4327-bec3-9f002013391f admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:19:19.080376 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-4fa12e9d-4c33-4327-bec3-9f002013391f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '23d2a7fb58644c38ae8cd7fa28bf32ed'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:19:19.091338 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-4fa12e9d-4c33-4327-bec3-9f002013391f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '23d2a7fb58644c38ae8cd7fa28bf32ed'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:19:19.098416 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-4fa12e9d-4c33-4327-bec3-9f002013391f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '23d2a7fb58644c38ae8cd7fa28bf32ed'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:19:19.105341 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-4fa12e9d-4c33-4327-bec3-9f002013391f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '23d2a7fb58644c38ae8cd7fa28bf32ed'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:19:19.106106 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-4fa12e9d-4c33-4327-bec3-9f002013391f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '23d2a7fb58644c38ae8cd7fa28bf32ed'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:19:19.111913 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1150/2289] 10.222.0.58 () {58 vars in 1223 bytes} [Tue Oct 12 17:19:18 2021] DELETE /identity/v3/users/23d2a7fb58644c38ae8cd7fa28bf32ed => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 17:19:19.116371 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f56eee0-05bb-4543-9e5e-f799c2fcfb29 None None] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:19:19.116668 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f56eee0-05bb-4543-9e5e-f799c2fcfb29 None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:19:19.116951 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f56eee0-05bb-4543-9e5e-f799c2fcfb29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:19:19.133462 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.auth.core [None req-6f56eee0-05bb-4543-9e5e-f799c2fcfb29 None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 17:19:19.134697 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-6f56eee0-05bb-4543-9e5e-f799c2fcfb29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:19:19.194606 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1140/2290] 10.222.0.58 () {58 vars in 957 bytes} [Tue Oct 12 17:19:19 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 17:19:19.204941 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa12e9d-4c33-4327-bec3-9f002013391f admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:19:19.206436 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-4fa12e9d-4c33-4327-bec3-9f002013391f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:19:19.260568 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa12e9d-4c33-4327-bec3-9f002013391f admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:19:19.264171 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5304004a-0329-44e7-a06f-52a85bef6fbf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e65f6d0598e4c539134292b86fb43d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:19:19.264801 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5304004a-0329-44e7-a06f-52a85bef6fbf service neutron] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:19:19.265080 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5304004a-0329-44e7-a06f-52a85bef6fbf service neutron] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:19:19.265351 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5304004a-0329-44e7-a06f-52a85bef6fbf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:19:19.274629 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5304004a-0329-44e7-a06f-52a85bef6fbf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:19:19.276084 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5304004a-0329-44e7-a06f-52a85bef6fbf service neutron] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:19:19.285063 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1151/2291] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Oct 12 17:19:19 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 17:19:19.571345 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f56eee0-05bb-4543-9e5e-f799c2fcfb29 None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:19:19.573530 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-6f56eee0-05bb-4543-9e5e-f799c2fcfb29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:19:19.591304 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f56eee0-05bb-4543-9e5e-f799c2fcfb29 None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:19:19.596469 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d0ab18-4335-4280-b092-a646f0a871dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:19:19.597282 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d0ab18-4335-4280-b092-a646f0a871dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:19:19.597562 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d0ab18-4335-4280-b092-a646f0a871dd admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:19:19.597838 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d0ab18-4335-4280-b092-a646f0a871dd admin admin] PATH_INFO: `/v3/projects/f2d7d77c3c704bf9b85b9caf0030404f` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:19:19.599049 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d0ab18-4335-4280-b092-a646f0a871dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=f2d7d77c3c704bf9b85b9caf0030404f)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:19:19.600969 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d0ab18-4335-4280-b092-a646f0a871dd admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:19:19.645860 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-26d0ab18-4335-4280-b092-a646f0a871dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f2d7d77c3c704bf9b85b9caf0030404f', 'request_id': 'req-26d0ab18-4335-4280-b092-a646f0a871dd'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:19:19.651236 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-26d0ab18-4335-4280-b092-a646f0a871dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f2d7d77c3c704bf9b85b9caf0030404f', 'request_id': 'req-26d0ab18-4335-4280-b092-a646f0a871dd'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:19:19.657609 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-26d0ab18-4335-4280-b092-a646f0a871dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f2d7d77c3c704bf9b85b9caf0030404f', 'request_id': 'req-26d0ab18-4335-4280-b092-a646f0a871dd'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:19:19.668817 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-26d0ab18-4335-4280-b092-a646f0a871dd admin admin] The token cache is being invalidate because project f2d7d77c3c704bf9b85b9caf0030404f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=85205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 17:19:19.669103 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-26d0ab18-4335-4280-b092-a646f0a871dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:19:19.669724 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-26d0ab18-4335-4280-b092-a646f0a871dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:19:19.671253 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1141/2292] 10.222.0.58 () {58 vars in 1232 bytes} [Tue Oct 12 17:19:19 2021] DELETE /identity/v3/projects/f2d7d77c3c704bf9b85b9caf0030404f => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 17:19:19.675376 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5304004a-0329-44e7-a06f-52a85bef6fbf service neutron] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:19:19.684848 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5304004a-0329-44e7-a06f-52a85bef6fbf service neutron] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:19:19.744570 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3040482f-22cb-4391-ae9d-aa1ed3001788 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:19:19.745456 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3040482f-22cb-4391-ae9d-aa1ed3001788 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:19:19.745738 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3040482f-22cb-4391-ae9d-aa1ed3001788 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:19:19.746045 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3040482f-22cb-4391-ae9d-aa1ed3001788 admin admin] PATH_INFO: `/v3/users/f29cc6d5716a4cfd8c245cfcba7a7980` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:19:19.747259 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3040482f-22cb-4391-ae9d-aa1ed3001788 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f29cc6d5716a4cfd8c245cfcba7a7980)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:19:19.749203 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3040482f-22cb-4391-ae9d-aa1ed3001788 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:19:19.793067 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-3040482f-22cb-4391-ae9d-aa1ed3001788 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f29cc6d5716a4cfd8c245cfcba7a7980'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:19:19.804422 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-3040482f-22cb-4391-ae9d-aa1ed3001788 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f29cc6d5716a4cfd8c245cfcba7a7980'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:19:19.811316 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-3040482f-22cb-4391-ae9d-aa1ed3001788 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f29cc6d5716a4cfd8c245cfcba7a7980'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:19:19.818280 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-3040482f-22cb-4391-ae9d-aa1ed3001788 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f29cc6d5716a4cfd8c245cfcba7a7980'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:19:19.818984 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-3040482f-22cb-4391-ae9d-aa1ed3001788 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f29cc6d5716a4cfd8c245cfcba7a7980'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:19:19.824796 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1152/2293] 10.222.0.58 () {58 vars in 1223 bytes} [Tue Oct 12 17:19:19 2021] DELETE /identity/v3/users/f29cc6d5716a4cfd8c245cfcba7a7980 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 17:19:20.094621 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d0ab18-4335-4280-b092-a646f0a871dd admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:19:20.096239 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-26d0ab18-4335-4280-b092-a646f0a871dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:19:20.112029 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d0ab18-4335-4280-b092-a646f0a871dd admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:19:20.180537 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23339d7c-fbcf-4d0d-8f84-0a74c6696b01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:19:20.181529 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23339d7c-fbcf-4d0d-8f84-0a74c6696b01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:19:20.181826 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23339d7c-fbcf-4d0d-8f84-0a74c6696b01 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:19:20.182135 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23339d7c-fbcf-4d0d-8f84-0a74c6696b01 admin admin] PATH_INFO: `/v3/projects/02888ed5892b40db9e9987d8bea23d57` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:19:20.183352 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23339d7c-fbcf-4d0d-8f84-0a74c6696b01 admin admin] RBAC: Authorizing `identity:delete_project(project_id=02888ed5892b40db9e9987d8bea23d57)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:19:20.185228 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23339d7c-fbcf-4d0d-8f84-0a74c6696b01 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:19:20.231435 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-23339d7c-fbcf-4d0d-8f84-0a74c6696b01 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '02888ed5892b40db9e9987d8bea23d57', 'request_id': 'req-23339d7c-fbcf-4d0d-8f84-0a74c6696b01'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:19:20.236662 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-23339d7c-fbcf-4d0d-8f84-0a74c6696b01 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '02888ed5892b40db9e9987d8bea23d57', 'request_id': 'req-23339d7c-fbcf-4d0d-8f84-0a74c6696b01'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:19:20.242731 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-23339d7c-fbcf-4d0d-8f84-0a74c6696b01 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '02888ed5892b40db9e9987d8bea23d57', 'request_id': 'req-23339d7c-fbcf-4d0d-8f84-0a74c6696b01'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:19:20.259217 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-23339d7c-fbcf-4d0d-8f84-0a74c6696b01 admin admin] The token cache is being invalidate because project 02888ed5892b40db9e9987d8bea23d57 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=85205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 17:19:20.259510 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-23339d7c-fbcf-4d0d-8f84-0a74c6696b01 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:19:20.260163 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-23339d7c-fbcf-4d0d-8f84-0a74c6696b01 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:19:20.261753 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1142/2294] 10.222.0.58 () {58 vars in 1232 bytes} [Tue Oct 12 17:19:20 2021] DELETE /identity/v3/projects/02888ed5892b40db9e9987d8bea23d57 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 17:19:20.269210 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6941953-b8fd-422f-8f67-04bd6814c882 None None] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:19:20.269497 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6941953-b8fd-422f-8f67-04bd6814c882 None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:19:20.269978 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6941953-b8fd-422f-8f67-04bd6814c882 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:19:20.288136 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.auth.core [None req-d6941953-b8fd-422f-8f67-04bd6814c882 None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 17:19:20.290531 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-d6941953-b8fd-422f-8f67-04bd6814c882 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:19:20.349101 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1153/2295] 10.222.0.58 () {58 vars in 957 bytes} [Tue Oct 12 17:19:20 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 17:19:20.357843 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364915a1-07d0-4851-bbe6-c251915e4583 None None] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:19:20.358170 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364915a1-07d0-4851-bbe6-c251915e4583 None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:19:20.358452 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364915a1-07d0-4851-bbe6-c251915e4583 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:19:20.381984 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.auth.core [None req-364915a1-07d0-4851-bbe6-c251915e4583 None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 17:19:20.383203 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-364915a1-07d0-4851-bbe6-c251915e4583 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:19:20.391148 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1143/2296] 10.222.0.58 () {58 vars in 957 bytes} [Tue Oct 12 17:19:20 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 17:19:20.395408 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6941953-b8fd-422f-8f67-04bd6814c882 None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:19:20.404967 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6941953-b8fd-422f-8f67-04bd6814c882 None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:19:20.409523 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcd919d-3eec-4e5f-b1be-5611405847d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:19:20.410217 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcd919d-3eec-4e5f-b1be-5611405847d1 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:19:20.410501 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcd919d-3eec-4e5f-b1be-5611405847d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:19:20.410778 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcd919d-3eec-4e5f-b1be-5611405847d1 admin admin] PATH_INFO: `/v3/domains` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:19:20.411513 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcd919d-3eec-4e5f-b1be-5611405847d1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 17:19:20.411825 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcd919d-3eec-4e5f-b1be-5611405847d1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:19:20.413399 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcd919d-3eec-4e5f-b1be-5611405847d1 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:19:20.425332 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1154/2297] 10.222.0.58 () {58 vars in 1152 bytes} [Tue Oct 12 17:19:20 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 17:19:20.429597 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364915a1-07d0-4851-bbe6-c251915e4583 None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:19:20.439327 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364915a1-07d0-4851-bbe6-c251915e4583 None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:19:20.444051 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b1bd52-ab75-4f14-a7f9-ad219d393cbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:19:20.444702 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b1bd52-ab75-4f14-a7f9-ad219d393cbf admin admin] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:19:20.444989 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b1bd52-ab75-4f14-a7f9-ad219d393cbf admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:19:20.445270 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b1bd52-ab75-4f14-a7f9-ad219d393cbf admin admin] PATH_INFO: `/v3/projects` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:19:20.446018 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b1bd52-ab75-4f14-a7f9-ad219d393cbf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:19:20.447887 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b1bd52-ab75-4f14-a7f9-ad219d393cbf admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:19:20.472614 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1144/2298] 10.222.0.58 () {60 vars in 1152 bytes} [Tue Oct 12 17:19:20 2021] POST /identity/v3/projects => generated 379 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 17:19:20.476703 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcd919d-3eec-4e5f-b1be-5611405847d1 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:19:20.488608 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcd919d-3eec-4e5f-b1be-5611405847d1 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:19:20.543798 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e348c279-31a2-4145-b996-05981cb43e85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:19:20.544473 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e348c279-31a2-4145-b996-05981cb43e85 admin admin] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:19:20.544759 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e348c279-31a2-4145-b996-05981cb43e85 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:19:20.545038 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e348c279-31a2-4145-b996-05981cb43e85 admin admin] PATH_INFO: `/v3/users` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:19:20.545754 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e348c279-31a2-4145-b996-05981cb43e85 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:19:20.548204 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e348c279-31a2-4145-b996-05981cb43e85 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:19:20.568475 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1155/2299] 10.222.0.58 () {60 vars in 1143 bytes} [Tue Oct 12 17:19:20 2021] POST /identity/v3/users => generated 290 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 17:19:20.572784 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b1bd52-ab75-4f14-a7f9-ad219d393cbf admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:19:20.583966 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b1bd52-ab75-4f14-a7f9-ad219d393cbf admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:19:20.588293 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a9a2e3-920d-4d45-b455-6f535f1f2717 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:19:20.588962 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a9a2e3-920d-4d45-b455-6f535f1f2717 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:19:20.589253 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a9a2e3-920d-4d45-b455-6f535f1f2717 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:19:20.589555 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a9a2e3-920d-4d45-b455-6f535f1f2717 admin admin] PATH_INFO: `/v3/roles` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:19:20.590337 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a9a2e3-920d-4d45-b455-6f535f1f2717 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:19:20.591931 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a9a2e3-920d-4d45-b455-6f535f1f2717 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:19:20.605615 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1145/2300] 10.222.0.58 () {58 vars in 1121 bytes} [Tue Oct 12 17:19:20 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 17:19:20.606866 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e348c279-31a2-4145-b996-05981cb43e85 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:19:20.617761 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e348c279-31a2-4145-b996-05981cb43e85 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:19:20.622557 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e67b5f-7b87-400b-8898-6d4d70ef585e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:19:20.623225 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e67b5f-7b87-400b-8898-6d4d70ef585e admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:19:20.623509 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e67b5f-7b87-400b-8898-6d4d70ef585e admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:19:20.623785 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e67b5f-7b87-400b-8898-6d4d70ef585e admin admin] PATH_INFO: `/v3/roles` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:19:20.624560 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e67b5f-7b87-400b-8898-6d4d70ef585e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:19:20.626835 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e67b5f-7b87-400b-8898-6d4d70ef585e admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:19:20.637294 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1156/2301] 10.222.0.58 () {58 vars in 1121 bytes} [Tue Oct 12 17:19:20 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 17:19:20.642121 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a9a2e3-920d-4d45-b455-6f535f1f2717 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:19:20.652019 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a9a2e3-920d-4d45-b455-6f535f1f2717 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:19:20.657364 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bc56be-df79-4e53-b4af-ba4478285cf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:19:20.658284 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bc56be-df79-4e53-b4af-ba4478285cf8 admin admin] REQUEST_METHOD: `PUT` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:19:20.658572 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bc56be-df79-4e53-b4af-ba4478285cf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:19:20.658853 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bc56be-df79-4e53-b4af-ba4478285cf8 admin admin] PATH_INFO: `/v3/projects/8e0d28657c2e4b1a8db6db328ad189a9/users/dffbdd05e3994f19b498a19f9bfd7def/roles/55ba49fe29884e64b57c3ad13188d554` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:19:20.672903 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bc56be-df79-4e53-b4af-ba4478285cf8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e0d28657c2e4b1a8db6db328ad189a9, user_id=dffbdd05e3994f19b498a19f9bfd7def, role_id=55ba49fe29884e64b57c3ad13188d554)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:19:20.675562 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bc56be-df79-4e53-b4af-ba4478285cf8 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:19:20.689083 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1146/2302] 10.222.0.58 () {60 vars in 1482 bytes} [Tue Oct 12 17:19:20 2021] PUT /identity/v3/projects/8e0d28657c2e4b1a8db6db328ad189a9/users/dffbdd05e3994f19b498a19f9bfd7def/roles/55ba49fe29884e64b57c3ad13188d554 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 17:19:20.699060 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6255a85-e3df-4ac0-ab13-c08bbaa12674 None None] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:19:20.699587 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6255a85-e3df-4ac0-ab13-c08bbaa12674 None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:19:20.699706 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6255a85-e3df-4ac0-ab13-c08bbaa12674 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:19:20.725944 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.auth.core [None req-a6255a85-e3df-4ac0-ab13-c08bbaa12674 None None] MFA Rules not processed for user `dffbdd05e3994f19b498a19f9bfd7def`. Rule list: `[]` (Enabled: `True`). {{(pid=85204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 17:19:20.727145 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-a6255a85-e3df-4ac0-ab13-c08bbaa12674 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:19:20.790845 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1157/2303] 10.222.0.58 () {58 vars in 957 bytes} [Tue Oct 12 17:19:20 2021] POST /identity/v3/auth/tokens => generated 3399 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 17:19:20.795262 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bc56be-df79-4e53-b4af-ba4478285cf8 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:19:20.854306 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bc56be-df79-4e53-b4af-ba4478285cf8 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:19:20.858931 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8039ae-17fb-4646-8f12-58c57fdf13d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:19:20.859589 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8039ae-17fb-4646-8f12-58c57fdf13d7 admin admin] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:19:20.859951 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8039ae-17fb-4646-8f12-58c57fdf13d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:19:20.860232 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8039ae-17fb-4646-8f12-58c57fdf13d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:19:20.860942 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8039ae-17fb-4646-8f12-58c57fdf13d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:19:20.862845 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8039ae-17fb-4646-8f12-58c57fdf13d7 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:19:20.887461 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1147/2304] 10.222.0.58 () {60 vars in 1152 bytes} [Tue Oct 12 17:19:20 2021] POST /identity/v3/projects => generated 379 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 17:19:20.892108 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6255a85-e3df-4ac0-ab13-c08bbaa12674 None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:19:20.902402 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6255a85-e3df-4ac0-ab13-c08bbaa12674 None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:19:20.955332 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724ab9b4-50e1-4518-85a5-5fbd85b3b16c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:19:20.956010 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724ab9b4-50e1-4518-85a5-5fbd85b3b16c admin admin] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:19:20.956298 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724ab9b4-50e1-4518-85a5-5fbd85b3b16c admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:19:20.956580 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724ab9b4-50e1-4518-85a5-5fbd85b3b16c admin admin] PATH_INFO: `/v3/users` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:19:20.957301 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724ab9b4-50e1-4518-85a5-5fbd85b3b16c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:19:20.959226 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724ab9b4-50e1-4518-85a5-5fbd85b3b16c admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:19:20.978894 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1158/2305] 10.222.0.58 () {60 vars in 1143 bytes} [Tue Oct 12 17:19:20 2021] POST /identity/v3/users => generated 290 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 17:19:20.982973 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8039ae-17fb-4646-8f12-58c57fdf13d7 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:19:20.993140 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8039ae-17fb-4646-8f12-58c57fdf13d7 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:19:20.997691 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38688161-3b92-4a74-9003-ffe5c8aad361 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:19:20.998406 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38688161-3b92-4a74-9003-ffe5c8aad361 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:19:20.998690 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38688161-3b92-4a74-9003-ffe5c8aad361 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:19:20.998965 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38688161-3b92-4a74-9003-ffe5c8aad361 admin admin] PATH_INFO: `/v3/roles` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:19:20.999695 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38688161-3b92-4a74-9003-ffe5c8aad361 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:19:21.001771 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38688161-3b92-4a74-9003-ffe5c8aad361 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:19:21.012738 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1148/2306] 10.222.0.58 () {58 vars in 1121 bytes} [Tue Oct 12 17:19:20 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 17:19:21.016931 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724ab9b4-50e1-4518-85a5-5fbd85b3b16c admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:19:21.026729 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724ab9b4-50e1-4518-85a5-5fbd85b3b16c admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:19:21.031399 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b577be4-c60b-4af2-98e4-88adc9e21c4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:19:21.032539 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b577be4-c60b-4af2-98e4-88adc9e21c4c admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:19:21.032825 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b577be4-c60b-4af2-98e4-88adc9e21c4c admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:19:21.033107 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b577be4-c60b-4af2-98e4-88adc9e21c4c admin admin] PATH_INFO: `/v3/roles` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:19:21.033851 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b577be4-c60b-4af2-98e4-88adc9e21c4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:19:21.035469 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b577be4-c60b-4af2-98e4-88adc9e21c4c admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:19:21.044918 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1159/2307] 10.222.0.58 () {58 vars in 1121 bytes} [Tue Oct 12 17:19:21 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 17:19:21.049214 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38688161-3b92-4a74-9003-ffe5c8aad361 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:19:21.058752 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38688161-3b92-4a74-9003-ffe5c8aad361 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:19:21.063439 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81917e0b-a784-4152-8995-fa05f580aa22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:19:21.064293 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81917e0b-a784-4152-8995-fa05f580aa22 admin admin] REQUEST_METHOD: `PUT` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:19:21.064577 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81917e0b-a784-4152-8995-fa05f580aa22 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:19:21.064855 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81917e0b-a784-4152-8995-fa05f580aa22 admin admin] PATH_INFO: `/v3/projects/edcded9daddc422fa0ba3d9276f1afa2/users/b91ae80886ec4cfdbc18f0de8c1d87ae/roles/55ba49fe29884e64b57c3ad13188d554` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:19:21.079203 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81917e0b-a784-4152-8995-fa05f580aa22 admin admin] RBAC: Authorizing `identity:create_grant(project_id=edcded9daddc422fa0ba3d9276f1afa2, user_id=b91ae80886ec4cfdbc18f0de8c1d87ae, role_id=55ba49fe29884e64b57c3ad13188d554)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:19:21.081810 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81917e0b-a784-4152-8995-fa05f580aa22 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:19:21.094020 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1149/2308] 10.222.0.58 () {60 vars in 1482 bytes} [Tue Oct 12 17:19:21 2021] PUT /identity/v3/projects/edcded9daddc422fa0ba3d9276f1afa2/users/b91ae80886ec4cfdbc18f0de8c1d87ae/roles/55ba49fe29884e64b57c3ad13188d554 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 17:19:21.104482 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba95e850-c7bd-4ce4-a08c-208f442410c0 None None] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:19:21.104712 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba95e850-c7bd-4ce4-a08c-208f442410c0 None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:19:21.104989 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba95e850-c7bd-4ce4-a08c-208f442410c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:19:21.131235 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.auth.core [None req-ba95e850-c7bd-4ce4-a08c-208f442410c0 None None] MFA Rules not processed for user `b91ae80886ec4cfdbc18f0de8c1d87ae`. Rule list: `[]` (Enabled: `True`). {{(pid=85204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 17:19:21.132436 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-ba95e850-c7bd-4ce4-a08c-208f442410c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:19:21.197663 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1160/2309] 10.222.0.58 () {58 vars in 957 bytes} [Tue Oct 12 17:19:21 2021] POST /identity/v3/auth/tokens => generated 3399 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 17:19:21.202173 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81917e0b-a784-4152-8995-fa05f580aa22 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:19:21.261414 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81917e0b-a784-4152-8995-fa05f580aa22 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:19:21.266649 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd12195-5002-4f71-8916-b109f6d76758 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:19:21.267283 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd12195-5002-4f71-8916-b109f6d76758 admin admin] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:19:21.267565 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd12195-5002-4f71-8916-b109f6d76758 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:19:21.267839 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd12195-5002-4f71-8916-b109f6d76758 admin admin] PATH_INFO: `/v3/projects` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:19:21.268542 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd12195-5002-4f71-8916-b109f6d76758 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:19:21.270429 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd12195-5002-4f71-8916-b109f6d76758 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:19:21.295808 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1150/2310] 10.222.0.58 () {60 vars in 1152 bytes} [Tue Oct 12 17:19:21 2021] POST /identity/v3/projects => generated 375 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 17:19:21.299876 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba95e850-c7bd-4ce4-a08c-208f442410c0 None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:19:21.310535 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba95e850-c7bd-4ce4-a08c-208f442410c0 None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:19:21.363404 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bc4d5a-c065-4d2d-9ed6-ed82eb5d0bff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:19:21.363985 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bc4d5a-c065-4d2d-9ed6-ed82eb5d0bff admin admin] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:19:21.364264 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bc4d5a-c065-4d2d-9ed6-ed82eb5d0bff admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:19:21.364534 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bc4d5a-c065-4d2d-9ed6-ed82eb5d0bff admin admin] PATH_INFO: `/v3/users` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:19:21.365219 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bc4d5a-c065-4d2d-9ed6-ed82eb5d0bff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:19:21.367120 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bc4d5a-c065-4d2d-9ed6-ed82eb5d0bff admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:19:21.386161 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1161/2311] 10.222.0.58 () {60 vars in 1143 bytes} [Tue Oct 12 17:19:21 2021] POST /identity/v3/users => generated 294 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 17:19:21.390184 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd12195-5002-4f71-8916-b109f6d76758 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:19:21.400600 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd12195-5002-4f71-8916-b109f6d76758 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:19:21.405657 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bf2853-0e57-4b1c-8628-a0811fd1b8a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:19:21.406366 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bf2853-0e57-4b1c-8628-a0811fd1b8a4 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:19:21.407207 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bf2853-0e57-4b1c-8628-a0811fd1b8a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:19:21.407490 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bf2853-0e57-4b1c-8628-a0811fd1b8a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:19:21.408240 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bf2853-0e57-4b1c-8628-a0811fd1b8a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:19:21.409934 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bf2853-0e57-4b1c-8628-a0811fd1b8a4 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:19:21.421498 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1151/2312] 10.222.0.58 () {58 vars in 1121 bytes} [Tue Oct 12 17:19:21 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 17:19:21.425675 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bc4d5a-c065-4d2d-9ed6-ed82eb5d0bff admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:19:21.435603 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bc4d5a-c065-4d2d-9ed6-ed82eb5d0bff admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:19:21.440634 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01208dc7-9860-4bd1-b3c6-4f8d667aacac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:19:21.441497 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01208dc7-9860-4bd1-b3c6-4f8d667aacac admin admin] REQUEST_METHOD: `PUT` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:19:21.441772 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01208dc7-9860-4bd1-b3c6-4f8d667aacac admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:19:21.442073 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01208dc7-9860-4bd1-b3c6-4f8d667aacac admin admin] PATH_INFO: `/v3/projects/ab383980939340bbb71d87ed5a8c2122/users/eee59f28c1554430b1b7654df252a01a/roles/610824e4f50f4fb8954610e98c1de784` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:19:21.456468 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01208dc7-9860-4bd1-b3c6-4f8d667aacac admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab383980939340bbb71d87ed5a8c2122, user_id=eee59f28c1554430b1b7654df252a01a, role_id=610824e4f50f4fb8954610e98c1de784)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:19:21.459075 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01208dc7-9860-4bd1-b3c6-4f8d667aacac admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:19:21.471231 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1162/2313] 10.222.0.58 () {60 vars in 1482 bytes} [Tue Oct 12 17:19:21 2021] PUT /identity/v3/projects/ab383980939340bbb71d87ed5a8c2122/users/eee59f28c1554430b1b7654df252a01a/roles/610824e4f50f4fb8954610e98c1de784 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 17:19:21.474975 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bf2853-0e57-4b1c-8628-a0811fd1b8a4 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:19:21.484902 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bf2853-0e57-4b1c-8628-a0811fd1b8a4 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:19:21.548984 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a51ee4e-1b1f-46b6-a258-37e9bb6c12db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:19:21.549686 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a51ee4e-1b1f-46b6-a258-37e9bb6c12db admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:19:21.550075 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a51ee4e-1b1f-46b6-a258-37e9bb6c12db admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:19:21.550354 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a51ee4e-1b1f-46b6-a258-37e9bb6c12db admin admin] PATH_INFO: `/v3/roles` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:19:21.551092 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a51ee4e-1b1f-46b6-a258-37e9bb6c12db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:19:21.552672 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a51ee4e-1b1f-46b6-a258-37e9bb6c12db admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:19:21.562359 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1152/2314] 10.222.0.58 () {58 vars in 1121 bytes} [Tue Oct 12 17:19:21 2021] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 17:19:21.566947 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01208dc7-9860-4bd1-b3c6-4f8d667aacac admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:19:21.576927 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01208dc7-9860-4bd1-b3c6-4f8d667aacac admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:19:21.582291 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919d8ced-2be3-4d5c-9950-c465ddb70954 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:19:21.583040 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919d8ced-2be3-4d5c-9950-c465ddb70954 admin admin] REQUEST_METHOD: `PUT` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:19:21.583316 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919d8ced-2be3-4d5c-9950-c465ddb70954 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:19:21.583588 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919d8ced-2be3-4d5c-9950-c465ddb70954 admin admin] PATH_INFO: `/v3/projects/ab383980939340bbb71d87ed5a8c2122/users/eee59f28c1554430b1b7654df252a01a/roles/610824e4f50f4fb8954610e98c1de784` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:19:21.585549 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919d8ced-2be3-4d5c-9950-c465ddb70954 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab383980939340bbb71d87ed5a8c2122, user_id=eee59f28c1554430b1b7654df252a01a, role_id=610824e4f50f4fb8954610e98c1de784)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:19:21.588157 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919d8ced-2be3-4d5c-9950-c465ddb70954 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:19:21.597913 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1163/2315] 10.222.0.58 () {60 vars in 1482 bytes} [Tue Oct 12 17:19:21 2021] PUT /identity/v3/projects/ab383980939340bbb71d87ed5a8c2122/users/eee59f28c1554430b1b7654df252a01a/roles/610824e4f50f4fb8954610e98c1de784 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 17:19:21.651844 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561df50b-b98a-4470-ba1c-2f923ca67be0 None None] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:19:21.652409 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561df50b-b98a-4470-ba1c-2f923ca67be0 None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:19:21.652409 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561df50b-b98a-4470-ba1c-2f923ca67be0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:19:21.678147 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.auth.core [None req-561df50b-b98a-4470-ba1c-2f923ca67be0 None None] MFA Rules not processed for user `eee59f28c1554430b1b7654df252a01a`. Rule list: `[]` (Enabled: `True`). {{(pid=85205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 17:19:21.679353 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-561df50b-b98a-4470-ba1c-2f923ca67be0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:19:21.744914 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1153/2316] 10.222.0.58 () {58 vars in 957 bytes} [Tue Oct 12 17:19:21 2021] POST /identity/v3/auth/tokens => generated 3462 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 17:19:21.755965 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919d8ced-2be3-4d5c-9950-c465ddb70954 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:19:21.757670 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-919d8ced-2be3-4d5c-9950-c465ddb70954 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:19:21.813506 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919d8ced-2be3-4d5c-9950-c465ddb70954 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:19:21.817210 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfdd613-4ebf-4ae7-9fcc-e75fc22fe918 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04704222b3d64a33a6c092fc641ccbb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:19:21.817862 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfdd613-4ebf-4ae7-9fcc-e75fc22fe918 service cinder] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:19:21.818178 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfdd613-4ebf-4ae7-9fcc-e75fc22fe918 service cinder] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:19:21.818460 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfdd613-4ebf-4ae7-9fcc-e75fc22fe918 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:19:21.827541 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfdd613-4ebf-4ae7-9fcc-e75fc22fe918 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:19:21.828964 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfdd613-4ebf-4ae7-9fcc-e75fc22fe918 service cinder] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:19:21.838268 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1164/2317] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Oct 12 17:19:21 2021] GET /identity/v3/auth/tokens => generated 3462 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 17:19:21.877680 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561df50b-b98a-4470-ba1c-2f923ca67be0 None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:19:21.879098 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-561df50b-b98a-4470-ba1c-2f923ca67be0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:19:21.890710 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561df50b-b98a-4470-ba1c-2f923ca67be0 None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:19:21.894279 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15972fd8-1ea9-4b83-980d-47fb8baebd56 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04704222b3d64a33a6c092fc641ccbb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:19:21.894909 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15972fd8-1ea9-4b83-980d-47fb8baebd56 service cinder] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:19:21.895190 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15972fd8-1ea9-4b83-980d-47fb8baebd56 service cinder] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:19:21.895465 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15972fd8-1ea9-4b83-980d-47fb8baebd56 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:19:21.948672 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15972fd8-1ea9-4b83-980d-47fb8baebd56 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:19:21.950104 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15972fd8-1ea9-4b83-980d-47fb8baebd56 service cinder] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:19:21.958690 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1154/2318] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Oct 12 17:19:21 2021] GET /identity/v3/auth/tokens => generated 3399 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 17:19:31.706192 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfdd613-4ebf-4ae7-9fcc-e75fc22fe918 service cinder] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:19:31.714836 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfdd613-4ebf-4ae7-9fcc-e75fc22fe918 service cinder] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:19:31.718462 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69902ef-c6c4-45c8-bf8c-467f2c2a27db service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04704222b3d64a33a6c092fc641ccbb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:19:31.719174 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69902ef-c6c4-45c8-bf8c-467f2c2a27db service cinder] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:19:31.719951 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69902ef-c6c4-45c8-bf8c-467f2c2a27db service cinder] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:19:31.720235 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69902ef-c6c4-45c8-bf8c-467f2c2a27db service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:19:31.722088 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-f69902ef-c6c4-45c8-bf8c-467f2c2a27db service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:19:31.777184 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69902ef-c6c4-45c8-bf8c-467f2c2a27db service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:19:31.778635 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69902ef-c6c4-45c8-bf8c-467f2c2a27db service cinder] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:19:31.788009 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1165/2319] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Oct 12 17:19:31 2021] GET /identity/v3/auth/tokens => generated 3407 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 17:19:32.631833 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15972fd8-1ea9-4b83-980d-47fb8baebd56 service cinder] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:19:32.640324 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15972fd8-1ea9-4b83-980d-47fb8baebd56 service cinder] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:19:32.644180 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7f7e61-73cb-445a-a0ef-0a238e18b619 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04704222b3d64a33a6c092fc641ccbb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:19:32.644820 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7f7e61-73cb-445a-a0ef-0a238e18b619 service cinder] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:19:32.645104 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7f7e61-73cb-445a-a0ef-0a238e18b619 service cinder] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:19:32.645380 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7f7e61-73cb-445a-a0ef-0a238e18b619 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:19:32.647163 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-3a7f7e61-73cb-445a-a0ef-0a238e18b619 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:19:32.714410 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7f7e61-73cb-445a-a0ef-0a238e18b619 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:19:32.715811 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7f7e61-73cb-445a-a0ef-0a238e18b619 service cinder] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:19:32.725143 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1155/2320] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Oct 12 17:19:32 2021] GET /identity/v3/auth/tokens => generated 3397 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 17:20:29.823658 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69902ef-c6c4-45c8-bf8c-467f2c2a27db service cinder] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:20:29.832728 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69902ef-c6c4-45c8-bf8c-467f2c2a27db service cinder] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:20:29.836392 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19cc3d6-b6cc-4351-80e8-07fd4e062b8f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04704222b3d64a33a6c092fc641ccbb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:20:29.837023 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19cc3d6-b6cc-4351-80e8-07fd4e062b8f service cinder] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:20:29.837305 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19cc3d6-b6cc-4351-80e8-07fd4e062b8f service cinder] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:20:29.837578 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19cc3d6-b6cc-4351-80e8-07fd4e062b8f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:20:29.839372 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-d19cc3d6-b6cc-4351-80e8-07fd4e062b8f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:20:29.895390 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19cc3d6-b6cc-4351-80e8-07fd4e062b8f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:20:29.896805 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19cc3d6-b6cc-4351-80e8-07fd4e062b8f service cinder] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:20:29.905495 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1166/2321] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Oct 12 17:20:29 2021] GET /identity/v3/auth/tokens => generated 3403 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 17:21:00.347349 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7f7e61-73cb-445a-a0ef-0a238e18b619 service cinder] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:21:00.357062 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7f7e61-73cb-445a-a0ef-0a238e18b619 service cinder] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:21:00.360896 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b2710b-4577-4631-a02b-c7c01383a633 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04704222b3d64a33a6c092fc641ccbb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:21:00.361460 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b2710b-4577-4631-a02b-c7c01383a633 service cinder] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:21:00.361746 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b2710b-4577-4631-a02b-c7c01383a633 service cinder] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:21:00.362055 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b2710b-4577-4631-a02b-c7c01383a633 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:21:00.363861 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-88b2710b-4577-4631-a02b-c7c01383a633 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:21:00.432553 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b2710b-4577-4631-a02b-c7c01383a633 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:21:00.433990 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b2710b-4577-4631-a02b-c7c01383a633 service cinder] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:21:00.448441 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1156/2322] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Oct 12 17:21:00 2021] GET /identity/v3/auth/tokens => generated 3403 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 17:21:51.881734 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19cc3d6-b6cc-4351-80e8-07fd4e062b8f service cinder] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:21:51.883710 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-d19cc3d6-b6cc-4351-80e8-07fd4e062b8f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:21:51.935798 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19cc3d6-b6cc-4351-80e8-07fd4e062b8f service cinder] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:21:51.939395 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699bb809-db68-483f-9b3b-2bb5e7a900b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e65f6d0598e4c539134292b86fb43d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:21:51.940025 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699bb809-db68-483f-9b3b-2bb5e7a900b8 service neutron] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:21:51.940306 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699bb809-db68-483f-9b3b-2bb5e7a900b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:21:51.940576 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699bb809-db68-483f-9b3b-2bb5e7a900b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:21:51.942331 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-699bb809-db68-483f-9b3b-2bb5e7a900b8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:21:51.951821 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699bb809-db68-483f-9b3b-2bb5e7a900b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:21:51.953239 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699bb809-db68-483f-9b3b-2bb5e7a900b8 service neutron] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:21:51.961732 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1167/2323] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Oct 12 17:21:51 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 17:23:57.174813 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b2710b-4577-4631-a02b-c7c01383a633 service cinder] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:23:57.176189 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-88b2710b-4577-4631-a02b-c7c01383a633 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:23:57.307669 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b2710b-4577-4631-a02b-c7c01383a633 service cinder] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:23:57.312710 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2113dff0-4c06-4fe1-a5a7-17db61c3ad36 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4102412c40bc4745bba8c31f1caf9788', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:23:57.313345 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2113dff0-4c06-4fe1-a5a7-17db61c3ad36 service placement] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:23:57.313630 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2113dff0-4c06-4fe1-a5a7-17db61c3ad36 service placement] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:23:57.313930 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2113dff0-4c06-4fe1-a5a7-17db61c3ad36 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:23:57.315679 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-2113dff0-4c06-4fe1-a5a7-17db61c3ad36 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:23:57.327040 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2113dff0-4c06-4fe1-a5a7-17db61c3ad36 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:23:57.328586 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2113dff0-4c06-4fe1-a5a7-17db61c3ad36 service placement] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:23:57.338148 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1157/2324] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Oct 12 17:23:57 2021] GET /identity/v3/auth/tokens => generated 3451 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 17:24:01.115924 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699bb809-db68-483f-9b3b-2bb5e7a900b8 service neutron] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:24:01.151283 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699bb809-db68-483f-9b3b-2bb5e7a900b8 service neutron] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:24:01.154833 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1694a30-7cbe-43ac-81bb-f9710a60ee81 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e65f6d0598e4c539134292b86fb43d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:24:01.155468 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1694a30-7cbe-43ac-81bb-f9710a60ee81 service neutron] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:24:01.155750 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1694a30-7cbe-43ac-81bb-f9710a60ee81 service neutron] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:24:01.156024 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1694a30-7cbe-43ac-81bb-f9710a60ee81 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:24:01.157758 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-c1694a30-7cbe-43ac-81bb-f9710a60ee81 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:24:01.218350 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1694a30-7cbe-43ac-81bb-f9710a60ee81 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:24:01.219774 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1694a30-7cbe-43ac-81bb-f9710a60ee81 service neutron] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:24:01.229023 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1168/2325] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Oct 12 17:24:01 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 17:24:01.707214 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2113dff0-4c06-4fe1-a5a7-17db61c3ad36 service placement] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:24:01.709196 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-2113dff0-4c06-4fe1-a5a7-17db61c3ad36 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:24:01.722744 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2113dff0-4c06-4fe1-a5a7-17db61c3ad36 service placement] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:24:01.727470 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df00b8a3-4665-4e89-b669-a34441250832 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:24:01.729426 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df00b8a3-4665-4e89-b669-a34441250832 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:24:01.730083 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df00b8a3-4665-4e89-b669-a34441250832 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:24:01.730376 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df00b8a3-4665-4e89-b669-a34441250832 admin admin] PATH_INFO: `/v3/users/7b7a1c26e06f45e68291dd72d3f5d5ba` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:24:01.731635 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df00b8a3-4665-4e89-b669-a34441250832 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b7a1c26e06f45e68291dd72d3f5d5ba)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:24:01.733546 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df00b8a3-4665-4e89-b669-a34441250832 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:24:01.782790 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-df00b8a3-4665-4e89-b669-a34441250832 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b7a1c26e06f45e68291dd72d3f5d5ba'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:24:01.794157 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-df00b8a3-4665-4e89-b669-a34441250832 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b7a1c26e06f45e68291dd72d3f5d5ba'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:24:01.801384 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-df00b8a3-4665-4e89-b669-a34441250832 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b7a1c26e06f45e68291dd72d3f5d5ba'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:24:01.808807 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-df00b8a3-4665-4e89-b669-a34441250832 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b7a1c26e06f45e68291dd72d3f5d5ba'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:24:01.809590 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-df00b8a3-4665-4e89-b669-a34441250832 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b7a1c26e06f45e68291dd72d3f5d5ba'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:24:01.816333 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1158/2326] 10.222.0.58 () {58 vars in 1223 bytes} [Tue Oct 12 17:24:01 2021] DELETE /identity/v3/users/7b7a1c26e06f45e68291dd72d3f5d5ba => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 17:24:01.835048 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1694a30-7cbe-43ac-81bb-f9710a60ee81 service neutron] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:24:01.844834 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1694a30-7cbe-43ac-81bb-f9710a60ee81 service neutron] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:24:01.904299 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fe39c5-469e-473c-85a4-21a038954ba2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:24:01.905165 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fe39c5-469e-473c-85a4-21a038954ba2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:24:01.905445 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fe39c5-469e-473c-85a4-21a038954ba2 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:24:01.905721 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fe39c5-469e-473c-85a4-21a038954ba2 admin admin] PATH_INFO: `/v3/users/dffbdd05e3994f19b498a19f9bfd7def` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:24:01.906951 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fe39c5-469e-473c-85a4-21a038954ba2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dffbdd05e3994f19b498a19f9bfd7def)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:24:01.908844 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fe39c5-469e-473c-85a4-21a038954ba2 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:24:01.953209 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-f4fe39c5-469e-473c-85a4-21a038954ba2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dffbdd05e3994f19b498a19f9bfd7def'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:24:01.964881 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-f4fe39c5-469e-473c-85a4-21a038954ba2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dffbdd05e3994f19b498a19f9bfd7def'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:24:01.975113 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-f4fe39c5-469e-473c-85a4-21a038954ba2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dffbdd05e3994f19b498a19f9bfd7def'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:24:01.982811 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-f4fe39c5-469e-473c-85a4-21a038954ba2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dffbdd05e3994f19b498a19f9bfd7def'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:24:01.983508 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-f4fe39c5-469e-473c-85a4-21a038954ba2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dffbdd05e3994f19b498a19f9bfd7def'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:24:01.990582 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1169/2327] 10.222.0.58 () {58 vars in 1223 bytes} [Tue Oct 12 17:24:01 2021] DELETE /identity/v3/users/dffbdd05e3994f19b498a19f9bfd7def => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 17:24:01.994288 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df00b8a3-4665-4e89-b669-a34441250832 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:24:01.994773 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ea3aee-0983-482f-993f-8ceaf20abefd None None] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:24:01.995068 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ea3aee-0983-482f-993f-8ceaf20abefd None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:24:01.995351 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ea3aee-0983-482f-993f-8ceaf20abefd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:24:01.995921 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-df00b8a3-4665-4e89-b669-a34441250832 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:24:02.011494 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df00b8a3-4665-4e89-b669-a34441250832 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:24:02.018292 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.auth.core [None req-79ea3aee-0983-482f-993f-8ceaf20abefd None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 17:24:02.019483 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-79ea3aee-0983-482f-993f-8ceaf20abefd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:24:02.073615 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd6bf0c-ea84-408f-a07e-028779927298 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:24:02.074435 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd6bf0c-ea84-408f-a07e-028779927298 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:24:02.074721 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd6bf0c-ea84-408f-a07e-028779927298 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:24:02.075034 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd6bf0c-ea84-408f-a07e-028779927298 admin admin] PATH_INFO: `/v3/projects/a4090b819f2c43da9e9bbae08ade9a79` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:24:02.075748 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1170/2328] 10.222.0.58 () {58 vars in 957 bytes} [Tue Oct 12 17:24:01 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 17:24:02.076245 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd6bf0c-ea84-408f-a07e-028779927298 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a4090b819f2c43da9e9bbae08ade9a79)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:24:02.078157 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd6bf0c-ea84-408f-a07e-028779927298 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:24:02.085512 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ea3aee-0983-482f-993f-8ceaf20abefd None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:24:02.086849 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-79ea3aee-0983-482f-993f-8ceaf20abefd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:24:02.123727 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-2dd6bf0c-ea84-408f-a07e-028779927298 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a4090b819f2c43da9e9bbae08ade9a79', 'request_id': 'req-2dd6bf0c-ea84-408f-a07e-028779927298'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:24:02.128915 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-2dd6bf0c-ea84-408f-a07e-028779927298 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a4090b819f2c43da9e9bbae08ade9a79', 'request_id': 'req-2dd6bf0c-ea84-408f-a07e-028779927298'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:24:02.135555 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-2dd6bf0c-ea84-408f-a07e-028779927298 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a4090b819f2c43da9e9bbae08ade9a79', 'request_id': 'req-2dd6bf0c-ea84-408f-a07e-028779927298'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:24:02.144230 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ea3aee-0983-482f-993f-8ceaf20abefd None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:24:02.147840 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-2dd6bf0c-ea84-408f-a07e-028779927298 admin admin] The token cache is being invalidate because project a4090b819f2c43da9e9bbae08ade9a79 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=85205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 17:24:02.148133 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-2dd6bf0c-ea84-408f-a07e-028779927298 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:24:02.150456 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-2dd6bf0c-ea84-408f-a07e-028779927298 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:24:02.151486 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1159/2329] 10.222.0.58 () {58 vars in 1232 bytes} [Tue Oct 12 17:24:01 2021] DELETE /identity/v3/projects/a4090b819f2c43da9e9bbae08ade9a79 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 17:24:02.164195 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7de15e-09cb-4bf6-a01a-b23bd6f517c6 None None] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:24:02.164727 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7de15e-09cb-4bf6-a01a-b23bd6f517c6 None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:24:02.165249 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7de15e-09cb-4bf6-a01a-b23bd6f517c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:24:02.186053 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.auth.core [None req-5b7de15e-09cb-4bf6-a01a-b23bd6f517c6 None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 17:24:02.188297 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-5b7de15e-09cb-4bf6-a01a-b23bd6f517c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:24:02.195334 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93cd3af-4883-44d8-b2dc-6cc5f4bb5216 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e65f6d0598e4c539134292b86fb43d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:24:02.195989 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93cd3af-4883-44d8-b2dc-6cc5f4bb5216 service neutron] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:24:02.196267 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93cd3af-4883-44d8-b2dc-6cc5f4bb5216 service neutron] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:24:02.196540 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93cd3af-4883-44d8-b2dc-6cc5f4bb5216 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:24:02.198428 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-e93cd3af-4883-44d8-b2dc-6cc5f4bb5216 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:24:02.247476 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1160/2330] 10.222.0.58 () {58 vars in 957 bytes} [Tue Oct 12 17:24:02 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 17:24:02.255516 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600655cd-aa88-4bd0-bf7e-d17f6a522a82 None None] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:24:02.256320 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600655cd-aa88-4bd0-bf7e-d17f6a522a82 None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:24:02.256600 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600655cd-aa88-4bd0-bf7e-d17f6a522a82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:24:02.270337 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93cd3af-4883-44d8-b2dc-6cc5f4bb5216 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:24:02.271815 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93cd3af-4883-44d8-b2dc-6cc5f4bb5216 service neutron] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:24:02.273939 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.auth.core [None req-600655cd-aa88-4bd0-bf7e-d17f6a522a82 None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 17:24:02.275132 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-600655cd-aa88-4bd0-bf7e-d17f6a522a82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:24:02.281744 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1171/2331] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Oct 12 17:24:02 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 12 17:24:02.283003 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1161/2332] 10.222.0.58 () {58 vars in 957 bytes} [Tue Oct 12 17:24:02 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 17:24:02.287331 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93cd3af-4883-44d8-b2dc-6cc5f4bb5216 service neutron] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:24:02.296319 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93cd3af-4883-44d8-b2dc-6cc5f4bb5216 service neutron] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:24:02.300959 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32858d36-ad43-4997-b42b-72c80974510d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:24:02.301608 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32858d36-ad43-4997-b42b-72c80974510d admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:24:02.301915 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32858d36-ad43-4997-b42b-72c80974510d admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:24:02.302195 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32858d36-ad43-4997-b42b-72c80974510d admin admin] PATH_INFO: `/v3/domains` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:24:02.303678 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32858d36-ad43-4997-b42b-72c80974510d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 17:24:02.303992 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32858d36-ad43-4997-b42b-72c80974510d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:24:02.305560 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32858d36-ad43-4997-b42b-72c80974510d admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:24:02.317151 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1172/2333] 10.222.0.58 () {58 vars in 1152 bytes} [Tue Oct 12 17:24:02 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 17:24:02.321461 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600655cd-aa88-4bd0-bf7e-d17f6a522a82 None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:24:02.331385 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600655cd-aa88-4bd0-bf7e-d17f6a522a82 None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:24:02.336607 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f8389c-f129-4d10-b485-05000a09c802 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:24:02.337303 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f8389c-f129-4d10-b485-05000a09c802 admin admin] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:24:02.337582 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f8389c-f129-4d10-b485-05000a09c802 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:24:02.337858 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f8389c-f129-4d10-b485-05000a09c802 admin admin] PATH_INFO: `/v3/projects` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:24:02.338632 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f8389c-f129-4d10-b485-05000a09c802 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:24:02.340667 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f8389c-f129-4d10-b485-05000a09c802 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:24:02.367516 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1162/2334] 10.222.0.58 () {60 vars in 1152 bytes} [Tue Oct 12 17:24:02 2021] POST /identity/v3/projects => generated 373 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 17:24:02.371719 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32858d36-ad43-4997-b42b-72c80974510d admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:24:02.382108 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32858d36-ad43-4997-b42b-72c80974510d admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:24:02.436529 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f38d64-87d1-45b7-a340-a366a46f8f2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:24:02.437214 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f38d64-87d1-45b7-a340-a366a46f8f2d admin admin] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:24:02.437496 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f38d64-87d1-45b7-a340-a366a46f8f2d admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:24:02.437807 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f38d64-87d1-45b7-a340-a366a46f8f2d admin admin] PATH_INFO: `/v3/users` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:24:02.438505 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f38d64-87d1-45b7-a340-a366a46f8f2d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:24:02.440384 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f38d64-87d1-45b7-a340-a366a46f8f2d admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:24:02.461096 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1173/2335] 10.222.0.58 () {60 vars in 1143 bytes} [Tue Oct 12 17:24:02 2021] POST /identity/v3/users => generated 287 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 17:24:02.464999 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f8389c-f129-4d10-b485-05000a09c802 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:24:02.475234 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f8389c-f129-4d10-b485-05000a09c802 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:24:02.479909 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64924d82-1a68-4000-845a-018da816b8e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:24:02.480568 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64924d82-1a68-4000-845a-018da816b8e3 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:24:02.480853 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64924d82-1a68-4000-845a-018da816b8e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:24:02.481133 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64924d82-1a68-4000-845a-018da816b8e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:24:02.481991 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64924d82-1a68-4000-845a-018da816b8e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:24:02.483482 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64924d82-1a68-4000-845a-018da816b8e3 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:24:02.494008 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1163/2336] 10.222.0.58 () {58 vars in 1121 bytes} [Tue Oct 12 17:24:02 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 17:24:02.497718 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f38d64-87d1-45b7-a340-a366a46f8f2d admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:24:02.508398 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f38d64-87d1-45b7-a340-a366a46f8f2d admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:24:02.513381 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bcd61e-fb82-40a5-959f-a54aa89ca934 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:24:02.514064 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bcd61e-fb82-40a5-959f-a54aa89ca934 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:24:02.514353 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bcd61e-fb82-40a5-959f-a54aa89ca934 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:24:02.514632 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bcd61e-fb82-40a5-959f-a54aa89ca934 admin admin] PATH_INFO: `/v3/roles` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:24:02.515375 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bcd61e-fb82-40a5-959f-a54aa89ca934 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:24:02.516971 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bcd61e-fb82-40a5-959f-a54aa89ca934 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:24:02.527063 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1174/2337] 10.222.0.58 () {58 vars in 1121 bytes} [Tue Oct 12 17:24:02 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 17:24:02.530992 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64924d82-1a68-4000-845a-018da816b8e3 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:24:02.542090 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64924d82-1a68-4000-845a-018da816b8e3 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:24:02.547554 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f319dd-1dfd-4cf8-9e42-a0de5903dcf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:24:02.548571 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f319dd-1dfd-4cf8-9e42-a0de5903dcf4 admin admin] REQUEST_METHOD: `PUT` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:24:02.548858 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f319dd-1dfd-4cf8-9e42-a0de5903dcf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:24:02.549137 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f319dd-1dfd-4cf8-9e42-a0de5903dcf4 admin admin] PATH_INFO: `/v3/projects/fa0d17f286a74417bb2ec8b31b9fdada/users/8f7ee28a4d884e40a5a1c5e427fba8de/roles/55ba49fe29884e64b57c3ad13188d554` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:24:02.555507 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bcd61e-fb82-40a5-959f-a54aa89ca934 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:24:02.557429 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-29bcd61e-fb82-40a5-959f-a54aa89ca934 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:24:02.568212 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f319dd-1dfd-4cf8-9e42-a0de5903dcf4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa0d17f286a74417bb2ec8b31b9fdada, user_id=8f7ee28a4d884e40a5a1c5e427fba8de, role_id=55ba49fe29884e64b57c3ad13188d554)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:24:02.571043 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f319dd-1dfd-4cf8-9e42-a0de5903dcf4 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:24:02.572602 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bcd61e-fb82-40a5-959f-a54aa89ca934 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:24:02.578007 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e66550-2547-469a-8bfa-863c1c7f98f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:24:02.578775 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e66550-2547-469a-8bfa-863c1c7f98f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:24:02.579388 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e66550-2547-469a-8bfa-863c1c7f98f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:24:02.579750 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e66550-2547-469a-8bfa-863c1c7f98f6 admin admin] PATH_INFO: `/v3/projects/8e0d28657c2e4b1a8db6db328ad189a9` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:24:02.581095 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e66550-2547-469a-8bfa-863c1c7f98f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e0d28657c2e4b1a8db6db328ad189a9)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:24:02.582994 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e66550-2547-469a-8bfa-863c1c7f98f6 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:24:02.586269 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1164/2338] 10.222.0.58 () {60 vars in 1482 bytes} [Tue Oct 12 17:24:02 2021] PUT /identity/v3/projects/fa0d17f286a74417bb2ec8b31b9fdada/users/8f7ee28a4d884e40a5a1c5e427fba8de/roles/55ba49fe29884e64b57c3ad13188d554 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 17:24:02.591332 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f249e3-b0a6-4e1a-b21f-d81fa8381478 None None] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:24:02.591723 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f249e3-b0a6-4e1a-b21f-d81fa8381478 None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:24:02.599818 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f249e3-b0a6-4e1a-b21f-d81fa8381478 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:24:02.619001 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.auth.core [None req-48f249e3-b0a6-4e1a-b21f-d81fa8381478 None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 17:24:02.620470 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-48f249e3-b0a6-4e1a-b21f-d81fa8381478 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:24:02.640367 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-b0e66550-2547-469a-8bfa-863c1c7f98f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e0d28657c2e4b1a8db6db328ad189a9', 'request_id': 'req-b0e66550-2547-469a-8bfa-863c1c7f98f6'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:24:02.645831 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-b0e66550-2547-469a-8bfa-863c1c7f98f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e0d28657c2e4b1a8db6db328ad189a9', 'request_id': 'req-b0e66550-2547-469a-8bfa-863c1c7f98f6'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:24:02.652535 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-b0e66550-2547-469a-8bfa-863c1c7f98f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e0d28657c2e4b1a8db6db328ad189a9', 'request_id': 'req-b0e66550-2547-469a-8bfa-863c1c7f98f6'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:24:02.665757 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-b0e66550-2547-469a-8bfa-863c1c7f98f6 admin admin] The token cache is being invalidate because project 8e0d28657c2e4b1a8db6db328ad189a9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=85204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 17:24:02.666082 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-b0e66550-2547-469a-8bfa-863c1c7f98f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:24:02.666723 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-b0e66550-2547-469a-8bfa-863c1c7f98f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:24:02.668546 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1175/2339] 10.222.0.58 () {58 vars in 1232 bytes} [Tue Oct 12 17:24:02 2021] DELETE /identity/v3/projects/8e0d28657c2e4b1a8db6db328ad189a9 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 17:24:02.672399 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e66550-2547-469a-8bfa-863c1c7f98f6 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:24:02.673694 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-b0e66550-2547-469a-8bfa-863c1c7f98f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:24:02.679612 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1165/2340] 10.222.0.58 () {58 vars in 957 bytes} [Tue Oct 12 17:24:02 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 17:24:02.689262 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f249e3-b0a6-4e1a-b21f-d81fa8381478 None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:24:02.690583 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-48f249e3-b0a6-4e1a-b21f-d81fa8381478 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:24:02.734823 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e66550-2547-469a-8bfa-863c1c7f98f6 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:24:02.739575 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cd56c5-c1ce-41ce-892c-9e0f261d97ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:24:02.740481 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cd56c5-c1ce-41ce-892c-9e0f261d97ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:24:02.740771 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cd56c5-c1ce-41ce-892c-9e0f261d97ab admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:24:02.741051 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cd56c5-c1ce-41ce-892c-9e0f261d97ab admin admin] PATH_INFO: `/v3/users/b91ae80886ec4cfdbc18f0de8c1d87ae` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:24:02.744786 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cd56c5-c1ce-41ce-892c-9e0f261d97ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=b91ae80886ec4cfdbc18f0de8c1d87ae)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:24:02.746725 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cd56c5-c1ce-41ce-892c-9e0f261d97ab admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:24:02.747215 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f249e3-b0a6-4e1a-b21f-d81fa8381478 None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:24:02.794402 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-e2cd56c5-c1ce-41ce-892c-9e0f261d97ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b91ae80886ec4cfdbc18f0de8c1d87ae'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:24:02.796901 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e64781-24f6-4dc6-a1aa-09bf61f9c1be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e65f6d0598e4c539134292b86fb43d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:24:02.797552 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e64781-24f6-4dc6-a1aa-09bf61f9c1be service neutron] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:24:02.797842 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e64781-24f6-4dc6-a1aa-09bf61f9c1be service neutron] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:24:02.798162 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e64781-24f6-4dc6-a1aa-09bf61f9c1be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:24:02.810151 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-e2cd56c5-c1ce-41ce-892c-9e0f261d97ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b91ae80886ec4cfdbc18f0de8c1d87ae'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:24:02.810316 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e64781-24f6-4dc6-a1aa-09bf61f9c1be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:24:02.810316 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e64781-24f6-4dc6-a1aa-09bf61f9c1be service neutron] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:24:02.813547 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-e2cd56c5-c1ce-41ce-892c-9e0f261d97ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b91ae80886ec4cfdbc18f0de8c1d87ae'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:24:02.820304 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1166/2341] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Oct 12 17:24:02 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 12 17:24:02.830698 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-e2cd56c5-c1ce-41ce-892c-9e0f261d97ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b91ae80886ec4cfdbc18f0de8c1d87ae'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:24:02.831830 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-e2cd56c5-c1ce-41ce-892c-9e0f261d97ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b91ae80886ec4cfdbc18f0de8c1d87ae'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:24:02.842300 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1176/2342] 10.222.0.58 () {58 vars in 1223 bytes} [Tue Oct 12 17:24:02 2021] DELETE /identity/v3/users/b91ae80886ec4cfdbc18f0de8c1d87ae => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 17:24:03.183745 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e64781-24f6-4dc6-a1aa-09bf61f9c1be service neutron] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:24:03.193958 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e64781-24f6-4dc6-a1aa-09bf61f9c1be service neutron] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:24:03.271865 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40b8691-0861-4523-9909-399031784743 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:24:03.272876 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40b8691-0861-4523-9909-399031784743 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:24:03.273163 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40b8691-0861-4523-9909-399031784743 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:24:03.273441 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40b8691-0861-4523-9909-399031784743 admin admin] PATH_INFO: `/v3/projects/edcded9daddc422fa0ba3d9276f1afa2` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:24:03.274684 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40b8691-0861-4523-9909-399031784743 admin admin] RBAC: Authorizing `identity:delete_project(project_id=edcded9daddc422fa0ba3d9276f1afa2)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:24:03.276913 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40b8691-0861-4523-9909-399031784743 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:24:03.329491 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-f40b8691-0861-4523-9909-399031784743 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'edcded9daddc422fa0ba3d9276f1afa2', 'request_id': 'req-f40b8691-0861-4523-9909-399031784743'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:24:03.334837 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-f40b8691-0861-4523-9909-399031784743 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'edcded9daddc422fa0ba3d9276f1afa2', 'request_id': 'req-f40b8691-0861-4523-9909-399031784743'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:24:03.341095 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-f40b8691-0861-4523-9909-399031784743 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'edcded9daddc422fa0ba3d9276f1afa2', 'request_id': 'req-f40b8691-0861-4523-9909-399031784743'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:24:03.354408 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-f40b8691-0861-4523-9909-399031784743 admin admin] The token cache is being invalidate because project edcded9daddc422fa0ba3d9276f1afa2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=85205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 17:24:03.354700 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-f40b8691-0861-4523-9909-399031784743 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:24:03.355402 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-f40b8691-0861-4523-9909-399031784743 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:24:03.357082 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1167/2343] 10.222.0.58 () {58 vars in 1232 bytes} [Tue Oct 12 17:24:03 2021] DELETE /identity/v3/projects/edcded9daddc422fa0ba3d9276f1afa2 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 17:24:03.360967 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cd56c5-c1ce-41ce-892c-9e0f261d97ab admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:24:03.362421 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-e2cd56c5-c1ce-41ce-892c-9e0f261d97ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:24:03.375864 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cd56c5-c1ce-41ce-892c-9e0f261d97ab admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:24:03.431209 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4712a443-b578-4159-bd4b-e61b2d0d56e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:24:03.432091 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4712a443-b578-4159-bd4b-e61b2d0d56e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:24:03.432386 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4712a443-b578-4159-bd4b-e61b2d0d56e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:24:03.432663 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4712a443-b578-4159-bd4b-e61b2d0d56e2 admin admin] PATH_INFO: `/v3/users/eee59f28c1554430b1b7654df252a01a` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:24:03.434001 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4712a443-b578-4159-bd4b-e61b2d0d56e2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eee59f28c1554430b1b7654df252a01a)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:24:03.436022 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4712a443-b578-4159-bd4b-e61b2d0d56e2 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:24:03.481527 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-4712a443-b578-4159-bd4b-e61b2d0d56e2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eee59f28c1554430b1b7654df252a01a'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:24:03.493495 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-4712a443-b578-4159-bd4b-e61b2d0d56e2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eee59f28c1554430b1b7654df252a01a'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:24:03.500238 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-4712a443-b578-4159-bd4b-e61b2d0d56e2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eee59f28c1554430b1b7654df252a01a'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:24:03.507476 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-4712a443-b578-4159-bd4b-e61b2d0d56e2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eee59f28c1554430b1b7654df252a01a'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:24:03.508302 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-4712a443-b578-4159-bd4b-e61b2d0d56e2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eee59f28c1554430b1b7654df252a01a'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:24:03.514375 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1177/2344] 10.222.0.58 () {58 vars in 1223 bytes} [Tue Oct 12 17:24:03 2021] DELETE /identity/v3/users/eee59f28c1554430b1b7654df252a01a => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 17:24:04.010253 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40b8691-0861-4523-9909-399031784743 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:24:04.012497 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-f40b8691-0861-4523-9909-399031784743 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:24:04.027052 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40b8691-0861-4523-9909-399031784743 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:24:04.089247 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37eda41e-ca4a-475a-8834-bd9cd38286b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:24:04.090153 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37eda41e-ca4a-475a-8834-bd9cd38286b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:24:04.090431 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37eda41e-ca4a-475a-8834-bd9cd38286b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:24:04.090700 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37eda41e-ca4a-475a-8834-bd9cd38286b7 admin admin] PATH_INFO: `/v3/projects/ab383980939340bbb71d87ed5a8c2122` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:24:04.091976 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37eda41e-ca4a-475a-8834-bd9cd38286b7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ab383980939340bbb71d87ed5a8c2122)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:24:04.094042 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37eda41e-ca4a-475a-8834-bd9cd38286b7 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:24:04.146752 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-37eda41e-ca4a-475a-8834-bd9cd38286b7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab383980939340bbb71d87ed5a8c2122', 'request_id': 'req-37eda41e-ca4a-475a-8834-bd9cd38286b7'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:24:04.152257 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-37eda41e-ca4a-475a-8834-bd9cd38286b7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab383980939340bbb71d87ed5a8c2122', 'request_id': 'req-37eda41e-ca4a-475a-8834-bd9cd38286b7'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:24:04.158800 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-37eda41e-ca4a-475a-8834-bd9cd38286b7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab383980939340bbb71d87ed5a8c2122', 'request_id': 'req-37eda41e-ca4a-475a-8834-bd9cd38286b7'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:24:04.174626 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-37eda41e-ca4a-475a-8834-bd9cd38286b7 admin admin] The token cache is being invalidate because project ab383980939340bbb71d87ed5a8c2122 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=85205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 17:24:04.174922 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-37eda41e-ca4a-475a-8834-bd9cd38286b7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:24:04.175574 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-37eda41e-ca4a-475a-8834-bd9cd38286b7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:24:04.177167 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1168/2345] 10.222.0.58 () {58 vars in 1232 bytes} [Tue Oct 12 17:24:04 2021] DELETE /identity/v3/projects/ab383980939340bbb71d87ed5a8c2122 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 17:24:04.184344 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2a550b-1474-4840-a8d9-12c56dd957d1 None None] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:24:04.184643 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2a550b-1474-4840-a8d9-12c56dd957d1 None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:24:04.184909 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2a550b-1474-4840-a8d9-12c56dd957d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:24:04.204777 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.auth.core [None req-df2a550b-1474-4840-a8d9-12c56dd957d1 None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 17:24:04.205764 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-df2a550b-1474-4840-a8d9-12c56dd957d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:24:04.283844 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65898590-26cf-4bdf-94dd-dbeddcdeefe8 None None] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:24:04.284134 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65898590-26cf-4bdf-94dd-dbeddcdeefe8 None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:24:04.284417 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65898590-26cf-4bdf-94dd-dbeddcdeefe8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:24:04.284864 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1178/2346] 10.222.0.58 () {58 vars in 957 bytes} [Tue Oct 12 17:24:04 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 17:24:04.308575 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.auth.core [None req-65898590-26cf-4bdf-94dd-dbeddcdeefe8 None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 17:24:04.309800 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-65898590-26cf-4bdf-94dd-dbeddcdeefe8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:24:04.321292 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1169/2347] 10.222.0.58 () {58 vars in 957 bytes} [Tue Oct 12 17:24:04 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 17:24:04.322230 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2a550b-1474-4840-a8d9-12c56dd957d1 None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:24:04.332041 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2a550b-1474-4840-a8d9-12c56dd957d1 None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:24:04.337574 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c719a6c-dc64-4d58-b80b-902f1ba4a139 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:24:04.338274 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c719a6c-dc64-4d58-b80b-902f1ba4a139 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:24:04.338556 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c719a6c-dc64-4d58-b80b-902f1ba4a139 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:24:04.338829 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c719a6c-dc64-4d58-b80b-902f1ba4a139 admin admin] PATH_INFO: `/v3/domains` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:24:04.339567 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c719a6c-dc64-4d58-b80b-902f1ba4a139 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 17:24:04.339872 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c719a6c-dc64-4d58-b80b-902f1ba4a139 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:24:04.341591 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c719a6c-dc64-4d58-b80b-902f1ba4a139 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:24:04.355637 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1179/2348] 10.222.0.58 () {58 vars in 1152 bytes} [Tue Oct 12 17:24:04 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 17:24:04.360362 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65898590-26cf-4bdf-94dd-dbeddcdeefe8 None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:24:04.370924 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65898590-26cf-4bdf-94dd-dbeddcdeefe8 None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:24:04.378143 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f579f36-fde9-4b8e-b0a0-c3d37a0a15c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:24:04.378908 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f579f36-fde9-4b8e-b0a0-c3d37a0a15c2 admin admin] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:24:04.379268 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f579f36-fde9-4b8e-b0a0-c3d37a0a15c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:24:04.380392 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f579f36-fde9-4b8e-b0a0-c3d37a0a15c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:24:04.380953 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f579f36-fde9-4b8e-b0a0-c3d37a0a15c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:24:04.383122 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f579f36-fde9-4b8e-b0a0-c3d37a0a15c2 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:24:04.414081 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1170/2349] 10.222.0.58 () {60 vars in 1152 bytes} [Tue Oct 12 17:24:04 2021] POST /identity/v3/projects => generated 387 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 17:24:04.418244 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c719a6c-dc64-4d58-b80b-902f1ba4a139 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:24:04.431159 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c719a6c-dc64-4d58-b80b-902f1ba4a139 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:24:04.514624 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecf836b-dcbf-4ca8-9d01-cd6e13e1d525 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:24:04.515737 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecf836b-dcbf-4ca8-9d01-cd6e13e1d525 admin admin] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:24:04.516109 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecf836b-dcbf-4ca8-9d01-cd6e13e1d525 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:24:04.516454 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecf836b-dcbf-4ca8-9d01-cd6e13e1d525 admin admin] PATH_INFO: `/v3/users` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:24:04.517328 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecf836b-dcbf-4ca8-9d01-cd6e13e1d525 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:24:04.519409 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecf836b-dcbf-4ca8-9d01-cd6e13e1d525 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:24:04.548702 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1180/2350] 10.222.0.58 () {60 vars in 1143 bytes} [Tue Oct 12 17:24:04 2021] POST /identity/v3/users => generated 294 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 17:24:04.550250 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f579f36-fde9-4b8e-b0a0-c3d37a0a15c2 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:24:04.561513 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f579f36-fde9-4b8e-b0a0-c3d37a0a15c2 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:24:04.569154 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0183ed-b5c2-4683-9d62-1cebc2f65f79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:24:04.569956 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0183ed-b5c2-4683-9d62-1cebc2f65f79 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:24:04.570491 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0183ed-b5c2-4683-9d62-1cebc2f65f79 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:24:04.570907 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0183ed-b5c2-4683-9d62-1cebc2f65f79 admin admin] PATH_INFO: `/v3/roles` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:24:04.571741 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0183ed-b5c2-4683-9d62-1cebc2f65f79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:24:04.573473 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0183ed-b5c2-4683-9d62-1cebc2f65f79 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:24:04.586573 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1171/2351] 10.222.0.58 () {58 vars in 1121 bytes} [Tue Oct 12 17:24:04 2021] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 17:24:04.590718 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecf836b-dcbf-4ca8-9d01-cd6e13e1d525 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:24:04.601207 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecf836b-dcbf-4ca8-9d01-cd6e13e1d525 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:24:04.606118 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a6afa3-cb68-4f82-8d45-e1695009a6fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:24:04.606791 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a6afa3-cb68-4f82-8d45-e1695009a6fb admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:24:04.607112 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a6afa3-cb68-4f82-8d45-e1695009a6fb admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:24:04.607557 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a6afa3-cb68-4f82-8d45-e1695009a6fb admin admin] PATH_INFO: `/v3/roles` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:24:04.608338 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a6afa3-cb68-4f82-8d45-e1695009a6fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:24:04.609959 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a6afa3-cb68-4f82-8d45-e1695009a6fb admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:24:04.620094 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1181/2352] 10.222.0.58 () {58 vars in 1121 bytes} [Tue Oct 12 17:24:04 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 17:24:04.624656 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0183ed-b5c2-4683-9d62-1cebc2f65f79 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:24:04.636191 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0183ed-b5c2-4683-9d62-1cebc2f65f79 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:24:04.640932 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82c5b0b-d3d8-48e0-9e4b-490214e1c011 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:24:04.641816 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82c5b0b-d3d8-48e0-9e4b-490214e1c011 admin admin] REQUEST_METHOD: `PUT` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:24:04.642147 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82c5b0b-d3d8-48e0-9e4b-490214e1c011 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:24:04.642426 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82c5b0b-d3d8-48e0-9e4b-490214e1c011 admin admin] PATH_INFO: `/v3/projects/c627df5746104c1289aa80e8481c05a7/users/1e73ea5273504acd995ada176607c989/roles/55ba49fe29884e64b57c3ad13188d554` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:24:04.658177 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82c5b0b-d3d8-48e0-9e4b-490214e1c011 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c627df5746104c1289aa80e8481c05a7, user_id=1e73ea5273504acd995ada176607c989, role_id=55ba49fe29884e64b57c3ad13188d554)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:24:04.660860 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82c5b0b-d3d8-48e0-9e4b-490214e1c011 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:24:04.674798 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1172/2353] 10.222.0.58 () {60 vars in 1482 bytes} [Tue Oct 12 17:24:04 2021] PUT /identity/v3/projects/c627df5746104c1289aa80e8481c05a7/users/1e73ea5273504acd995ada176607c989/roles/55ba49fe29884e64b57c3ad13188d554 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 17:24:04.686576 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd548c1-7555-499a-be53-9d106f62e016 None None] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:24:04.686867 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd548c1-7555-499a-be53-9d106f62e016 None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:24:04.687136 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd548c1-7555-499a-be53-9d106f62e016 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:24:04.718997 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.auth.core [None req-0cd548c1-7555-499a-be53-9d106f62e016 None None] MFA Rules not processed for user `1e73ea5273504acd995ada176607c989`. Rule list: `[]` (Enabled: `True`). {{(pid=85204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 17:24:04.720198 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-0cd548c1-7555-499a-be53-9d106f62e016 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:24:04.788951 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1182/2354] 10.222.0.58 () {58 vars in 957 bytes} [Tue Oct 12 17:24:04 2021] POST /identity/v3/auth/tokens => generated 3407 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 17:24:04.793301 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82c5b0b-d3d8-48e0-9e4b-490214e1c011 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:24:04.856639 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82c5b0b-d3d8-48e0-9e4b-490214e1c011 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:24:04.861390 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81b5cfd-14da-429f-893f-5c82004c2829 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:24:04.862080 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81b5cfd-14da-429f-893f-5c82004c2829 admin admin] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:24:04.862369 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81b5cfd-14da-429f-893f-5c82004c2829 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:24:04.862644 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81b5cfd-14da-429f-893f-5c82004c2829 admin admin] PATH_INFO: `/v3/projects` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:24:04.863372 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81b5cfd-14da-429f-893f-5c82004c2829 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:24:04.865479 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81b5cfd-14da-429f-893f-5c82004c2829 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:24:04.894257 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1173/2355] 10.222.0.58 () {60 vars in 1152 bytes} [Tue Oct 12 17:24:04 2021] POST /identity/v3/projects => generated 385 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 17:24:04.895669 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd548c1-7555-499a-be53-9d106f62e016 None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:24:04.907265 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd548c1-7555-499a-be53-9d106f62e016 None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:24:04.973090 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10279aef-0309-4aa3-ba1b-617705a2970f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:24:04.974171 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10279aef-0309-4aa3-ba1b-617705a2970f admin admin] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:24:04.974171 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10279aef-0309-4aa3-ba1b-617705a2970f admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:24:04.974363 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10279aef-0309-4aa3-ba1b-617705a2970f admin admin] PATH_INFO: `/v3/users` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:24:04.975071 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10279aef-0309-4aa3-ba1b-617705a2970f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:24:04.977079 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10279aef-0309-4aa3-ba1b-617705a2970f admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:24:05.004675 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1183/2356] 10.222.0.58 () {60 vars in 1143 bytes} [Tue Oct 12 17:24:04 2021] POST /identity/v3/users => generated 299 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 17:24:05.007569 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81b5cfd-14da-429f-893f-5c82004c2829 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:24:05.018172 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81b5cfd-14da-429f-893f-5c82004c2829 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:24:05.030793 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a839a2f-8b54-4dc6-b730-0d5f74e19366 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:24:05.031542 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a839a2f-8b54-4dc6-b730-0d5f74e19366 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:24:05.031769 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a839a2f-8b54-4dc6-b730-0d5f74e19366 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:24:05.032036 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a839a2f-8b54-4dc6-b730-0d5f74e19366 admin admin] PATH_INFO: `/v3/roles` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:24:05.032793 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a839a2f-8b54-4dc6-b730-0d5f74e19366 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:24:05.034601 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a839a2f-8b54-4dc6-b730-0d5f74e19366 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:24:05.047355 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1174/2357] 10.222.0.58 () {58 vars in 1121 bytes} [Tue Oct 12 17:24:05 2021] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 17:24:05.051107 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10279aef-0309-4aa3-ba1b-617705a2970f admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:24:05.069444 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10279aef-0309-4aa3-ba1b-617705a2970f admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:24:05.075143 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0974ff31-af27-433c-a497-6b7122e25c9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:24:05.076293 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0974ff31-af27-433c-a497-6b7122e25c9c admin admin] REQUEST_METHOD: `PUT` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:24:05.076566 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0974ff31-af27-433c-a497-6b7122e25c9c admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:24:05.076901 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0974ff31-af27-433c-a497-6b7122e25c9c admin admin] PATH_INFO: `/v3/projects/2172a7b91a40417988a060382b94117e/users/0636f34aa6b242118c5e35834938b67a/roles/610824e4f50f4fb8954610e98c1de784` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:24:05.093120 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0974ff31-af27-433c-a497-6b7122e25c9c admin admin] RBAC: Authorizing `identity:create_grant(project_id=2172a7b91a40417988a060382b94117e, user_id=0636f34aa6b242118c5e35834938b67a, role_id=610824e4f50f4fb8954610e98c1de784)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:24:05.095945 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0974ff31-af27-433c-a497-6b7122e25c9c admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:24:05.112926 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1184/2358] 10.222.0.58 () {60 vars in 1482 bytes} [Tue Oct 12 17:24:05 2021] PUT /identity/v3/projects/2172a7b91a40417988a060382b94117e/users/0636f34aa6b242118c5e35834938b67a/roles/610824e4f50f4fb8954610e98c1de784 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 17:24:05.117414 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a839a2f-8b54-4dc6-b730-0d5f74e19366 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:24:05.127870 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a839a2f-8b54-4dc6-b730-0d5f74e19366 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:24:05.189001 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88abc192-efcc-4ba8-beb7-f845899895bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:24:05.189598 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88abc192-efcc-4ba8-beb7-f845899895bd admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:24:05.189906 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88abc192-efcc-4ba8-beb7-f845899895bd admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:24:05.190203 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88abc192-efcc-4ba8-beb7-f845899895bd admin admin] PATH_INFO: `/v3/roles` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:24:05.190951 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88abc192-efcc-4ba8-beb7-f845899895bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:24:05.192551 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88abc192-efcc-4ba8-beb7-f845899895bd admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:24:05.203442 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1175/2359] 10.222.0.58 () {58 vars in 1121 bytes} [Tue Oct 12 17:24:05 2021] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 17:24:05.207718 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0974ff31-af27-433c-a497-6b7122e25c9c admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:24:05.218197 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0974ff31-af27-433c-a497-6b7122e25c9c admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:24:05.223098 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19030059-91c2-4d85-be4e-2506f10ebe9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:24:05.224033 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19030059-91c2-4d85-be4e-2506f10ebe9e admin admin] REQUEST_METHOD: `PUT` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:24:05.224341 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19030059-91c2-4d85-be4e-2506f10ebe9e admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:24:05.224645 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19030059-91c2-4d85-be4e-2506f10ebe9e admin admin] PATH_INFO: `/v3/projects/2172a7b91a40417988a060382b94117e/users/0636f34aa6b242118c5e35834938b67a/roles/610824e4f50f4fb8954610e98c1de784` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:24:05.226649 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19030059-91c2-4d85-be4e-2506f10ebe9e admin admin] RBAC: Authorizing `identity:create_grant(project_id=2172a7b91a40417988a060382b94117e, user_id=0636f34aa6b242118c5e35834938b67a, role_id=610824e4f50f4fb8954610e98c1de784)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:24:05.229256 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19030059-91c2-4d85-be4e-2506f10ebe9e admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:24:05.240650 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1185/2360] 10.222.0.58 () {60 vars in 1482 bytes} [Tue Oct 12 17:24:05 2021] PUT /identity/v3/projects/2172a7b91a40417988a060382b94117e/users/0636f34aa6b242118c5e35834938b67a/roles/610824e4f50f4fb8954610e98c1de784 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 17:24:05.250764 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3be420-c5c5-40f6-9a1d-872542f5515b None None] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:24:05.251045 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3be420-c5c5-40f6-9a1d-872542f5515b None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:24:05.251328 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3be420-c5c5-40f6-9a1d-872542f5515b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:24:05.283002 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.auth.core [None req-2e3be420-c5c5-40f6-9a1d-872542f5515b None None] MFA Rules not processed for user `0636f34aa6b242118c5e35834938b67a`. Rule list: `[]` (Enabled: `True`). {{(pid=85205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 17:24:05.284257 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-2e3be420-c5c5-40f6-9a1d-872542f5515b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:24:05.360584 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1176/2361] 10.222.0.58 () {58 vars in 957 bytes} [Tue Oct 12 17:24:05 2021] POST /identity/v3/auth/tokens => generated 3472 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 17:24:05.370535 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19030059-91c2-4d85-be4e-2506f10ebe9e admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:24:05.372272 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-19030059-91c2-4d85-be4e-2506f10ebe9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:24:05.447980 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19030059-91c2-4d85-be4e-2506f10ebe9e admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:24:05.453125 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b636ba85-0f00-48ba-96c5-8dd86dace039 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04704222b3d64a33a6c092fc641ccbb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:24:05.453829 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b636ba85-0f00-48ba-96c5-8dd86dace039 service cinder] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:24:05.454220 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b636ba85-0f00-48ba-96c5-8dd86dace039 service cinder] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:24:05.454588 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b636ba85-0f00-48ba-96c5-8dd86dace039 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:24:05.467664 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b636ba85-0f00-48ba-96c5-8dd86dace039 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:24:05.469493 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b636ba85-0f00-48ba-96c5-8dd86dace039 service cinder] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:24:05.480127 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1186/2362] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Oct 12 17:24:05 2021] GET /identity/v3/auth/tokens => generated 3472 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 17:24:06.162587 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3be420-c5c5-40f6-9a1d-872542f5515b None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:24:06.235157 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3be420-c5c5-40f6-9a1d-872542f5515b None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:24:06.240683 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc1a77b-5a87-475d-9e43-8c442dc15e7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:24:06.241568 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc1a77b-5a87-475d-9e43-8c442dc15e7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:24:06.241892 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc1a77b-5a87-475d-9e43-8c442dc15e7b admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:24:06.242171 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc1a77b-5a87-475d-9e43-8c442dc15e7b admin admin] PATH_INFO: `/v3/users/1e73ea5273504acd995ada176607c989` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:24:06.244612 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc1a77b-5a87-475d-9e43-8c442dc15e7b admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e73ea5273504acd995ada176607c989)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:24:06.246486 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc1a77b-5a87-475d-9e43-8c442dc15e7b admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:24:06.300515 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-0fc1a77b-5a87-475d-9e43-8c442dc15e7b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e73ea5273504acd995ada176607c989'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:24:06.312945 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-0fc1a77b-5a87-475d-9e43-8c442dc15e7b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e73ea5273504acd995ada176607c989'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:24:06.321095 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-0fc1a77b-5a87-475d-9e43-8c442dc15e7b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e73ea5273504acd995ada176607c989'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:24:06.328255 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-0fc1a77b-5a87-475d-9e43-8c442dc15e7b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e73ea5273504acd995ada176607c989'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:24:06.328928 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-0fc1a77b-5a87-475d-9e43-8c442dc15e7b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e73ea5273504acd995ada176607c989'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:24:06.335887 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1177/2363] 10.222.0.58 () {58 vars in 1223 bytes} [Tue Oct 12 17:24:06 2021] DELETE /identity/v3/users/1e73ea5273504acd995ada176607c989 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 17:24:06.340172 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8675f6ae-7580-4052-ac60-d079769c257e None None] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:24:06.340465 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8675f6ae-7580-4052-ac60-d079769c257e None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:24:06.340744 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8675f6ae-7580-4052-ac60-d079769c257e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:24:06.358823 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.auth.core [None req-8675f6ae-7580-4052-ac60-d079769c257e None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 17:24:06.360023 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-8675f6ae-7580-4052-ac60-d079769c257e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:24:06.430850 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1187/2364] 10.222.0.58 () {58 vars in 957 bytes} [Tue Oct 12 17:24:06 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 17:24:06.451287 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc1a77b-5a87-475d-9e43-8c442dc15e7b admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:24:06.452991 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-0fc1a77b-5a87-475d-9e43-8c442dc15e7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:24:06.553281 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc1a77b-5a87-475d-9e43-8c442dc15e7b admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:24:06.557786 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e0f835-3e91-4e69-b4e8-17df2037f5e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e65f6d0598e4c539134292b86fb43d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:24:06.558772 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e0f835-3e91-4e69-b4e8-17df2037f5e1 service neutron] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:24:06.559064 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e0f835-3e91-4e69-b4e8-17df2037f5e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:24:06.559341 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e0f835-3e91-4e69-b4e8-17df2037f5e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:24:06.571494 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e0f835-3e91-4e69-b4e8-17df2037f5e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:24:06.573856 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e0f835-3e91-4e69-b4e8-17df2037f5e1 service neutron] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:24:06.587719 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1178/2365] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Oct 12 17:24:06 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 17:24:07.016661 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8675f6ae-7580-4052-ac60-d079769c257e None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:24:07.018240 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-8675f6ae-7580-4052-ac60-d079769c257e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:24:07.040501 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8675f6ae-7580-4052-ac60-d079769c257e None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:24:07.046556 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f507531-3588-4f3f-9ccd-960fd74c1b25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:24:07.047736 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f507531-3588-4f3f-9ccd-960fd74c1b25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:24:07.048021 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f507531-3588-4f3f-9ccd-960fd74c1b25 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:24:07.048313 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f507531-3588-4f3f-9ccd-960fd74c1b25 admin admin] PATH_INFO: `/v3/projects/c627df5746104c1289aa80e8481c05a7` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:24:07.050295 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f507531-3588-4f3f-9ccd-960fd74c1b25 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c627df5746104c1289aa80e8481c05a7)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:24:07.052391 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f507531-3588-4f3f-9ccd-960fd74c1b25 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:24:07.104266 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-4f507531-3588-4f3f-9ccd-960fd74c1b25 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c627df5746104c1289aa80e8481c05a7', 'request_id': 'req-4f507531-3588-4f3f-9ccd-960fd74c1b25'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:24:07.112208 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-4f507531-3588-4f3f-9ccd-960fd74c1b25 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c627df5746104c1289aa80e8481c05a7', 'request_id': 'req-4f507531-3588-4f3f-9ccd-960fd74c1b25'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:24:07.120546 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-4f507531-3588-4f3f-9ccd-960fd74c1b25 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c627df5746104c1289aa80e8481c05a7', 'request_id': 'req-4f507531-3588-4f3f-9ccd-960fd74c1b25'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:24:07.141763 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-4f507531-3588-4f3f-9ccd-960fd74c1b25 admin admin] The token cache is being invalidate because project c627df5746104c1289aa80e8481c05a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=85204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 17:24:07.143533 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-4f507531-3588-4f3f-9ccd-960fd74c1b25 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:24:07.144221 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-4f507531-3588-4f3f-9ccd-960fd74c1b25 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:24:07.146223 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1188/2366] 10.222.0.58 () {58 vars in 1232 bytes} [Tue Oct 12 17:24:07 2021] DELETE /identity/v3/projects/c627df5746104c1289aa80e8481c05a7 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 17:24:07.150774 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e0f835-3e91-4e69-b4e8-17df2037f5e1 service neutron] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:24:07.161462 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e0f835-3e91-4e69-b4e8-17df2037f5e1 service neutron] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:24:07.238674 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2b8275-13be-48ac-a217-e9f75452cd4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:24:07.239574 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2b8275-13be-48ac-a217-e9f75452cd4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:24:07.240448 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2b8275-13be-48ac-a217-e9f75452cd4f admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:24:07.240732 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2b8275-13be-48ac-a217-e9f75452cd4f admin admin] PATH_INFO: `/v3/users/0636f34aa6b242118c5e35834938b67a` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:24:07.242036 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2b8275-13be-48ac-a217-e9f75452cd4f admin admin] RBAC: Authorizing `identity:delete_user(user_id=0636f34aa6b242118c5e35834938b67a)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:24:07.243984 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2b8275-13be-48ac-a217-e9f75452cd4f admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:24:07.301610 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-0d2b8275-13be-48ac-a217-e9f75452cd4f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0636f34aa6b242118c5e35834938b67a'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:24:07.318543 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-0d2b8275-13be-48ac-a217-e9f75452cd4f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0636f34aa6b242118c5e35834938b67a'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:24:07.327309 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-0d2b8275-13be-48ac-a217-e9f75452cd4f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0636f34aa6b242118c5e35834938b67a'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:24:07.334764 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-0d2b8275-13be-48ac-a217-e9f75452cd4f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0636f34aa6b242118c5e35834938b67a'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:24:07.335466 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-0d2b8275-13be-48ac-a217-e9f75452cd4f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0636f34aa6b242118c5e35834938b67a'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:24:07.349264 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1179/2367] 10.222.0.58 () {58 vars in 1223 bytes} [Tue Oct 12 17:24:07 2021] DELETE /identity/v3/users/0636f34aa6b242118c5e35834938b67a => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 17:24:07.409102 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5eeae3d-d46e-4d53-816f-012309206a10 None None] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:24:07.409495 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5eeae3d-d46e-4d53-816f-012309206a10 None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:24:07.409786 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5eeae3d-d46e-4d53-816f-012309206a10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:24:07.447518 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.auth.core [None req-a5eeae3d-d46e-4d53-816f-012309206a10 None None] MFA Rules not processed for user `8f7ee28a4d884e40a5a1c5e427fba8de`. Rule list: `[]` (Enabled: `True`). {{(pid=85204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 17:24:07.448824 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-a5eeae3d-d46e-4d53-816f-012309206a10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:24:07.521280 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1189/2368] 10.222.0.58 () {58 vars in 957 bytes} [Tue Oct 12 17:24:07 2021] POST /identity/v3/auth/tokens => generated 3393 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 17:24:07.526106 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2b8275-13be-48ac-a217-e9f75452cd4f admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:24:07.528921 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-0d2b8275-13be-48ac-a217-e9f75452cd4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:24:07.618363 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2b8275-13be-48ac-a217-e9f75452cd4f admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:24:07.623553 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157fae9c-5830-4472-bf9a-b3abe959045a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:24:07.624227 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157fae9c-5830-4472-bf9a-b3abe959045a admin admin] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:24:07.624517 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157fae9c-5830-4472-bf9a-b3abe959045a admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:24:07.624798 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157fae9c-5830-4472-bf9a-b3abe959045a admin admin] PATH_INFO: `/v3/projects` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:24:07.625507 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157fae9c-5830-4472-bf9a-b3abe959045a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:24:07.627457 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157fae9c-5830-4472-bf9a-b3abe959045a admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:24:07.657239 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1180/2369] 10.222.0.58 () {60 vars in 1152 bytes} [Tue Oct 12 17:24:07 2021] POST /identity/v3/projects => generated 371 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 17:24:07.660922 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5eeae3d-d46e-4d53-816f-012309206a10 None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:24:07.674254 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5eeae3d-d46e-4d53-816f-012309206a10 None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:24:07.707088 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157fae9c-5830-4472-bf9a-b3abe959045a admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:24:07.708993 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-157fae9c-5830-4472-bf9a-b3abe959045a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:24:07.765559 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1bb257-5919-47ff-8d99-704a678836b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:24:07.766292 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1bb257-5919-47ff-8d99-704a678836b5 admin admin] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:24:07.766577 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1bb257-5919-47ff-8d99-704a678836b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:24:07.766854 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1bb257-5919-47ff-8d99-704a678836b5 admin admin] PATH_INFO: `/v3/users` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:24:07.767589 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1bb257-5919-47ff-8d99-704a678836b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:24:07.769594 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1bb257-5919-47ff-8d99-704a678836b5 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:24:07.795689 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1190/2370] 10.222.0.58 () {60 vars in 1143 bytes} [Tue Oct 12 17:24:07 2021] POST /identity/v3/users => generated 292 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 17:24:07.799516 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1bb257-5919-47ff-8d99-704a678836b5 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:24:07.811722 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1bb257-5919-47ff-8d99-704a678836b5 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:24:07.817766 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8654fb40-d3a2-40c4-9660-6892c70d22db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:24:07.819029 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8654fb40-d3a2-40c4-9660-6892c70d22db admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:24:07.819501 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8654fb40-d3a2-40c4-9660-6892c70d22db admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:24:07.819937 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8654fb40-d3a2-40c4-9660-6892c70d22db admin admin] PATH_INFO: `/v3/roles` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:24:07.820995 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8654fb40-d3a2-40c4-9660-6892c70d22db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:24:07.823037 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8654fb40-d3a2-40c4-9660-6892c70d22db admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:24:07.833286 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157fae9c-5830-4472-bf9a-b3abe959045a admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:24:07.838007 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1191/2371] 10.222.0.58 () {58 vars in 1121 bytes} [Tue Oct 12 17:24:07 2021] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 17:24:07.839870 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3388a153-1ba8-43d8-86a5-4aaec9ef275d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:24:07.840763 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3388a153-1ba8-43d8-86a5-4aaec9ef275d admin admin] REQUEST_METHOD: `DELETE` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:24:07.841240 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3388a153-1ba8-43d8-86a5-4aaec9ef275d admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:24:07.841510 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3388a153-1ba8-43d8-86a5-4aaec9ef275d admin admin] PATH_INFO: `/v3/projects/2172a7b91a40417988a060382b94117e` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:24:07.842131 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8654fb40-d3a2-40c4-9660-6892c70d22db admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:24:07.843073 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3388a153-1ba8-43d8-86a5-4aaec9ef275d admin admin] RBAC: Authorizing `identity:delete_project(project_id=2172a7b91a40417988a060382b94117e)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:24:07.845180 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3388a153-1ba8-43d8-86a5-4aaec9ef275d admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:24:07.854014 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8654fb40-d3a2-40c4-9660-6892c70d22db admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:24:07.860249 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99b952b-bd63-4383-934b-bbaadaef7870 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:24:07.861156 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99b952b-bd63-4383-934b-bbaadaef7870 admin admin] REQUEST_METHOD: `PUT` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:24:07.861437 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99b952b-bd63-4383-934b-bbaadaef7870 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:24:07.861707 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99b952b-bd63-4383-934b-bbaadaef7870 admin admin] PATH_INFO: `/v3/projects/7a7b70a460984d07b022d9f7315dfaca/users/13059d127f414ca08c63ac963b60a339/roles/610824e4f50f4fb8954610e98c1de784` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:24:07.897463 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99b952b-bd63-4383-934b-bbaadaef7870 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a7b70a460984d07b022d9f7315dfaca, user_id=13059d127f414ca08c63ac963b60a339, role_id=610824e4f50f4fb8954610e98c1de784)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:24:07.903167 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99b952b-bd63-4383-934b-bbaadaef7870 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:24:07.932438 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1192/2372] 10.222.0.58 () {60 vars in 1482 bytes} [Tue Oct 12 17:24:07 2021] PUT /identity/v3/projects/7a7b70a460984d07b022d9f7315dfaca/users/13059d127f414ca08c63ac963b60a339/roles/610824e4f50f4fb8954610e98c1de784 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 17:24:07.933396 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99b952b-bd63-4383-934b-bbaadaef7870 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:24:07.942631 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-3388a153-1ba8-43d8-86a5-4aaec9ef275d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2172a7b91a40417988a060382b94117e', 'request_id': 'req-3388a153-1ba8-43d8-86a5-4aaec9ef275d'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:24:07.952195 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-3388a153-1ba8-43d8-86a5-4aaec9ef275d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2172a7b91a40417988a060382b94117e', 'request_id': 'req-3388a153-1ba8-43d8-86a5-4aaec9ef275d'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:24:07.959529 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-3388a153-1ba8-43d8-86a5-4aaec9ef275d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2172a7b91a40417988a060382b94117e', 'request_id': 'req-3388a153-1ba8-43d8-86a5-4aaec9ef275d'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:24:07.987750 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-3388a153-1ba8-43d8-86a5-4aaec9ef275d admin admin] The token cache is being invalidate because project 2172a7b91a40417988a060382b94117e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=85205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 17:24:07.988056 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-3388a153-1ba8-43d8-86a5-4aaec9ef275d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:24:07.988759 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-3388a153-1ba8-43d8-86a5-4aaec9ef275d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:24:07.991716 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1181/2373] 10.222.0.58 () {58 vars in 1232 bytes} [Tue Oct 12 17:24:07 2021] DELETE /identity/v3/projects/2172a7b91a40417988a060382b94117e => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 17:24:07.996984 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e490931-582a-495a-a934-ea0b9f4a890e None None] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:24:07.997202 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e490931-582a-495a-a934-ea0b9f4a890e None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:24:07.997476 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e490931-582a-495a-a934-ea0b9f4a890e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:24:08.022518 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99b952b-bd63-4383-934b-bbaadaef7870 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:24:08.026397 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.auth.core [None req-3e490931-582a-495a-a934-ea0b9f4a890e None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 17:24:08.027662 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-3e490931-582a-495a-a934-ea0b9f4a890e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:24:08.088368 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16204890-b829-4305-b3a4-159135544613 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:24:08.089321 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16204890-b829-4305-b3a4-159135544613 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:24:08.089917 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16204890-b829-4305-b3a4-159135544613 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:24:08.089917 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16204890-b829-4305-b3a4-159135544613 admin admin] PATH_INFO: `/v3/roles` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:24:08.090805 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16204890-b829-4305-b3a4-159135544613 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:24:08.093133 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16204890-b829-4305-b3a4-159135544613 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:24:08.105145 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1182/2374] 10.222.0.58 () {58 vars in 957 bytes} [Tue Oct 12 17:24:07 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 17:24:08.105766 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1193/2375] 10.222.0.58 () {58 vars in 1121 bytes} [Tue Oct 12 17:24:07 2021] GET /identity/v3/roles => generated 1420 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 17:24:08.110901 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e490931-582a-495a-a934-ea0b9f4a890e None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:24:08.112410 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-3e490931-582a-495a-a934-ea0b9f4a890e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:24:08.112661 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fd08d7-7e4e-4445-8cb4-ede852bdc0a1 None None] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:24:08.112956 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fd08d7-7e4e-4445-8cb4-ede852bdc0a1 None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:24:08.113236 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fd08d7-7e4e-4445-8cb4-ede852bdc0a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:24:08.124952 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e490931-582a-495a-a934-ea0b9f4a890e None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:24:08.129624 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddb960f-5a81-41f0-aae9-564a1fa4a7d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:24:08.131342 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddb960f-5a81-41f0-aae9-564a1fa4a7d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:24:08.131746 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddb960f-5a81-41f0-aae9-564a1fa4a7d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:24:08.132025 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddb960f-5a81-41f0-aae9-564a1fa4a7d1 admin admin] PATH_INFO: `/v3/projects/7a7b70a460984d07b022d9f7315dfaca/users/13059d127f414ca08c63ac963b60a339/roles/610824e4f50f4fb8954610e98c1de784` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:24:08.133996 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.auth.core [None req-f1fd08d7-7e4e-4445-8cb4-ede852bdc0a1 None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 17:24:08.134140 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddb960f-5a81-41f0-aae9-564a1fa4a7d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a7b70a460984d07b022d9f7315dfaca, user_id=13059d127f414ca08c63ac963b60a339, role_id=610824e4f50f4fb8954610e98c1de784)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:24:08.135214 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-f1fd08d7-7e4e-4445-8cb4-ede852bdc0a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:24:08.136638 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddb960f-5a81-41f0-aae9-564a1fa4a7d1 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:24:08.146880 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1194/2376] 10.222.0.58 () {58 vars in 957 bytes} [Tue Oct 12 17:24:08 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 17:24:08.147867 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1183/2377] 10.222.0.58 () {60 vars in 1482 bytes} [Tue Oct 12 17:24:08 2021] PUT /identity/v3/projects/7a7b70a460984d07b022d9f7315dfaca/users/13059d127f414ca08c63ac963b60a339/roles/610824e4f50f4fb8954610e98c1de784 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 17:24:08.148284 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fd08d7-7e4e-4445-8cb4-ede852bdc0a1 None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:24:08.158243 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fd08d7-7e4e-4445-8cb4-ede852bdc0a1 None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:24:08.224900 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d354dccd-3ab4-466a-9f34-dbe423dbebe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:24:08.225854 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d354dccd-3ab4-466a-9f34-dbe423dbebe6 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:24:08.226819 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d354dccd-3ab4-466a-9f34-dbe423dbebe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:24:08.227289 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d354dccd-3ab4-466a-9f34-dbe423dbebe6 admin admin] PATH_INFO: `/v3/domains` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:24:08.228392 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d354dccd-3ab4-466a-9f34-dbe423dbebe6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 17:24:08.228891 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d354dccd-3ab4-466a-9f34-dbe423dbebe6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:24:08.231572 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d354dccd-3ab4-466a-9f34-dbe423dbebe6 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:24:08.254015 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1195/2378] 10.222.0.58 () {58 vars in 1152 bytes} [Tue Oct 12 17:24:08 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 17:24:08.260250 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddb960f-5a81-41f0-aae9-564a1fa4a7d1 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:24:08.276838 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddb960f-5a81-41f0-aae9-564a1fa4a7d1 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:24:08.282726 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a688fb93-45fa-4425-a3c4-705b994e8871 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:24:08.283505 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a688fb93-45fa-4425-a3c4-705b994e8871 admin admin] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:24:08.283856 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a688fb93-45fa-4425-a3c4-705b994e8871 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:24:08.284192 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a688fb93-45fa-4425-a3c4-705b994e8871 admin admin] PATH_INFO: `/v3/projects` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:24:08.284964 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a688fb93-45fa-4425-a3c4-705b994e8871 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:24:08.287659 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a688fb93-45fa-4425-a3c4-705b994e8871 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:24:08.316870 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1184/2379] 10.222.0.58 () {60 vars in 1152 bytes} [Tue Oct 12 17:24:08 2021] POST /identity/v3/projects => generated 379 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 17:24:08.322048 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d354dccd-3ab4-466a-9f34-dbe423dbebe6 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:24:08.332954 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d354dccd-3ab4-466a-9f34-dbe423dbebe6 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:24:08.399312 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e36e142-64fa-43ad-a07d-bdc543081b6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:24:08.400392 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e36e142-64fa-43ad-a07d-bdc543081b6d admin admin] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:24:08.400777 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e36e142-64fa-43ad-a07d-bdc543081b6d admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:24:08.401434 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e36e142-64fa-43ad-a07d-bdc543081b6d admin admin] PATH_INFO: `/v3/users` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:24:08.402801 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e36e142-64fa-43ad-a07d-bdc543081b6d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:24:08.405092 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e36e142-64fa-43ad-a07d-bdc543081b6d admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:24:08.427201 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1196/2380] 10.222.0.58 () {60 vars in 1143 bytes} [Tue Oct 12 17:24:08 2021] POST /identity/v3/users => generated 290 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 17:24:08.431566 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a688fb93-45fa-4425-a3c4-705b994e8871 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:24:08.442091 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a688fb93-45fa-4425-a3c4-705b994e8871 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:24:08.447759 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abc9c72-3bbd-4cab-9aad-6e0f8d092af5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:24:08.448438 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abc9c72-3bbd-4cab-9aad-6e0f8d092af5 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:24:08.448725 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abc9c72-3bbd-4cab-9aad-6e0f8d092af5 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:24:08.450134 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abc9c72-3bbd-4cab-9aad-6e0f8d092af5 admin admin] PATH_INFO: `/v3/roles` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:24:08.451660 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abc9c72-3bbd-4cab-9aad-6e0f8d092af5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:24:08.455333 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abc9c72-3bbd-4cab-9aad-6e0f8d092af5 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:24:08.467185 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1185/2381] 10.222.0.58 () {58 vars in 1121 bytes} [Tue Oct 12 17:24:08 2021] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 17:24:08.471182 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e36e142-64fa-43ad-a07d-bdc543081b6d admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:24:08.482785 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e36e142-64fa-43ad-a07d-bdc543081b6d admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:24:08.487584 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fb89bf-35ce-4e7d-bdc5-ce4ef4a83089 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:24:08.488260 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fb89bf-35ce-4e7d-bdc5-ce4ef4a83089 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:24:08.488544 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fb89bf-35ce-4e7d-bdc5-ce4ef4a83089 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:24:08.488823 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fb89bf-35ce-4e7d-bdc5-ce4ef4a83089 admin admin] PATH_INFO: `/v3/roles` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:24:08.489574 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fb89bf-35ce-4e7d-bdc5-ce4ef4a83089 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:24:08.492198 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fb89bf-35ce-4e7d-bdc5-ce4ef4a83089 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:24:08.502717 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1197/2382] 10.222.0.58 () {58 vars in 1121 bytes} [Tue Oct 12 17:24:08 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 17:24:08.508049 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abc9c72-3bbd-4cab-9aad-6e0f8d092af5 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:24:08.526133 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abc9c72-3bbd-4cab-9aad-6e0f8d092af5 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:24:08.534051 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c970d7db-0c30-4ece-a176-ae337d22b29d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:24:08.535350 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c970d7db-0c30-4ece-a176-ae337d22b29d admin admin] REQUEST_METHOD: `PUT` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:24:08.536047 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c970d7db-0c30-4ece-a176-ae337d22b29d admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:24:08.536514 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c970d7db-0c30-4ece-a176-ae337d22b29d admin admin] PATH_INFO: `/v3/projects/5cd8a52044cb4459a435cebe823eb2ff/users/b4920c951a9d47c195b3b8e0aa9b0ca5/roles/55ba49fe29884e64b57c3ad13188d554` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:24:08.561393 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c970d7db-0c30-4ece-a176-ae337d22b29d admin admin] RBAC: Authorizing `identity:create_grant(project_id=5cd8a52044cb4459a435cebe823eb2ff, user_id=b4920c951a9d47c195b3b8e0aa9b0ca5, role_id=55ba49fe29884e64b57c3ad13188d554)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:24:08.564994 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c970d7db-0c30-4ece-a176-ae337d22b29d admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:24:08.585334 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1186/2383] 10.222.0.58 () {60 vars in 1482 bytes} [Tue Oct 12 17:24:08 2021] PUT /identity/v3/projects/5cd8a52044cb4459a435cebe823eb2ff/users/b4920c951a9d47c195b3b8e0aa9b0ca5/roles/55ba49fe29884e64b57c3ad13188d554 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 17:24:08.597129 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad9a659-0202-4832-968e-0944301bb87f None None] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:24:08.597422 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad9a659-0202-4832-968e-0944301bb87f None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:24:08.597703 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad9a659-0202-4832-968e-0944301bb87f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:24:08.639880 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.auth.core [None req-2ad9a659-0202-4832-968e-0944301bb87f None None] MFA Rules not processed for user `b4920c951a9d47c195b3b8e0aa9b0ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=85204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 17:24:08.641196 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-2ad9a659-0202-4832-968e-0944301bb87f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:24:08.705592 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1198/2384] 10.222.0.58 () {58 vars in 957 bytes} [Tue Oct 12 17:24:08 2021] POST /identity/v3/auth/tokens => generated 3399 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 17:24:08.710639 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c970d7db-0c30-4ece-a176-ae337d22b29d admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:24:08.771954 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c970d7db-0c30-4ece-a176-ae337d22b29d admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:24:08.776544 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b9e6e6-0023-4dd3-b834-1fb324f1f711 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:24:08.777199 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b9e6e6-0023-4dd3-b834-1fb324f1f711 admin admin] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:24:08.777482 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b9e6e6-0023-4dd3-b834-1fb324f1f711 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:24:08.777757 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b9e6e6-0023-4dd3-b834-1fb324f1f711 admin admin] PATH_INFO: `/v3/projects` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:24:08.778492 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b9e6e6-0023-4dd3-b834-1fb324f1f711 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:24:08.780547 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b9e6e6-0023-4dd3-b834-1fb324f1f711 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:24:08.814699 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1187/2385] 10.222.0.58 () {60 vars in 1152 bytes} [Tue Oct 12 17:24:08 2021] POST /identity/v3/projects => generated 381 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 17:24:08.818792 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad9a659-0202-4832-968e-0944301bb87f None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:24:08.830858 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad9a659-0202-4832-968e-0944301bb87f None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:24:08.909558 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b836cea-ea43-42ed-9f7b-6ddda56c1990 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:24:08.910760 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b836cea-ea43-42ed-9f7b-6ddda56c1990 admin admin] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:24:08.911056 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b836cea-ea43-42ed-9f7b-6ddda56c1990 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:24:08.911341 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b836cea-ea43-42ed-9f7b-6ddda56c1990 admin admin] PATH_INFO: `/v3/users` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:24:08.912821 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b836cea-ea43-42ed-9f7b-6ddda56c1990 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:24:08.914813 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b836cea-ea43-42ed-9f7b-6ddda56c1990 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:24:08.936270 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1199/2386] 10.222.0.58 () {60 vars in 1143 bytes} [Tue Oct 12 17:24:08 2021] POST /identity/v3/users => generated 297 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 17:24:08.940468 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b9e6e6-0023-4dd3-b834-1fb324f1f711 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:24:08.951176 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b9e6e6-0023-4dd3-b834-1fb324f1f711 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:24:08.958169 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f733476-54c1-4a0b-8d08-4d1165993aa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:24:08.959431 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f733476-54c1-4a0b-8d08-4d1165993aa0 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:24:08.959756 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f733476-54c1-4a0b-8d08-4d1165993aa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:24:08.960078 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f733476-54c1-4a0b-8d08-4d1165993aa0 admin admin] PATH_INFO: `/v3/roles` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:24:08.960854 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f733476-54c1-4a0b-8d08-4d1165993aa0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:24:08.963354 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f733476-54c1-4a0b-8d08-4d1165993aa0 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:24:08.986148 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1188/2387] 10.222.0.58 () {58 vars in 1121 bytes} [Tue Oct 12 17:24:08 2021] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 17:24:08.986900 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b836cea-ea43-42ed-9f7b-6ddda56c1990 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:24:08.997915 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b836cea-ea43-42ed-9f7b-6ddda56c1990 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:24:09.003332 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0498cf7-90ba-4eb6-9ed5-241da6cae14f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:24:09.004232 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0498cf7-90ba-4eb6-9ed5-241da6cae14f admin admin] REQUEST_METHOD: `PUT` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:24:09.004515 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0498cf7-90ba-4eb6-9ed5-241da6cae14f admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:24:09.004795 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0498cf7-90ba-4eb6-9ed5-241da6cae14f admin admin] PATH_INFO: `/v3/projects/2a606207084947ab9da0191870d6652a/users/e722bf93e0204787a2f0c3bd7ee89c62/roles/610824e4f50f4fb8954610e98c1de784` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:24:09.026647 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0498cf7-90ba-4eb6-9ed5-241da6cae14f admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a606207084947ab9da0191870d6652a, user_id=e722bf93e0204787a2f0c3bd7ee89c62, role_id=610824e4f50f4fb8954610e98c1de784)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:24:09.029313 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0498cf7-90ba-4eb6-9ed5-241da6cae14f admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:24:09.049127 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1200/2388] 10.222.0.58 () {60 vars in 1482 bytes} [Tue Oct 12 17:24:08 2021] PUT /identity/v3/projects/2a606207084947ab9da0191870d6652a/users/e722bf93e0204787a2f0c3bd7ee89c62/roles/610824e4f50f4fb8954610e98c1de784 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 17:24:09.053482 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f733476-54c1-4a0b-8d08-4d1165993aa0 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:24:09.071034 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f733476-54c1-4a0b-8d08-4d1165993aa0 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:24:09.143009 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce4fe0a-1c54-4d50-be71-622aedb75752 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:24:09.143681 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce4fe0a-1c54-4d50-be71-622aedb75752 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:24:09.143962 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce4fe0a-1c54-4d50-be71-622aedb75752 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:24:09.144234 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce4fe0a-1c54-4d50-be71-622aedb75752 admin admin] PATH_INFO: `/v3/roles` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:24:09.144969 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce4fe0a-1c54-4d50-be71-622aedb75752 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:24:09.147177 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce4fe0a-1c54-4d50-be71-622aedb75752 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:24:09.158254 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1189/2389] 10.222.0.58 () {58 vars in 1121 bytes} [Tue Oct 12 17:24:09 2021] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 17:24:09.162003 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0498cf7-90ba-4eb6-9ed5-241da6cae14f admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:24:09.175248 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0498cf7-90ba-4eb6-9ed5-241da6cae14f admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:24:09.180772 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3882fe-834a-4415-96f8-8d887bcbaaee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:24:09.182038 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3882fe-834a-4415-96f8-8d887bcbaaee admin admin] REQUEST_METHOD: `PUT` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:24:09.182528 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3882fe-834a-4415-96f8-8d887bcbaaee admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:24:09.183006 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3882fe-834a-4415-96f8-8d887bcbaaee admin admin] PATH_INFO: `/v3/projects/2a606207084947ab9da0191870d6652a/users/e722bf93e0204787a2f0c3bd7ee89c62/roles/610824e4f50f4fb8954610e98c1de784` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:24:09.185312 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3882fe-834a-4415-96f8-8d887bcbaaee admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a606207084947ab9da0191870d6652a, user_id=e722bf93e0204787a2f0c3bd7ee89c62, role_id=610824e4f50f4fb8954610e98c1de784)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:24:09.188292 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3882fe-834a-4415-96f8-8d887bcbaaee admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:24:09.205962 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1201/2390] 10.222.0.58 () {60 vars in 1482 bytes} [Tue Oct 12 17:24:09 2021] PUT /identity/v3/projects/2a606207084947ab9da0191870d6652a/users/e722bf93e0204787a2f0c3bd7ee89c62/roles/610824e4f50f4fb8954610e98c1de784 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 17:24:09.216560 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147a36c3-c188-4604-ba39-7c7b83093454 None None] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:24:09.216920 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147a36c3-c188-4604-ba39-7c7b83093454 None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:24:09.217270 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147a36c3-c188-4604-ba39-7c7b83093454 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:24:09.247834 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.auth.core [None req-147a36c3-c188-4604-ba39-7c7b83093454 None None] MFA Rules not processed for user `e722bf93e0204787a2f0c3bd7ee89c62`. Rule list: `[]` (Enabled: `True`). {{(pid=85205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 17:24:09.249194 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-147a36c3-c188-4604-ba39-7c7b83093454 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:24:09.348629 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1190/2391] 10.222.0.58 () {58 vars in 957 bytes} [Tue Oct 12 17:24:09 2021] POST /identity/v3/auth/tokens => generated 3468 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 17:24:09.359754 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3882fe-834a-4415-96f8-8d887bcbaaee admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:24:09.361621 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-4f3882fe-834a-4415-96f8-8d887bcbaaee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:24:09.430651 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3882fe-834a-4415-96f8-8d887bcbaaee admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:24:09.434547 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd20df66-deee-4838-bb4d-82d4006db1ec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04704222b3d64a33a6c092fc641ccbb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:24:09.435224 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd20df66-deee-4838-bb4d-82d4006db1ec service cinder] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:24:09.435499 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd20df66-deee-4838-bb4d-82d4006db1ec service cinder] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:24:09.435773 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd20df66-deee-4838-bb4d-82d4006db1ec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:24:09.445834 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd20df66-deee-4838-bb4d-82d4006db1ec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:24:09.448360 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd20df66-deee-4838-bb4d-82d4006db1ec service cinder] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:24:09.461314 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1202/2392] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Oct 12 17:24:09 2021] GET /identity/v3/auth/tokens => generated 3468 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 17:24:09.553090 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147a36c3-c188-4604-ba39-7c7b83093454 None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:24:09.572276 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147a36c3-c188-4604-ba39-7c7b83093454 None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:24:09.585724 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fab4a7-93c1-4b00-95b3-f43808b0ede8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04704222b3d64a33a6c092fc641ccbb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:24:09.586554 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fab4a7-93c1-4b00-95b3-f43808b0ede8 service cinder] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:24:09.586937 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fab4a7-93c1-4b00-95b3-f43808b0ede8 service cinder] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:24:09.587309 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fab4a7-93c1-4b00-95b3-f43808b0ede8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:24:09.726792 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fab4a7-93c1-4b00-95b3-f43808b0ede8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:24:09.728241 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fab4a7-93c1-4b00-95b3-f43808b0ede8 service cinder] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:24:09.759091 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1191/2393] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Oct 12 17:24:09 2021] GET /identity/v3/auth/tokens => generated 3399 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 17:24:10.150031 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd20df66-deee-4838-bb4d-82d4006db1ec service cinder] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:24:10.241583 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd20df66-deee-4838-bb4d-82d4006db1ec service cinder] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:24:10.246360 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3605a4b-06f8-4368-ba81-40a5f7fa0cf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:24:10.247229 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3605a4b-06f8-4368-ba81-40a5f7fa0cf4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:24:10.247508 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3605a4b-06f8-4368-ba81-40a5f7fa0cf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:24:10.247784 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3605a4b-06f8-4368-ba81-40a5f7fa0cf4 admin admin] PATH_INFO: `/v3/users/b4920c951a9d47c195b3b8e0aa9b0ca5` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:24:10.248999 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3605a4b-06f8-4368-ba81-40a5f7fa0cf4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b4920c951a9d47c195b3b8e0aa9b0ca5)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:24:10.250946 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3605a4b-06f8-4368-ba81-40a5f7fa0cf4 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:24:10.308411 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-d3605a4b-06f8-4368-ba81-40a5f7fa0cf4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b4920c951a9d47c195b3b8e0aa9b0ca5'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:24:10.324024 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-d3605a4b-06f8-4368-ba81-40a5f7fa0cf4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b4920c951a9d47c195b3b8e0aa9b0ca5'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:24:10.334095 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-d3605a4b-06f8-4368-ba81-40a5f7fa0cf4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b4920c951a9d47c195b3b8e0aa9b0ca5'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:24:10.345838 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-d3605a4b-06f8-4368-ba81-40a5f7fa0cf4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b4920c951a9d47c195b3b8e0aa9b0ca5'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:24:10.349142 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-d3605a4b-06f8-4368-ba81-40a5f7fa0cf4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b4920c951a9d47c195b3b8e0aa9b0ca5'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:24:10.361167 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1203/2394] 10.222.0.58 () {58 vars in 1223 bytes} [Tue Oct 12 17:24:10 2021] DELETE /identity/v3/users/b4920c951a9d47c195b3b8e0aa9b0ca5 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 17:24:10.366018 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195994af-9ed4-4326-a9d4-aa4756b70540 None None] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:24:10.366616 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195994af-9ed4-4326-a9d4-aa4756b70540 None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:24:10.367071 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195994af-9ed4-4326-a9d4-aa4756b70540 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:24:10.388632 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.auth.core [None req-195994af-9ed4-4326-a9d4-aa4756b70540 None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 17:24:10.389988 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-195994af-9ed4-4326-a9d4-aa4756b70540 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:24:10.450921 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1192/2395] 10.222.0.58 () {58 vars in 957 bytes} [Tue Oct 12 17:24:10 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 17:24:10.461647 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3605a4b-06f8-4368-ba81-40a5f7fa0cf4 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:24:10.466966 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-d3605a4b-06f8-4368-ba81-40a5f7fa0cf4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:24:10.559817 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3605a4b-06f8-4368-ba81-40a5f7fa0cf4 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:24:10.564190 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dd9aac-b92d-479e-b4a5-3ce28bbef121 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e65f6d0598e4c539134292b86fb43d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:24:10.564849 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dd9aac-b92d-479e-b4a5-3ce28bbef121 service neutron] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:24:10.565127 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dd9aac-b92d-479e-b4a5-3ce28bbef121 service neutron] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:24:10.565403 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dd9aac-b92d-479e-b4a5-3ce28bbef121 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:24:10.586858 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3dd9aac-b92d-479e-b4a5-3ce28bbef121 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:24:10.589322 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3dd9aac-b92d-479e-b4a5-3ce28bbef121 service neutron] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:24:10.601031 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1204/2396] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Oct 12 17:24:10 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 17:24:11.183713 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195994af-9ed4-4326-a9d4-aa4756b70540 None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:24:11.185714 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-195994af-9ed4-4326-a9d4-aa4756b70540 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:24:11.213448 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195994af-9ed4-4326-a9d4-aa4756b70540 None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:24:11.225235 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dd8b17-4e84-450c-b328-6e8bbd5d39a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:24:11.227066 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dd8b17-4e84-450c-b328-6e8bbd5d39a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:24:11.227513 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dd8b17-4e84-450c-b328-6e8bbd5d39a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:24:11.228687 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dd8b17-4e84-450c-b328-6e8bbd5d39a8 admin admin] PATH_INFO: `/v3/projects/5cd8a52044cb4459a435cebe823eb2ff` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:24:11.230276 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6dd8b17-4e84-450c-b328-6e8bbd5d39a8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5cd8a52044cb4459a435cebe823eb2ff)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:24:11.234063 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6dd8b17-4e84-450c-b328-6e8bbd5d39a8 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:24:11.299519 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-b6dd8b17-4e84-450c-b328-6e8bbd5d39a8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5cd8a52044cb4459a435cebe823eb2ff', 'request_id': 'req-b6dd8b17-4e84-450c-b328-6e8bbd5d39a8'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:24:11.309007 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-b6dd8b17-4e84-450c-b328-6e8bbd5d39a8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5cd8a52044cb4459a435cebe823eb2ff', 'request_id': 'req-b6dd8b17-4e84-450c-b328-6e8bbd5d39a8'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:24:11.317151 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-b6dd8b17-4e84-450c-b328-6e8bbd5d39a8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5cd8a52044cb4459a435cebe823eb2ff', 'request_id': 'req-b6dd8b17-4e84-450c-b328-6e8bbd5d39a8'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:24:11.335625 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-b6dd8b17-4e84-450c-b328-6e8bbd5d39a8 admin admin] The token cache is being invalidate because project 5cd8a52044cb4459a435cebe823eb2ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=85205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 17:24:11.335839 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-b6dd8b17-4e84-450c-b328-6e8bbd5d39a8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:24:11.336574 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-b6dd8b17-4e84-450c-b328-6e8bbd5d39a8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:24:11.341316 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1193/2397] 10.222.0.58 () {58 vars in 1232 bytes} [Tue Oct 12 17:24:11 2021] DELETE /identity/v3/projects/5cd8a52044cb4459a435cebe823eb2ff => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 17:24:11.342966 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dd9aac-b92d-479e-b4a5-3ce28bbef121 service neutron] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:24:11.354648 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dd9aac-b92d-479e-b4a5-3ce28bbef121 service neutron] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:24:11.453988 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea4b525-74b6-4109-8a0d-a4d2fc415698 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:24:11.455244 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea4b525-74b6-4109-8a0d-a4d2fc415698 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:24:11.455672 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea4b525-74b6-4109-8a0d-a4d2fc415698 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:24:11.456090 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea4b525-74b6-4109-8a0d-a4d2fc415698 admin admin] PATH_INFO: `/v3/users/e722bf93e0204787a2f0c3bd7ee89c62` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:24:11.457503 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea4b525-74b6-4109-8a0d-a4d2fc415698 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e722bf93e0204787a2f0c3bd7ee89c62)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:24:11.459659 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea4b525-74b6-4109-8a0d-a4d2fc415698 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:24:11.541304 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-2ea4b525-74b6-4109-8a0d-a4d2fc415698 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e722bf93e0204787a2f0c3bd7ee89c62'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:24:11.566863 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-2ea4b525-74b6-4109-8a0d-a4d2fc415698 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e722bf93e0204787a2f0c3bd7ee89c62'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:24:11.575106 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-2ea4b525-74b6-4109-8a0d-a4d2fc415698 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e722bf93e0204787a2f0c3bd7ee89c62'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:24:11.589800 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-2ea4b525-74b6-4109-8a0d-a4d2fc415698 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e722bf93e0204787a2f0c3bd7ee89c62'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:24:11.590400 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-2ea4b525-74b6-4109-8a0d-a4d2fc415698 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e722bf93e0204787a2f0c3bd7ee89c62'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:24:11.601673 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1205/2398] 10.222.0.58 () {58 vars in 1223 bytes} [Tue Oct 12 17:24:11 2021] DELETE /identity/v3/users/e722bf93e0204787a2f0c3bd7ee89c62 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 17:24:12.173394 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dd8b17-4e84-450c-b328-6e8bbd5d39a8 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:24:12.175646 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-b6dd8b17-4e84-450c-b328-6e8bbd5d39a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:24:12.192489 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dd8b17-4e84-450c-b328-6e8bbd5d39a8 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:24:12.280014 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f478cc49-3efd-4216-9b22-c4a4404db099 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:24:12.281136 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f478cc49-3efd-4216-9b22-c4a4404db099 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:24:12.281628 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f478cc49-3efd-4216-9b22-c4a4404db099 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:24:12.282092 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f478cc49-3efd-4216-9b22-c4a4404db099 admin admin] PATH_INFO: `/v3/projects/2a606207084947ab9da0191870d6652a` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:24:12.284086 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f478cc49-3efd-4216-9b22-c4a4404db099 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2a606207084947ab9da0191870d6652a)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:24:12.287845 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f478cc49-3efd-4216-9b22-c4a4404db099 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:24:12.383939 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-f478cc49-3efd-4216-9b22-c4a4404db099 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a606207084947ab9da0191870d6652a', 'request_id': 'req-f478cc49-3efd-4216-9b22-c4a4404db099'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:24:12.391474 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-f478cc49-3efd-4216-9b22-c4a4404db099 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a606207084947ab9da0191870d6652a', 'request_id': 'req-f478cc49-3efd-4216-9b22-c4a4404db099'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:24:12.400379 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-f478cc49-3efd-4216-9b22-c4a4404db099 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a606207084947ab9da0191870d6652a', 'request_id': 'req-f478cc49-3efd-4216-9b22-c4a4404db099'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:24:12.426471 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-f478cc49-3efd-4216-9b22-c4a4404db099 admin admin] The token cache is being invalidate because project 2a606207084947ab9da0191870d6652a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=85205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 17:24:12.426775 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-f478cc49-3efd-4216-9b22-c4a4404db099 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:24:12.428053 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-f478cc49-3efd-4216-9b22-c4a4404db099 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:24:12.434863 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1194/2399] 10.222.0.58 () {58 vars in 1232 bytes} [Tue Oct 12 17:24:12 2021] DELETE /identity/v3/projects/2a606207084947ab9da0191870d6652a => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 17:24:12.436200 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cfbf1c-e39d-4a16-a100-da75a3c59c2e None None] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:24:12.436660 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cfbf1c-e39d-4a16-a100-da75a3c59c2e None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:24:12.436845 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cfbf1c-e39d-4a16-a100-da75a3c59c2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:24:12.464311 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.auth.core [None req-79cfbf1c-e39d-4a16-a100-da75a3c59c2e None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 17:24:12.468656 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-79cfbf1c-e39d-4a16-a100-da75a3c59c2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:24:12.597901 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1206/2400] 10.222.0.58 () {58 vars in 957 bytes} [Tue Oct 12 17:24:12 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 17:24:12.605658 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55344f09-9fb9-4ce5-9d7e-79e8936b72fd None None] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:24:12.605982 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55344f09-9fb9-4ce5-9d7e-79e8936b72fd None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:24:12.606259 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55344f09-9fb9-4ce5-9d7e-79e8936b72fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:24:12.627312 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.auth.core [None req-55344f09-9fb9-4ce5-9d7e-79e8936b72fd None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 17:24:12.628664 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-55344f09-9fb9-4ce5-9d7e-79e8936b72fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:24:12.643378 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1195/2401] 10.222.0.58 () {58 vars in 957 bytes} [Tue Oct 12 17:24:12 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 17:24:12.645057 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cfbf1c-e39d-4a16-a100-da75a3c59c2e None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:24:12.656237 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cfbf1c-e39d-4a16-a100-da75a3c59c2e None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:24:12.662164 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83ab730-c2d6-4b27-b134-6bd6058ea0f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:24:12.662826 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83ab730-c2d6-4b27-b134-6bd6058ea0f4 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:24:12.663272 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83ab730-c2d6-4b27-b134-6bd6058ea0f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:24:12.663554 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83ab730-c2d6-4b27-b134-6bd6058ea0f4 admin admin] PATH_INFO: `/v3/domains` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:24:12.664286 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83ab730-c2d6-4b27-b134-6bd6058ea0f4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 17:24:12.664756 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83ab730-c2d6-4b27-b134-6bd6058ea0f4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:24:12.666368 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83ab730-c2d6-4b27-b134-6bd6058ea0f4 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:24:12.681719 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1207/2402] 10.222.0.58 () {58 vars in 1152 bytes} [Tue Oct 12 17:24:12 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 17:24:12.685735 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55344f09-9fb9-4ce5-9d7e-79e8936b72fd None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:24:12.697265 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55344f09-9fb9-4ce5-9d7e-79e8936b72fd None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:24:12.702608 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789e38a9-b605-4949-8325-9526be37f10e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:24:12.703322 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789e38a9-b605-4949-8325-9526be37f10e admin admin] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:24:12.703533 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789e38a9-b605-4949-8325-9526be37f10e admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:24:12.703838 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789e38a9-b605-4949-8325-9526be37f10e admin admin] PATH_INFO: `/v3/projects` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:24:12.704538 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789e38a9-b605-4949-8325-9526be37f10e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:24:12.707414 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789e38a9-b605-4949-8325-9526be37f10e admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:24:12.758699 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1196/2403] 10.222.0.58 () {60 vars in 1152 bytes} [Tue Oct 12 17:24:12 2021] POST /identity/v3/projects => generated 373 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 17:24:12.759917 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83ab730-c2d6-4b27-b134-6bd6058ea0f4 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:24:12.770875 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83ab730-c2d6-4b27-b134-6bd6058ea0f4 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:24:12.848252 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6fbeb3-286e-49b5-9df0-1faa5eab6a54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:24:12.849655 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6fbeb3-286e-49b5-9df0-1faa5eab6a54 admin admin] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:24:12.850175 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6fbeb3-286e-49b5-9df0-1faa5eab6a54 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:24:12.850547 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6fbeb3-286e-49b5-9df0-1faa5eab6a54 admin admin] PATH_INFO: `/v3/users` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:24:12.851350 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6fbeb3-286e-49b5-9df0-1faa5eab6a54 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:24:12.854073 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6fbeb3-286e-49b5-9df0-1faa5eab6a54 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:24:12.877283 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1208/2404] 10.222.0.58 () {60 vars in 1143 bytes} [Tue Oct 12 17:24:12 2021] POST /identity/v3/users => generated 287 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 17:24:12.881936 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789e38a9-b605-4949-8325-9526be37f10e admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:24:12.893339 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789e38a9-b605-4949-8325-9526be37f10e admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:24:12.901321 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19797ffd-493c-4dee-9b0f-01104c6bd456 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:24:12.902152 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19797ffd-493c-4dee-9b0f-01104c6bd456 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:24:12.902521 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19797ffd-493c-4dee-9b0f-01104c6bd456 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:24:12.902867 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19797ffd-493c-4dee-9b0f-01104c6bd456 admin admin] PATH_INFO: `/v3/roles` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:24:12.903678 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19797ffd-493c-4dee-9b0f-01104c6bd456 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:24:12.905501 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19797ffd-493c-4dee-9b0f-01104c6bd456 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:24:12.919308 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1197/2405] 10.222.0.58 () {58 vars in 1121 bytes} [Tue Oct 12 17:24:12 2021] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 17:24:12.923675 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6fbeb3-286e-49b5-9df0-1faa5eab6a54 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:24:12.937432 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6fbeb3-286e-49b5-9df0-1faa5eab6a54 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:24:12.953772 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0079b20-f800-4ec9-85af-19b3ac1ec8b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:24:12.954715 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0079b20-f800-4ec9-85af-19b3ac1ec8b4 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:24:12.955173 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0079b20-f800-4ec9-85af-19b3ac1ec8b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:24:12.955601 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0079b20-f800-4ec9-85af-19b3ac1ec8b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:24:12.957508 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0079b20-f800-4ec9-85af-19b3ac1ec8b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:24:12.960716 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0079b20-f800-4ec9-85af-19b3ac1ec8b4 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:24:12.972700 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1209/2406] 10.222.0.58 () {58 vars in 1121 bytes} [Tue Oct 12 17:24:12 2021] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 17:24:12.976439 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19797ffd-493c-4dee-9b0f-01104c6bd456 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:24:12.994117 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19797ffd-493c-4dee-9b0f-01104c6bd456 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:24:13.004009 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6524374-b2e5-4b11-bb62-44a882751bdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:24:13.006080 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6524374-b2e5-4b11-bb62-44a882751bdf admin admin] REQUEST_METHOD: `PUT` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:24:13.007049 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6524374-b2e5-4b11-bb62-44a882751bdf admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:24:13.007524 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6524374-b2e5-4b11-bb62-44a882751bdf admin admin] PATH_INFO: `/v3/projects/544ad7ed39ee4ce2969bb819a3cb751e/users/a053dc3cb47d4391a929c257eea553b7/roles/55ba49fe29884e64b57c3ad13188d554` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:24:13.026065 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6524374-b2e5-4b11-bb62-44a882751bdf admin admin] RBAC: Authorizing `identity:create_grant(project_id=544ad7ed39ee4ce2969bb819a3cb751e, user_id=a053dc3cb47d4391a929c257eea553b7, role_id=55ba49fe29884e64b57c3ad13188d554)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:24:13.029600 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6524374-b2e5-4b11-bb62-44a882751bdf admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:24:13.045949 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1198/2407] 10.222.0.58 () {60 vars in 1482 bytes} [Tue Oct 12 17:24:12 2021] PUT /identity/v3/projects/544ad7ed39ee4ce2969bb819a3cb751e/users/a053dc3cb47d4391a929c257eea553b7/roles/55ba49fe29884e64b57c3ad13188d554 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 17:24:13.057086 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb6a8aa-9f7b-4356-b608-77f53ad8e223 None None] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:24:13.057375 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb6a8aa-9f7b-4356-b608-77f53ad8e223 None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:24:13.057653 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb6a8aa-9f7b-4356-b608-77f53ad8e223 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:24:13.092313 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.auth.core [None req-7cb6a8aa-9f7b-4356-b608-77f53ad8e223 None None] MFA Rules not processed for user `a053dc3cb47d4391a929c257eea553b7`. Rule list: `[]` (Enabled: `True`). {{(pid=85204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 17:24:13.093735 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-7cb6a8aa-9f7b-4356-b608-77f53ad8e223 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:24:13.180321 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1210/2408] 10.222.0.58 () {58 vars in 957 bytes} [Tue Oct 12 17:24:13 2021] POST /identity/v3/auth/tokens => generated 3393 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 17:24:13.190690 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6524374-b2e5-4b11-bb62-44a882751bdf admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:24:13.193257 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-b6524374-b2e5-4b11-bb62-44a882751bdf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:24:13.217314 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9407e5-f34c-461d-a005-afa92f0698e1 None None] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:24:13.217623 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9407e5-f34c-461d-a005-afa92f0698e1 None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:24:13.217928 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9407e5-f34c-461d-a005-afa92f0698e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:24:13.244796 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.auth.core [None req-5c9407e5-f34c-461d-a005-afa92f0698e1 None None] MFA Rules not processed for user `13059d127f414ca08c63ac963b60a339`. Rule list: `[]` (Enabled: `True`). {{(pid=85204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 17:24:13.246041 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-5c9407e5-f34c-461d-a005-afa92f0698e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:24:13.264995 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6524374-b2e5-4b11-bb62-44a882751bdf admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:24:13.271855 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae41e787-7025-4a24-98fb-57521b5d8c54 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04704222b3d64a33a6c092fc641ccbb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:24:13.272522 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae41e787-7025-4a24-98fb-57521b5d8c54 service cinder] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:24:13.272806 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae41e787-7025-4a24-98fb-57521b5d8c54 service cinder] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:24:13.273093 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae41e787-7025-4a24-98fb-57521b5d8c54 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:24:13.284825 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae41e787-7025-4a24-98fb-57521b5d8c54 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:24:13.287753 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae41e787-7025-4a24-98fb-57521b5d8c54 service cinder] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:24:13.299480 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1199/2409] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Oct 12 17:24:13 2021] GET /identity/v3/auth/tokens => generated 3393 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 17:24:13.324317 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae41e787-7025-4a24-98fb-57521b5d8c54 service cinder] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:24:13.348340 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1211/2410] 10.222.0.58 () {58 vars in 957 bytes} [Tue Oct 12 17:24:13 2021] POST /identity/v3/auth/tokens => generated 3458 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 17:24:13.357774 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9407e5-f34c-461d-a005-afa92f0698e1 None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:24:13.360189 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-5c9407e5-f34c-461d-a005-afa92f0698e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:24:13.395615 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae41e787-7025-4a24-98fb-57521b5d8c54 service cinder] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:24:13.401027 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b796e2-5d5a-4725-a70b-d3b99091d07f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:24:13.401924 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b796e2-5d5a-4725-a70b-d3b99091d07f admin admin] REQUEST_METHOD: `DELETE` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:24:13.402205 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b796e2-5d5a-4725-a70b-d3b99091d07f admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:24:13.402499 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b796e2-5d5a-4725-a70b-d3b99091d07f admin admin] PATH_INFO: `/v3/users/a053dc3cb47d4391a929c257eea553b7` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:24:13.403698 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b796e2-5d5a-4725-a70b-d3b99091d07f admin admin] RBAC: Authorizing `identity:delete_user(user_id=a053dc3cb47d4391a929c257eea553b7)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:24:13.405579 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b796e2-5d5a-4725-a70b-d3b99091d07f admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:24:13.440206 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9407e5-f34c-461d-a005-afa92f0698e1 None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:24:13.446221 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279ed563-2037-400f-add5-d09d1f10ee0e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29d30b574eec4ad3990d77d235c8b424', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:24:13.446956 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279ed563-2037-400f-add5-d09d1f10ee0e service nova] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:24:13.447327 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279ed563-2037-400f-add5-d09d1f10ee0e service nova] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:24:13.447683 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279ed563-2037-400f-add5-d09d1f10ee0e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:24:13.450824 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-279ed563-2037-400f-add5-d09d1f10ee0e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:24:13.459649 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-86b796e2-5d5a-4725-a70b-d3b99091d07f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a053dc3cb47d4391a929c257eea553b7'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:24:13.471341 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-86b796e2-5d5a-4725-a70b-d3b99091d07f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a053dc3cb47d4391a929c257eea553b7'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:24:13.479750 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-86b796e2-5d5a-4725-a70b-d3b99091d07f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a053dc3cb47d4391a929c257eea553b7'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:24:13.487111 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-86b796e2-5d5a-4725-a70b-d3b99091d07f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a053dc3cb47d4391a929c257eea553b7'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:24:13.487837 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-86b796e2-5d5a-4725-a70b-d3b99091d07f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a053dc3cb47d4391a929c257eea553b7'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:24:13.494588 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1200/2411] 10.222.0.58 () {58 vars in 1223 bytes} [Tue Oct 12 17:24:13 2021] DELETE /identity/v3/users/a053dc3cb47d4391a929c257eea553b7 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 17:24:13.503126 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db8de8d-e012-43b6-b167-6f0b8452b5a4 None None] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:24:13.503412 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db8de8d-e012-43b6-b167-6f0b8452b5a4 None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:24:13.503690 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db8de8d-e012-43b6-b167-6f0b8452b5a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:24:13.520612 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.auth.core [None req-9db8de8d-e012-43b6-b167-6f0b8452b5a4 None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 17:24:13.523822 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-9db8de8d-e012-43b6-b167-6f0b8452b5a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:24:13.525794 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279ed563-2037-400f-add5-d09d1f10ee0e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:24:13.527772 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279ed563-2037-400f-add5-d09d1f10ee0e service nova] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:24:13.538843 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1212/2412] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Oct 12 17:24:13 2021] GET /identity/v3/auth/tokens => generated 3393 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 12 17:24:13.599063 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1201/2413] 10.222.0.58 () {58 vars in 957 bytes} [Tue Oct 12 17:24:13 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 17:24:13.609859 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279ed563-2037-400f-add5-d09d1f10ee0e service nova] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:24:13.611669 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-279ed563-2037-400f-add5-d09d1f10ee0e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:24:13.673078 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279ed563-2037-400f-add5-d09d1f10ee0e service nova] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:24:13.738833 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fac510-fd48-45b8-b6a3-a09c56036017 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e65f6d0598e4c539134292b86fb43d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:24:13.739486 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fac510-fd48-45b8-b6a3-a09c56036017 service neutron] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:24:13.739805 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fac510-fd48-45b8-b6a3-a09c56036017 service neutron] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:24:13.740135 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fac510-fd48-45b8-b6a3-a09c56036017 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:24:13.749561 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fac510-fd48-45b8-b6a3-a09c56036017 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:24:13.751819 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fac510-fd48-45b8-b6a3-a09c56036017 service neutron] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:24:13.773940 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1213/2414] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Oct 12 17:24:13 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 12 17:24:14.073130 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db8de8d-e012-43b6-b167-6f0b8452b5a4 None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:24:14.075298 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-9db8de8d-e012-43b6-b167-6f0b8452b5a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:24:14.089485 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db8de8d-e012-43b6-b167-6f0b8452b5a4 None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:24:14.099213 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d00a022-6b0e-48a2-8293-cc74371ccfc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:24:14.100097 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d00a022-6b0e-48a2-8293-cc74371ccfc3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:24:14.100381 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d00a022-6b0e-48a2-8293-cc74371ccfc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:24:14.100685 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d00a022-6b0e-48a2-8293-cc74371ccfc3 admin admin] PATH_INFO: `/v3/projects/544ad7ed39ee4ce2969bb819a3cb751e` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:24:14.102048 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d00a022-6b0e-48a2-8293-cc74371ccfc3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=544ad7ed39ee4ce2969bb819a3cb751e)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:24:14.103900 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d00a022-6b0e-48a2-8293-cc74371ccfc3 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:24:14.167522 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-8d00a022-6b0e-48a2-8293-cc74371ccfc3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '544ad7ed39ee4ce2969bb819a3cb751e', 'request_id': 'req-8d00a022-6b0e-48a2-8293-cc74371ccfc3'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:24:14.172830 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-8d00a022-6b0e-48a2-8293-cc74371ccfc3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '544ad7ed39ee4ce2969bb819a3cb751e', 'request_id': 'req-8d00a022-6b0e-48a2-8293-cc74371ccfc3'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:24:14.179475 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-8d00a022-6b0e-48a2-8293-cc74371ccfc3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '544ad7ed39ee4ce2969bb819a3cb751e', 'request_id': 'req-8d00a022-6b0e-48a2-8293-cc74371ccfc3'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:24:14.195296 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-8d00a022-6b0e-48a2-8293-cc74371ccfc3 admin admin] The token cache is being invalidate because project 544ad7ed39ee4ce2969bb819a3cb751e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=85205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 17:24:14.196277 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-8d00a022-6b0e-48a2-8293-cc74371ccfc3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:24:14.197081 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-8d00a022-6b0e-48a2-8293-cc74371ccfc3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:24:14.198699 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1202/2415] 10.222.0.58 () {58 vars in 1232 bytes} [Tue Oct 12 17:24:14 2021] DELETE /identity/v3/projects/544ad7ed39ee4ce2969bb819a3cb751e => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 17:24:14.204528 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655dfd84-6db8-473b-bece-84ceee6d5939 None None] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:24:14.204820 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655dfd84-6db8-473b-bece-84ceee6d5939 None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:24:14.205096 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655dfd84-6db8-473b-bece-84ceee6d5939 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:24:14.223251 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.auth.core [None req-655dfd84-6db8-473b-bece-84ceee6d5939 None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 17:24:14.224615 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-655dfd84-6db8-473b-bece-84ceee6d5939 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:24:14.286330 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1214/2416] 10.222.0.58 () {58 vars in 957 bytes} [Tue Oct 12 17:24:14 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 17:24:14.294725 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071a3551-4640-49e0-aa40-7ed882e38a10 None None] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:24:14.295235 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071a3551-4640-49e0-aa40-7ed882e38a10 None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:24:14.295513 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071a3551-4640-49e0-aa40-7ed882e38a10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:24:14.314991 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.auth.core [None req-071a3551-4640-49e0-aa40-7ed882e38a10 None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 17:24:14.316201 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-071a3551-4640-49e0-aa40-7ed882e38a10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:24:14.328380 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1203/2417] 10.222.0.58 () {58 vars in 957 bytes} [Tue Oct 12 17:24:14 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 17:24:14.332579 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655dfd84-6db8-473b-bece-84ceee6d5939 None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:24:14.345598 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655dfd84-6db8-473b-bece-84ceee6d5939 None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:24:14.352658 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3379b908-5cf2-4aa6-b08e-1bb72160ca46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:24:14.353326 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3379b908-5cf2-4aa6-b08e-1bb72160ca46 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:24:14.353609 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3379b908-5cf2-4aa6-b08e-1bb72160ca46 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:24:14.353911 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3379b908-5cf2-4aa6-b08e-1bb72160ca46 admin admin] PATH_INFO: `/v3/domains` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:24:14.354787 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3379b908-5cf2-4aa6-b08e-1bb72160ca46 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 17:24:14.355101 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3379b908-5cf2-4aa6-b08e-1bb72160ca46 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:24:14.356702 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3379b908-5cf2-4aa6-b08e-1bb72160ca46 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:24:14.374559 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1215/2418] 10.222.0.58 () {58 vars in 1152 bytes} [Tue Oct 12 17:24:14 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 17:24:14.375093 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071a3551-4640-49e0-aa40-7ed882e38a10 None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:24:14.384609 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071a3551-4640-49e0-aa40-7ed882e38a10 None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:24:14.389406 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1c2f9a-3207-448a-a602-018679d9b693 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:24:14.390089 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1c2f9a-3207-448a-a602-018679d9b693 admin admin] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:24:14.390378 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1c2f9a-3207-448a-a602-018679d9b693 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:24:14.390658 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1c2f9a-3207-448a-a602-018679d9b693 admin admin] PATH_INFO: `/v3/projects` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:24:14.391378 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1c2f9a-3207-448a-a602-018679d9b693 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:24:14.393272 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1c2f9a-3207-448a-a602-018679d9b693 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:24:14.419857 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1204/2419] 10.222.0.58 () {60 vars in 1152 bytes} [Tue Oct 12 17:24:14 2021] POST /identity/v3/projects => generated 375 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 17:24:14.423965 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3379b908-5cf2-4aa6-b08e-1bb72160ca46 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:24:14.434817 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3379b908-5cf2-4aa6-b08e-1bb72160ca46 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:24:14.491126 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999bdc58-d0e4-4169-a80a-1ea0405b6480 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:24:14.491804 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999bdc58-d0e4-4169-a80a-1ea0405b6480 admin admin] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:24:14.492231 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999bdc58-d0e4-4169-a80a-1ea0405b6480 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:24:14.492512 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999bdc58-d0e4-4169-a80a-1ea0405b6480 admin admin] PATH_INFO: `/v3/users` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:24:14.493230 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999bdc58-d0e4-4169-a80a-1ea0405b6480 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:24:14.495206 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999bdc58-d0e4-4169-a80a-1ea0405b6480 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:24:14.516992 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1216/2420] 10.222.0.58 () {60 vars in 1143 bytes} [Tue Oct 12 17:24:14 2021] POST /identity/v3/users => generated 288 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 17:24:14.520789 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1c2f9a-3207-448a-a602-018679d9b693 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:24:14.531628 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1c2f9a-3207-448a-a602-018679d9b693 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:24:14.537054 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58daa321-a093-4ae8-b889-9f4bf9a6ebb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:24:14.537811 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58daa321-a093-4ae8-b889-9f4bf9a6ebb4 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:24:14.538219 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58daa321-a093-4ae8-b889-9f4bf9a6ebb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:24:14.538566 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58daa321-a093-4ae8-b889-9f4bf9a6ebb4 admin admin] PATH_INFO: `/v3/roles` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:24:14.539588 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58daa321-a093-4ae8-b889-9f4bf9a6ebb4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:24:14.541122 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58daa321-a093-4ae8-b889-9f4bf9a6ebb4 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:24:14.552162 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1205/2421] 10.222.0.58 () {58 vars in 1121 bytes} [Tue Oct 12 17:24:14 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 17:24:14.556726 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999bdc58-d0e4-4169-a80a-1ea0405b6480 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:24:14.566689 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999bdc58-d0e4-4169-a80a-1ea0405b6480 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:24:14.571779 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a9d65e-05aa-422e-aaae-c0d7297220c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:24:14.572445 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a9d65e-05aa-422e-aaae-c0d7297220c5 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:24:14.572727 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a9d65e-05aa-422e-aaae-c0d7297220c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:24:14.573006 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a9d65e-05aa-422e-aaae-c0d7297220c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:24:14.573898 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a9d65e-05aa-422e-aaae-c0d7297220c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:24:14.575552 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a9d65e-05aa-422e-aaae-c0d7297220c5 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:24:14.585959 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1217/2422] 10.222.0.58 () {58 vars in 1121 bytes} [Tue Oct 12 17:24:14 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 17:24:14.590295 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58daa321-a093-4ae8-b889-9f4bf9a6ebb4 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:24:14.602407 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58daa321-a093-4ae8-b889-9f4bf9a6ebb4 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:24:14.609450 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d04e812-eb66-49f3-bca3-457c6c5d2423 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:24:14.610659 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d04e812-eb66-49f3-bca3-457c6c5d2423 admin admin] REQUEST_METHOD: `PUT` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:24:14.610952 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d04e812-eb66-49f3-bca3-457c6c5d2423 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:24:14.611233 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d04e812-eb66-49f3-bca3-457c6c5d2423 admin admin] PATH_INFO: `/v3/projects/c9fa7363084c4378b5943c78b382e36e/users/66c2267c0b6b41848c9aa059d1db96c6/roles/55ba49fe29884e64b57c3ad13188d554` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:24:14.627664 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d04e812-eb66-49f3-bca3-457c6c5d2423 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9fa7363084c4378b5943c78b382e36e, user_id=66c2267c0b6b41848c9aa059d1db96c6, role_id=55ba49fe29884e64b57c3ad13188d554)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:24:14.630601 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d04e812-eb66-49f3-bca3-457c6c5d2423 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:24:14.657368 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1206/2423] 10.222.0.58 () {60 vars in 1482 bytes} [Tue Oct 12 17:24:14 2021] PUT /identity/v3/projects/c9fa7363084c4378b5943c78b382e36e/users/66c2267c0b6b41848c9aa059d1db96c6/roles/55ba49fe29884e64b57c3ad13188d554 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 17:24:14.668934 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f7bcf6-0262-4bc2-abf2-6121e50ff91e None None] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:24:14.669470 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f7bcf6-0262-4bc2-abf2-6121e50ff91e None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:24:14.669810 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f7bcf6-0262-4bc2-abf2-6121e50ff91e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:24:14.715924 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.auth.core [None req-16f7bcf6-0262-4bc2-abf2-6121e50ff91e None None] MFA Rules not processed for user `66c2267c0b6b41848c9aa059d1db96c6`. Rule list: `[]` (Enabled: `True`). {{(pid=85204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 17:24:14.717150 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-16f7bcf6-0262-4bc2-abf2-6121e50ff91e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:24:14.783346 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1218/2424] 10.222.0.58 () {58 vars in 957 bytes} [Tue Oct 12 17:24:14 2021] POST /identity/v3/auth/tokens => generated 3395 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 17:24:14.799520 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d04e812-eb66-49f3-bca3-457c6c5d2423 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:24:14.801199 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-2d04e812-eb66-49f3-bca3-457c6c5d2423 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:24:14.879752 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d04e812-eb66-49f3-bca3-457c6c5d2423 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:24:14.883943 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e86e03-d989-4584-8b40-5ccadffe3dfc service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ff84015069041f2bf33e3fd55b92e44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:24:14.884611 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e86e03-d989-4584-8b40-5ccadffe3dfc service glance] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:24:14.884900 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e86e03-d989-4584-8b40-5ccadffe3dfc service glance] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:24:14.885180 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e86e03-d989-4584-8b40-5ccadffe3dfc service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:24:14.894104 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e86e03-d989-4584-8b40-5ccadffe3dfc service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:24:14.895514 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e86e03-d989-4584-8b40-5ccadffe3dfc service glance] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:24:14.905163 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1207/2425] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Oct 12 17:24:14 2021] GET /identity/v3/auth/tokens => generated 3395 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 17:24:15.789819 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece21fe8-18fa-49d5-b53d-04dbc75908d3 None None] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:24:15.790405 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece21fe8-18fa-49d5-b53d-04dbc75908d3 None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:24:15.790655 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece21fe8-18fa-49d5-b53d-04dbc75908d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:24:15.821746 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.auth.core [None req-ece21fe8-18fa-49d5-b53d-04dbc75908d3 None None] MFA Rules not processed for user `8f7ee28a4d884e40a5a1c5e427fba8de`. Rule list: `[]` (Enabled: `True`). {{(pid=85204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 17:24:15.823602 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-ece21fe8-18fa-49d5-b53d-04dbc75908d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:24:15.893273 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1219/2426] 10.222.0.58 () {58 vars in 957 bytes} [Tue Oct 12 17:24:15 2021] POST /identity/v3/auth/tokens => generated 3393 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 17:24:30.726380 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e86e03-d989-4584-8b40-5ccadffe3dfc service glance] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:24:30.727759 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-a6e86e03-d989-4584-8b40-5ccadffe3dfc service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:24:30.783956 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e86e03-d989-4584-8b40-5ccadffe3dfc service glance] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:24:30.788097 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a946ae83-57a8-4097-978f-a586a85dee78 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04704222b3d64a33a6c092fc641ccbb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:24:30.788739 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a946ae83-57a8-4097-978f-a586a85dee78 service cinder] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:24:30.789021 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a946ae83-57a8-4097-978f-a586a85dee78 service cinder] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:24:30.789293 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a946ae83-57a8-4097-978f-a586a85dee78 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:24:30.791086 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-a946ae83-57a8-4097-978f-a586a85dee78 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:24:30.858623 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a946ae83-57a8-4097-978f-a586a85dee78 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:24:30.860049 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a946ae83-57a8-4097-978f-a586a85dee78 service cinder] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:24:30.878490 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1208/2427] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Oct 12 17:24:30 2021] GET /identity/v3/auth/tokens => generated 3407 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 17:24:32.146715 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece21fe8-18fa-49d5-b53d-04dbc75908d3 None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:24:32.156419 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece21fe8-18fa-49d5-b53d-04dbc75908d3 None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:24:32.160028 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bf1784-3ad8-466f-a607-d7f431ce9442 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04704222b3d64a33a6c092fc641ccbb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:24:32.160676 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bf1784-3ad8-466f-a607-d7f431ce9442 service cinder] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:24:32.160961 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bf1784-3ad8-466f-a607-d7f431ce9442 service cinder] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:24:32.161242 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bf1784-3ad8-466f-a607-d7f431ce9442 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:24:32.163628 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-44bf1784-3ad8-466f-a607-d7f431ce9442 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:24:32.231042 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bf1784-3ad8-466f-a607-d7f431ce9442 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:24:32.232397 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bf1784-3ad8-466f-a607-d7f431ce9442 service cinder] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:24:32.250232 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1220/2428] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Oct 12 17:24:32 2021] GET /identity/v3/auth/tokens => generated 3397 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 17:24:39.750269 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a946ae83-57a8-4097-978f-a586a85dee78 service cinder] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:24:39.809389 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a946ae83-57a8-4097-978f-a586a85dee78 service cinder] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:24:39.814058 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd7a2c4-9bb2-4735-b2ca-1f9258e202ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:24:39.814947 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd7a2c4-9bb2-4735-b2ca-1f9258e202ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:24:39.815228 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd7a2c4-9bb2-4735-b2ca-1f9258e202ff admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:24:39.815550 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd7a2c4-9bb2-4735-b2ca-1f9258e202ff admin admin] PATH_INFO: `/v3/users/66c2267c0b6b41848c9aa059d1db96c6` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:24:39.816849 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd7a2c4-9bb2-4735-b2ca-1f9258e202ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=66c2267c0b6b41848c9aa059d1db96c6)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:24:39.819264 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd7a2c4-9bb2-4735-b2ca-1f9258e202ff admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:24:39.865060 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-5fd7a2c4-9bb2-4735-b2ca-1f9258e202ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '66c2267c0b6b41848c9aa059d1db96c6'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:24:39.876985 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-5fd7a2c4-9bb2-4735-b2ca-1f9258e202ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '66c2267c0b6b41848c9aa059d1db96c6'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:24:39.885513 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-5fd7a2c4-9bb2-4735-b2ca-1f9258e202ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '66c2267c0b6b41848c9aa059d1db96c6'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:24:39.892292 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-5fd7a2c4-9bb2-4735-b2ca-1f9258e202ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '66c2267c0b6b41848c9aa059d1db96c6'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:24:39.892972 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-5fd7a2c4-9bb2-4735-b2ca-1f9258e202ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '66c2267c0b6b41848c9aa059d1db96c6'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:24:39.899280 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1209/2429] 10.222.0.58 () {58 vars in 1223 bytes} [Tue Oct 12 17:24:39 2021] DELETE /identity/v3/users/66c2267c0b6b41848c9aa059d1db96c6 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 17:24:39.903845 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1041a9fb-8d04-4314-aef0-c0b9331d13ab None None] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:24:39.904330 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1041a9fb-8d04-4314-aef0-c0b9331d13ab None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:24:39.904436 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1041a9fb-8d04-4314-aef0-c0b9331d13ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:24:39.920810 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.auth.core [None req-1041a9fb-8d04-4314-aef0-c0b9331d13ab None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 17:24:39.922017 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-1041a9fb-8d04-4314-aef0-c0b9331d13ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:24:39.976261 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1221/2430] 10.222.0.58 () {58 vars in 957 bytes} [Tue Oct 12 17:24:39 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 17:24:39.985854 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd7a2c4-9bb2-4735-b2ca-1f9258e202ff admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:24:39.987310 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-5fd7a2c4-9bb2-4735-b2ca-1f9258e202ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:24:40.041697 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd7a2c4-9bb2-4735-b2ca-1f9258e202ff admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:24:40.045414 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8408f2c7-0e44-4b53-bf2d-310db8f30d45 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e65f6d0598e4c539134292b86fb43d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:24:40.046083 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8408f2c7-0e44-4b53-bf2d-310db8f30d45 service neutron] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:24:40.046371 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8408f2c7-0e44-4b53-bf2d-310db8f30d45 service neutron] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:24:40.046650 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8408f2c7-0e44-4b53-bf2d-310db8f30d45 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:24:40.055382 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8408f2c7-0e44-4b53-bf2d-310db8f30d45 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:24:40.056780 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8408f2c7-0e44-4b53-bf2d-310db8f30d45 service neutron] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:24:40.066000 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1210/2431] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Oct 12 17:24:39 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 17:24:40.319114 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1041a9fb-8d04-4314-aef0-c0b9331d13ab None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:24:40.320974 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-1041a9fb-8d04-4314-aef0-c0b9331d13ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:24:40.335443 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1041a9fb-8d04-4314-aef0-c0b9331d13ab None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:24:40.340374 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9b0bd2-e3c3-4ef0-a81b-9d06e7e908ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:24:40.341225 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9b0bd2-e3c3-4ef0-a81b-9d06e7e908ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:24:40.341530 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9b0bd2-e3c3-4ef0-a81b-9d06e7e908ac admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:24:40.341802 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9b0bd2-e3c3-4ef0-a81b-9d06e7e908ac admin admin] PATH_INFO: `/v3/projects/c9fa7363084c4378b5943c78b382e36e` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:24:40.343138 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9b0bd2-e3c3-4ef0-a81b-9d06e7e908ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=c9fa7363084c4378b5943c78b382e36e)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:24:40.345010 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9b0bd2-e3c3-4ef0-a81b-9d06e7e908ac admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:24:40.390312 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-1b9b0bd2-e3c3-4ef0-a81b-9d06e7e908ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c9fa7363084c4378b5943c78b382e36e', 'request_id': 'req-1b9b0bd2-e3c3-4ef0-a81b-9d06e7e908ac'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:24:40.395917 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-1b9b0bd2-e3c3-4ef0-a81b-9d06e7e908ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c9fa7363084c4378b5943c78b382e36e', 'request_id': 'req-1b9b0bd2-e3c3-4ef0-a81b-9d06e7e908ac'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:24:40.402376 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-1b9b0bd2-e3c3-4ef0-a81b-9d06e7e908ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c9fa7363084c4378b5943c78b382e36e', 'request_id': 'req-1b9b0bd2-e3c3-4ef0-a81b-9d06e7e908ac'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:24:40.414152 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-1b9b0bd2-e3c3-4ef0-a81b-9d06e7e908ac admin admin] The token cache is being invalidate because project c9fa7363084c4378b5943c78b382e36e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=85204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 17:24:40.414445 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-1b9b0bd2-e3c3-4ef0-a81b-9d06e7e908ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:24:40.415081 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-1b9b0bd2-e3c3-4ef0-a81b-9d06e7e908ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:24:40.416700 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1222/2432] 10.222.0.58 () {58 vars in 1232 bytes} [Tue Oct 12 17:24:40 2021] DELETE /identity/v3/projects/c9fa7363084c4378b5943c78b382e36e => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 17:24:40.470238 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8408f2c7-0e44-4b53-bf2d-310db8f30d45 service neutron] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:24:40.471732 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-8408f2c7-0e44-4b53-bf2d-310db8f30d45 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:24:40.545681 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8408f2c7-0e44-4b53-bf2d-310db8f30d45 service neutron] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:24:40.594104 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1afebf-7916-48a1-b29e-11d04ea46bfb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04704222b3d64a33a6c092fc641ccbb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:24:40.594753 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1afebf-7916-48a1-b29e-11d04ea46bfb service cinder] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:24:40.595062 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1afebf-7916-48a1-b29e-11d04ea46bfb service cinder] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:24:40.595341 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1afebf-7916-48a1-b29e-11d04ea46bfb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:24:40.597123 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-ce1afebf-7916-48a1-b29e-11d04ea46bfb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:24:40.669073 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1afebf-7916-48a1-b29e-11d04ea46bfb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:24:40.670453 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1afebf-7916-48a1-b29e-11d04ea46bfb service cinder] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:24:40.681832 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1211/2433] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Oct 12 17:24:40 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 17:24:40.939961 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9b0bd2-e3c3-4ef0-a81b-9d06e7e908ac admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:24:40.941426 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-1b9b0bd2-e3c3-4ef0-a81b-9d06e7e908ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:24:40.995093 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9b0bd2-e3c3-4ef0-a81b-9d06e7e908ac admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:24:40.998661 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5887d365-3437-409c-b758-af7c35ab3ff6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e65f6d0598e4c539134292b86fb43d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:24:40.999296 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5887d365-3437-409c-b758-af7c35ab3ff6 service neutron] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:24:40.999577 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5887d365-3437-409c-b758-af7c35ab3ff6 service neutron] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:24:40.999851 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5887d365-3437-409c-b758-af7c35ab3ff6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:24:41.001555 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-5887d365-3437-409c-b758-af7c35ab3ff6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:24:41.010718 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5887d365-3437-409c-b758-af7c35ab3ff6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:24:41.012109 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5887d365-3437-409c-b758-af7c35ab3ff6 service neutron] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:24:41.019783 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1223/2434] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Oct 12 17:24:40 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 17:24:41.662136 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1afebf-7916-48a1-b29e-11d04ea46bfb service cinder] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:24:41.663648 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-ce1afebf-7916-48a1-b29e-11d04ea46bfb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:24:41.671067 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5887d365-3437-409c-b758-af7c35ab3ff6 service neutron] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:24:41.680501 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5887d365-3437-409c-b758-af7c35ab3ff6 service neutron] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:24:41.685365 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185a945e-0370-4c1f-83ea-ed17ac0046d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e65f6d0598e4c539134292b86fb43d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:24:41.686301 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185a945e-0370-4c1f-83ea-ed17ac0046d4 service neutron] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:24:41.686593 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185a945e-0370-4c1f-83ea-ed17ac0046d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:24:41.686871 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185a945e-0370-4c1f-83ea-ed17ac0046d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:24:41.688808 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-185a945e-0370-4c1f-83ea-ed17ac0046d4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:24:41.711797 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185a945e-0370-4c1f-83ea-ed17ac0046d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:24:41.713320 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185a945e-0370-4c1f-83ea-ed17ac0046d4 service neutron] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:24:41.724466 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1224/2435] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Oct 12 17:24:41 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 12 17:24:41.731339 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1afebf-7916-48a1-b29e-11d04ea46bfb service cinder] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:24:41.736389 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f841b71-b0bc-469b-9c1f-bdfa82a630a5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4102412c40bc4745bba8c31f1caf9788', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:24:41.737039 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f841b71-b0bc-469b-9c1f-bdfa82a630a5 service placement] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:24:41.737324 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f841b71-b0bc-469b-9c1f-bdfa82a630a5 service placement] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:24:41.737601 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f841b71-b0bc-469b-9c1f-bdfa82a630a5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:24:41.739927 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-9f841b71-b0bc-469b-9c1f-bdfa82a630a5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:24:41.752144 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f841b71-b0bc-469b-9c1f-bdfa82a630a5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:24:41.753713 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f841b71-b0bc-469b-9c1f-bdfa82a630a5 service placement] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:24:41.765961 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1212/2436] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Oct 12 17:24:41 2021] GET /identity/v3/auth/tokens => generated 3451 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 17:24:44.006303 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185a945e-0370-4c1f-83ea-ed17ac0046d4 service neutron] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:24:44.009680 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-185a945e-0370-4c1f-83ea-ed17ac0046d4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:24:44.032086 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185a945e-0370-4c1f-83ea-ed17ac0046d4 service neutron] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:24:44.041025 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbc909a-4324-4174-be2e-9562a135547a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29d30b574eec4ad3990d77d235c8b424', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:24:44.041990 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbc909a-4324-4174-be2e-9562a135547a service nova] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:24:44.042278 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbc909a-4324-4174-be2e-9562a135547a service nova] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:24:44.042554 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbc909a-4324-4174-be2e-9562a135547a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:24:44.044406 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-7cbc909a-4324-4174-be2e-9562a135547a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:24:44.058929 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbc909a-4324-4174-be2e-9562a135547a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:24:44.060700 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbc909a-4324-4174-be2e-9562a135547a service nova] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:24:44.073478 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1225/2437] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Oct 12 17:24:44 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 17:24:54.466281 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f841b71-b0bc-469b-9c1f-bdfa82a630a5 service placement] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:24:54.480173 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f841b71-b0bc-469b-9c1f-bdfa82a630a5 service placement] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:24:54.485589 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f14c7d-af50-4369-9b7a-9e01329be00e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29d30b574eec4ad3990d77d235c8b424', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:24:54.486271 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f14c7d-af50-4369-9b7a-9e01329be00e service nova] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:24:54.486554 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f14c7d-af50-4369-9b7a-9e01329be00e service nova] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:24:54.486827 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f14c7d-af50-4369-9b7a-9e01329be00e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:24:54.488582 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-a1f14c7d-af50-4369-9b7a-9e01329be00e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:24:54.501800 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f14c7d-af50-4369-9b7a-9e01329be00e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:24:54.503520 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f14c7d-af50-4369-9b7a-9e01329be00e service nova] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:24:54.515157 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1213/2438] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Oct 12 17:24:54 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 17:24:56.879278 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbc909a-4324-4174-be2e-9562a135547a service nova] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:24:56.889113 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbc909a-4324-4174-be2e-9562a135547a service nova] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:24:56.892639 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cb64d0-8464-4ec2-be48-2525c69ddefb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e65f6d0598e4c539134292b86fb43d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:24:56.893261 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cb64d0-8464-4ec2-be48-2525c69ddefb service neutron] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:24:56.893540 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cb64d0-8464-4ec2-be48-2525c69ddefb service neutron] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:24:56.893812 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cb64d0-8464-4ec2-be48-2525c69ddefb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:24:56.895562 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-33cb64d0-8464-4ec2-be48-2525c69ddefb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:24:56.953200 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cb64d0-8464-4ec2-be48-2525c69ddefb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:24:56.954626 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cb64d0-8464-4ec2-be48-2525c69ddefb service neutron] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:24:56.963706 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1226/2439] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Oct 12 17:24:56 2021] GET /identity/v3/auth/tokens => generated 3458 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 17:24:58.508294 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f14c7d-af50-4369-9b7a-9e01329be00e service nova] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:24:58.519923 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f14c7d-af50-4369-9b7a-9e01329be00e service nova] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:24:58.525755 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467837a4-b53f-45d6-8652-076631bc7b3e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29d30b574eec4ad3990d77d235c8b424', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:24:58.526446 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467837a4-b53f-45d6-8652-076631bc7b3e service nova] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:24:58.526736 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467837a4-b53f-45d6-8652-076631bc7b3e service nova] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:24:58.527014 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467837a4-b53f-45d6-8652-076631bc7b3e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:24:58.528813 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-467837a4-b53f-45d6-8652-076631bc7b3e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:24:58.541369 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467837a4-b53f-45d6-8652-076631bc7b3e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:24:58.542980 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467837a4-b53f-45d6-8652-076631bc7b3e service nova] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:24:58.554066 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1214/2440] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Oct 12 17:24:58 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 17:25:25.861899 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cb64d0-8464-4ec2-be48-2525c69ddefb service neutron] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:25:25.871063 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cb64d0-8464-4ec2-be48-2525c69ddefb service neutron] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:25:25.874762 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53166b36-5b81-402f-abe7-f77ef4dad483 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e65f6d0598e4c539134292b86fb43d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:25:25.875397 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53166b36-5b81-402f-abe7-f77ef4dad483 service neutron] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:25:25.875677 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53166b36-5b81-402f-abe7-f77ef4dad483 service neutron] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:25:25.875952 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53166b36-5b81-402f-abe7-f77ef4dad483 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:25:25.877723 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-53166b36-5b81-402f-abe7-f77ef4dad483 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:25:25.938184 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53166b36-5b81-402f-abe7-f77ef4dad483 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:25:25.939610 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53166b36-5b81-402f-abe7-f77ef4dad483 service neutron] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:25:25.949737 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1227/2441] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Oct 12 17:25:25 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 17:25:26.432819 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467837a4-b53f-45d6-8652-076631bc7b3e service nova] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:25:26.434302 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-467837a4-b53f-45d6-8652-076631bc7b3e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:25:26.448027 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467837a4-b53f-45d6-8652-076631bc7b3e service nova] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:25:26.452641 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed0071f-4994-4839-a437-2edc55ec022e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:25:26.453495 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed0071f-4994-4839-a437-2edc55ec022e admin admin] REQUEST_METHOD: `DELETE` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:25:26.453778 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed0071f-4994-4839-a437-2edc55ec022e admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:25:26.454084 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed0071f-4994-4839-a437-2edc55ec022e admin admin] PATH_INFO: `/v3/users/fac2e7e3088b4863b65bd9310b878229` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:25:26.455269 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed0071f-4994-4839-a437-2edc55ec022e admin admin] RBAC: Authorizing `identity:delete_user(user_id=fac2e7e3088b4863b65bd9310b878229)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:25:26.457187 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed0071f-4994-4839-a437-2edc55ec022e admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:25:26.500465 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-8ed0071f-4994-4839-a437-2edc55ec022e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fac2e7e3088b4863b65bd9310b878229'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:25:26.513620 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-8ed0071f-4994-4839-a437-2edc55ec022e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fac2e7e3088b4863b65bd9310b878229'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:25:26.520629 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-8ed0071f-4994-4839-a437-2edc55ec022e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fac2e7e3088b4863b65bd9310b878229'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:25:26.527447 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-8ed0071f-4994-4839-a437-2edc55ec022e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fac2e7e3088b4863b65bd9310b878229'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:25:26.528088 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-8ed0071f-4994-4839-a437-2edc55ec022e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fac2e7e3088b4863b65bd9310b878229'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:25:26.533939 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1215/2442] 10.222.0.58 () {58 vars in 1223 bytes} [Tue Oct 12 17:25:26 2021] DELETE /identity/v3/users/fac2e7e3088b4863b65bd9310b878229 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 17:25:26.701090 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53166b36-5b81-402f-abe7-f77ef4dad483 service neutron] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:25:26.711428 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53166b36-5b81-402f-abe7-f77ef4dad483 service neutron] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:25:26.767018 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79c1edc-4a9c-4aaa-bee8-b9933802e774 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:25:26.767865 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79c1edc-4a9c-4aaa-bee8-b9933802e774 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:25:26.768141 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79c1edc-4a9c-4aaa-bee8-b9933802e774 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:25:26.768411 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79c1edc-4a9c-4aaa-bee8-b9933802e774 admin admin] PATH_INFO: `/v3/projects/21ab55c3bf90442dba24cbfc0d6e5fc1` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:25:26.769579 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79c1edc-4a9c-4aaa-bee8-b9933802e774 admin admin] RBAC: Authorizing `identity:delete_project(project_id=21ab55c3bf90442dba24cbfc0d6e5fc1)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:25:26.771469 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79c1edc-4a9c-4aaa-bee8-b9933802e774 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:25:26.815381 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-d79c1edc-4a9c-4aaa-bee8-b9933802e774 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '21ab55c3bf90442dba24cbfc0d6e5fc1', 'request_id': 'req-d79c1edc-4a9c-4aaa-bee8-b9933802e774'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:25:26.820582 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-d79c1edc-4a9c-4aaa-bee8-b9933802e774 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '21ab55c3bf90442dba24cbfc0d6e5fc1', 'request_id': 'req-d79c1edc-4a9c-4aaa-bee8-b9933802e774'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:25:26.826588 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-d79c1edc-4a9c-4aaa-bee8-b9933802e774 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '21ab55c3bf90442dba24cbfc0d6e5fc1', 'request_id': 'req-d79c1edc-4a9c-4aaa-bee8-b9933802e774'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:25:26.838702 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-d79c1edc-4a9c-4aaa-bee8-b9933802e774 admin admin] The token cache is being invalidate because project 21ab55c3bf90442dba24cbfc0d6e5fc1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=85204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 17:25:26.838989 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-d79c1edc-4a9c-4aaa-bee8-b9933802e774 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:25:26.839613 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-d79c1edc-4a9c-4aaa-bee8-b9933802e774 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:25:26.841122 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1228/2443] 10.222.0.58 () {58 vars in 1232 bytes} [Tue Oct 12 17:25:26 2021] DELETE /identity/v3/projects/21ab55c3bf90442dba24cbfc0d6e5fc1 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 17:25:26.847550 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538fac0f-a735-4846-8a46-706c86dc11ad None None] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:25:26.847852 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538fac0f-a735-4846-8a46-706c86dc11ad None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:25:26.848128 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538fac0f-a735-4846-8a46-706c86dc11ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:25:26.866084 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.auth.core [None req-538fac0f-a735-4846-8a46-706c86dc11ad None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 17:25:26.867292 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-538fac0f-a735-4846-8a46-706c86dc11ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:25:26.923413 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1216/2444] 10.222.0.58 () {58 vars in 957 bytes} [Tue Oct 12 17:25:26 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 17:25:26.931245 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cce87d-413b-4c2a-b31e-695233200e4c None None] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:25:26.931717 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cce87d-413b-4c2a-b31e-695233200e4c None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:25:26.931819 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cce87d-413b-4c2a-b31e-695233200e4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:25:26.949187 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.auth.core [None req-17cce87d-413b-4c2a-b31e-695233200e4c None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 17:25:26.950481 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-17cce87d-413b-4c2a-b31e-695233200e4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:25:26.958185 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1229/2445] 10.222.0.58 () {58 vars in 957 bytes} [Tue Oct 12 17:25:26 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 17:25:26.962677 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538fac0f-a735-4846-8a46-706c86dc11ad None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:25:26.972046 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538fac0f-a735-4846-8a46-706c86dc11ad None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:25:26.977326 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9040c5b2-0cac-4b6a-a20b-be1159189deb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:25:26.978011 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9040c5b2-0cac-4b6a-a20b-be1159189deb admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:25:26.978299 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9040c5b2-0cac-4b6a-a20b-be1159189deb admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:25:26.978577 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9040c5b2-0cac-4b6a-a20b-be1159189deb admin admin] PATH_INFO: `/v3/domains` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:25:26.979304 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9040c5b2-0cac-4b6a-a20b-be1159189deb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 17:25:26.979622 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9040c5b2-0cac-4b6a-a20b-be1159189deb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:25:26.981207 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9040c5b2-0cac-4b6a-a20b-be1159189deb admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:25:26.992256 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1217/2446] 10.222.0.58 () {58 vars in 1152 bytes} [Tue Oct 12 17:25:26 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 17:25:26.996475 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cce87d-413b-4c2a-b31e-695233200e4c None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:25:27.005235 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cce87d-413b-4c2a-b31e-695233200e4c None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:25:27.010606 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e5a20a-e32e-43fb-8919-0931601dabb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:25:27.011237 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e5a20a-e32e-43fb-8919-0931601dabb7 admin admin] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:25:27.011516 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e5a20a-e32e-43fb-8919-0931601dabb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:25:27.011786 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e5a20a-e32e-43fb-8919-0931601dabb7 admin admin] PATH_INFO: `/v3/projects` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:25:27.012504 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e5a20a-e32e-43fb-8919-0931601dabb7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:25:27.014383 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e5a20a-e32e-43fb-8919-0931601dabb7 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:25:27.038451 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1230/2447] 10.222.0.58 () {60 vars in 1152 bytes} [Tue Oct 12 17:25:26 2021] POST /identity/v3/projects => generated 405 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 17:25:27.042549 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9040c5b2-0cac-4b6a-a20b-be1159189deb admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:25:27.052472 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9040c5b2-0cac-4b6a-a20b-be1159189deb admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:25:27.108527 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04005187-7ace-4962-b3de-32ec870b30d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:25:27.109513 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04005187-7ace-4962-b3de-32ec870b30d9 admin admin] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:25:27.110047 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04005187-7ace-4962-b3de-32ec870b30d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:25:27.110538 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04005187-7ace-4962-b3de-32ec870b30d9 admin admin] PATH_INFO: `/v3/users` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:25:27.111850 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04005187-7ace-4962-b3de-32ec870b30d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:25:27.115561 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04005187-7ace-4962-b3de-32ec870b30d9 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:25:27.139313 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1218/2448] 10.222.0.58 () {60 vars in 1143 bytes} [Tue Oct 12 17:25:27 2021] POST /identity/v3/users => generated 303 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 17:25:27.143423 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e5a20a-e32e-43fb-8919-0931601dabb7 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:25:27.154638 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e5a20a-e32e-43fb-8919-0931601dabb7 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:25:27.159477 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2879e8-e6a1-4e26-8bf2-231c0d330830 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:25:27.160133 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2879e8-e6a1-4e26-8bf2-231c0d330830 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:25:27.160409 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2879e8-e6a1-4e26-8bf2-231c0d330830 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:25:27.160678 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2879e8-e6a1-4e26-8bf2-231c0d330830 admin admin] PATH_INFO: `/v3/roles` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:25:27.161406 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2879e8-e6a1-4e26-8bf2-231c0d330830 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:25:27.162998 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2879e8-e6a1-4e26-8bf2-231c0d330830 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:25:27.175165 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1231/2449] 10.222.0.58 () {58 vars in 1121 bytes} [Tue Oct 12 17:25:27 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 17:25:27.179118 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04005187-7ace-4962-b3de-32ec870b30d9 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:25:27.188789 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04005187-7ace-4962-b3de-32ec870b30d9 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:25:27.193373 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c23681a-d7d3-4d21-9f72-1c5cb5540909 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:25:27.194070 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c23681a-d7d3-4d21-9f72-1c5cb5540909 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:25:27.194352 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c23681a-d7d3-4d21-9f72-1c5cb5540909 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:25:27.194625 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c23681a-d7d3-4d21-9f72-1c5cb5540909 admin admin] PATH_INFO: `/v3/roles` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:25:27.195899 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c23681a-d7d3-4d21-9f72-1c5cb5540909 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:25:27.197551 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c23681a-d7d3-4d21-9f72-1c5cb5540909 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:25:27.206989 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1219/2450] 10.222.0.58 () {58 vars in 1121 bytes} [Tue Oct 12 17:25:27 2021] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 17:25:27.211423 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2879e8-e6a1-4e26-8bf2-231c0d330830 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:25:27.221030 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2879e8-e6a1-4e26-8bf2-231c0d330830 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:25:27.225684 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da30f8a-b0cc-4051-9290-2bb7f3d48d66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:25:27.226590 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da30f8a-b0cc-4051-9290-2bb7f3d48d66 admin admin] REQUEST_METHOD: `PUT` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:25:27.226870 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da30f8a-b0cc-4051-9290-2bb7f3d48d66 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:25:27.227145 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da30f8a-b0cc-4051-9290-2bb7f3d48d66 admin admin] PATH_INFO: `/v3/projects/aa856fb93ef84d3abcf17249f0be09a5/users/2249a41c60fd42f28676fc1b4806982b/roles/55ba49fe29884e64b57c3ad13188d554` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:25:27.240979 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da30f8a-b0cc-4051-9290-2bb7f3d48d66 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa856fb93ef84d3abcf17249f0be09a5, user_id=2249a41c60fd42f28676fc1b4806982b, role_id=55ba49fe29884e64b57c3ad13188d554)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:25:27.243623 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da30f8a-b0cc-4051-9290-2bb7f3d48d66 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:25:27.256251 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1232/2451] 10.222.0.58 () {60 vars in 1482 bytes} [Tue Oct 12 17:25:27 2021] PUT /identity/v3/projects/aa856fb93ef84d3abcf17249f0be09a5/users/2249a41c60fd42f28676fc1b4806982b/roles/55ba49fe29884e64b57c3ad13188d554 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 17:25:27.267349 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7152e5-60a4-426c-996d-802aceb72c26 None None] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:25:27.267640 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7152e5-60a4-426c-996d-802aceb72c26 None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:25:27.267918 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7152e5-60a4-426c-996d-802aceb72c26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:25:27.293607 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.auth.core [None req-ce7152e5-60a4-426c-996d-802aceb72c26 None None] MFA Rules not processed for user `2249a41c60fd42f28676fc1b4806982b`. Rule list: `[]` (Enabled: `True`). {{(pid=85205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 17:25:27.294855 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-ce7152e5-60a4-426c-996d-802aceb72c26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:25:27.354883 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1220/2452] 10.222.0.58 () {58 vars in 957 bytes} [Tue Oct 12 17:25:27 2021] POST /identity/v3/auth/tokens => generated 3425 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 17:25:27.359324 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da30f8a-b0cc-4051-9290-2bb7f3d48d66 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:25:27.421312 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da30f8a-b0cc-4051-9290-2bb7f3d48d66 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:25:27.425950 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1e9018-b1e0-4323-b84f-3843ac286104 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:25:27.426603 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1e9018-b1e0-4323-b84f-3843ac286104 admin admin] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:25:27.426885 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1e9018-b1e0-4323-b84f-3843ac286104 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:25:27.427162 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1e9018-b1e0-4323-b84f-3843ac286104 admin admin] PATH_INFO: `/v3/projects` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:25:27.427865 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1e9018-b1e0-4323-b84f-3843ac286104 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:25:27.430290 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1e9018-b1e0-4323-b84f-3843ac286104 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:25:27.455230 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1233/2453] 10.222.0.58 () {60 vars in 1152 bytes} [Tue Oct 12 17:25:27 2021] POST /identity/v3/projects => generated 403 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 17:25:27.459153 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7152e5-60a4-426c-996d-802aceb72c26 None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:25:27.469562 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7152e5-60a4-426c-996d-802aceb72c26 None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:25:27.522259 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711f26e9-c280-4418-a084-7618f4e81602 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:25:27.522924 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711f26e9-c280-4418-a084-7618f4e81602 admin admin] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:25:27.523718 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711f26e9-c280-4418-a084-7618f4e81602 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:25:27.523995 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711f26e9-c280-4418-a084-7618f4e81602 admin admin] PATH_INFO: `/v3/users` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:25:27.524684 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711f26e9-c280-4418-a084-7618f4e81602 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:25:27.526602 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711f26e9-c280-4418-a084-7618f4e81602 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:25:27.545788 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1221/2454] 10.222.0.58 () {60 vars in 1143 bytes} [Tue Oct 12 17:25:27 2021] POST /identity/v3/users => generated 308 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 17:25:27.549829 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1e9018-b1e0-4323-b84f-3843ac286104 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:25:27.560073 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1e9018-b1e0-4323-b84f-3843ac286104 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:25:27.564701 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c183551-c608-4b8a-80f3-cce54f9c576c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:25:27.565356 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c183551-c608-4b8a-80f3-cce54f9c576c admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:25:27.565636 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c183551-c608-4b8a-80f3-cce54f9c576c admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:25:27.566013 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c183551-c608-4b8a-80f3-cce54f9c576c admin admin] PATH_INFO: `/v3/roles` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:25:27.566748 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c183551-c608-4b8a-80f3-cce54f9c576c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:25:27.568317 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c183551-c608-4b8a-80f3-cce54f9c576c admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:25:27.578476 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1234/2455] 10.222.0.58 () {58 vars in 1121 bytes} [Tue Oct 12 17:25:27 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 17:25:27.582332 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711f26e9-c280-4418-a084-7618f4e81602 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:25:27.592401 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711f26e9-c280-4418-a084-7618f4e81602 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:25:27.597004 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ca46e1-9e50-47b0-9f08-7ce95bce9288 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:25:27.597865 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ca46e1-9e50-47b0-9f08-7ce95bce9288 admin admin] REQUEST_METHOD: `PUT` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:25:27.598173 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ca46e1-9e50-47b0-9f08-7ce95bce9288 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:25:27.598448 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ca46e1-9e50-47b0-9f08-7ce95bce9288 admin admin] PATH_INFO: `/v3/projects/2fb461b51d2042708632c6a8cbb5c691/users/6fbeaf72facb44c89f1330817bbbe6e1/roles/610824e4f50f4fb8954610e98c1de784` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:25:27.614213 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ca46e1-9e50-47b0-9f08-7ce95bce9288 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2fb461b51d2042708632c6a8cbb5c691, user_id=6fbeaf72facb44c89f1330817bbbe6e1, role_id=610824e4f50f4fb8954610e98c1de784)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:25:27.616761 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ca46e1-9e50-47b0-9f08-7ce95bce9288 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:25:27.629012 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1222/2456] 10.222.0.58 () {60 vars in 1482 bytes} [Tue Oct 12 17:25:27 2021] PUT /identity/v3/projects/2fb461b51d2042708632c6a8cbb5c691/users/6fbeaf72facb44c89f1330817bbbe6e1/roles/610824e4f50f4fb8954610e98c1de784 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 17:25:27.635570 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c183551-c608-4b8a-80f3-cce54f9c576c admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:25:27.645444 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c183551-c608-4b8a-80f3-cce54f9c576c admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:25:27.699851 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7926040a-40fb-4b89-bac7-32c2a065ff45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:25:27.700214 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7926040a-40fb-4b89-bac7-32c2a065ff45 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:25:27.700214 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7926040a-40fb-4b89-bac7-32c2a065ff45 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:25:27.700476 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7926040a-40fb-4b89-bac7-32c2a065ff45 admin admin] PATH_INFO: `/v3/roles` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:25:27.701147 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7926040a-40fb-4b89-bac7-32c2a065ff45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:25:27.702764 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7926040a-40fb-4b89-bac7-32c2a065ff45 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:25:27.713363 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1235/2457] 10.222.0.58 () {58 vars in 1121 bytes} [Tue Oct 12 17:25:27 2021] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 17:25:27.717485 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ca46e1-9e50-47b0-9f08-7ce95bce9288 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:25:27.727963 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ca46e1-9e50-47b0-9f08-7ce95bce9288 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:25:27.732655 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b85856-cb8b-4c0f-bb99-9ac57624d101 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:25:27.733532 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b85856-cb8b-4c0f-bb99-9ac57624d101 admin admin] REQUEST_METHOD: `PUT` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:25:27.733814 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b85856-cb8b-4c0f-bb99-9ac57624d101 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:25:27.734138 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b85856-cb8b-4c0f-bb99-9ac57624d101 admin admin] PATH_INFO: `/v3/projects/2fb461b51d2042708632c6a8cbb5c691/users/6fbeaf72facb44c89f1330817bbbe6e1/roles/610824e4f50f4fb8954610e98c1de784` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:25:27.736124 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b85856-cb8b-4c0f-bb99-9ac57624d101 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2fb461b51d2042708632c6a8cbb5c691, user_id=6fbeaf72facb44c89f1330817bbbe6e1, role_id=610824e4f50f4fb8954610e98c1de784)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:25:27.738728 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b85856-cb8b-4c0f-bb99-9ac57624d101 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:25:27.749145 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1223/2458] 10.222.0.58 () {60 vars in 1482 bytes} [Tue Oct 12 17:25:27 2021] PUT /identity/v3/projects/2fb461b51d2042708632c6a8cbb5c691/users/6fbeaf72facb44c89f1330817bbbe6e1/roles/610824e4f50f4fb8954610e98c1de784 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 17:25:27.759874 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6320d85f-ddca-4f66-bb78-2d1a55cd702b None None] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:25:27.760201 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6320d85f-ddca-4f66-bb78-2d1a55cd702b None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:25:27.760468 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6320d85f-ddca-4f66-bb78-2d1a55cd702b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:25:27.786108 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.auth.core [None req-6320d85f-ddca-4f66-bb78-2d1a55cd702b None None] MFA Rules not processed for user `6fbeaf72facb44c89f1330817bbbe6e1`. Rule list: `[]` (Enabled: `True`). {{(pid=85204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 17:25:27.787305 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-6320d85f-ddca-4f66-bb78-2d1a55cd702b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:25:27.852464 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1236/2459] 10.222.0.58 () {58 vars in 957 bytes} [Tue Oct 12 17:25:27 2021] POST /identity/v3/auth/tokens => generated 3490 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 17:25:27.862394 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b85856-cb8b-4c0f-bb99-9ac57624d101 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:25:27.864095 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-d9b85856-cb8b-4c0f-bb99-9ac57624d101 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:25:27.918001 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b85856-cb8b-4c0f-bb99-9ac57624d101 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:25:27.921565 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2212d2a2-2c1f-4694-8649-cc0409e38d23 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04704222b3d64a33a6c092fc641ccbb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:25:27.922230 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2212d2a2-2c1f-4694-8649-cc0409e38d23 service cinder] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:25:27.922518 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2212d2a2-2c1f-4694-8649-cc0409e38d23 service cinder] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:25:27.922794 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2212d2a2-2c1f-4694-8649-cc0409e38d23 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:25:27.931429 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2212d2a2-2c1f-4694-8649-cc0409e38d23 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:25:27.932833 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2212d2a2-2c1f-4694-8649-cc0409e38d23 service cinder] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:25:27.941933 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1224/2460] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Oct 12 17:25:27 2021] GET /identity/v3/auth/tokens => generated 3490 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 17:25:28.079834 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6320d85f-ddca-4f66-bb78-2d1a55cd702b None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:25:28.139242 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6320d85f-ddca-4f66-bb78-2d1a55cd702b None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:25:28.143710 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b90589-b6bb-4bcd-bd5d-d0d28f221084 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:25:28.144559 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b90589-b6bb-4bcd-bd5d-d0d28f221084 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:25:28.144843 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b90589-b6bb-4bcd-bd5d-d0d28f221084 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:25:28.145116 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b90589-b6bb-4bcd-bd5d-d0d28f221084 admin admin] PATH_INFO: `/v3/users/2249a41c60fd42f28676fc1b4806982b` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:25:28.146322 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b90589-b6bb-4bcd-bd5d-d0d28f221084 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2249a41c60fd42f28676fc1b4806982b)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:25:28.148234 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b90589-b6bb-4bcd-bd5d-d0d28f221084 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:25:28.192172 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-67b90589-b6bb-4bcd-bd5d-d0d28f221084 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2249a41c60fd42f28676fc1b4806982b'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:25:28.203952 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-67b90589-b6bb-4bcd-bd5d-d0d28f221084 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2249a41c60fd42f28676fc1b4806982b'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:25:28.210458 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-67b90589-b6bb-4bcd-bd5d-d0d28f221084 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2249a41c60fd42f28676fc1b4806982b'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:25:28.217997 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-67b90589-b6bb-4bcd-bd5d-d0d28f221084 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2249a41c60fd42f28676fc1b4806982b'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:25:28.218665 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-67b90589-b6bb-4bcd-bd5d-d0d28f221084 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2249a41c60fd42f28676fc1b4806982b'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:25:28.224317 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1237/2461] 10.222.0.58 () {58 vars in 1223 bytes} [Tue Oct 12 17:25:28 2021] DELETE /identity/v3/users/2249a41c60fd42f28676fc1b4806982b => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 17:25:28.228895 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b949bbd-317e-4a2c-b8c6-c1218d77292e None None] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:25:28.229187 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b949bbd-317e-4a2c-b8c6-c1218d77292e None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:25:28.229466 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b949bbd-317e-4a2c-b8c6-c1218d77292e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:25:28.246326 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.auth.core [None req-5b949bbd-317e-4a2c-b8c6-c1218d77292e None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 17:25:28.247519 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-5b949bbd-317e-4a2c-b8c6-c1218d77292e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:25:28.302254 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1225/2462] 10.222.0.58 () {58 vars in 957 bytes} [Tue Oct 12 17:25:28 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 17:25:28.312697 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b90589-b6bb-4bcd-bd5d-d0d28f221084 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:25:28.314087 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-67b90589-b6bb-4bcd-bd5d-d0d28f221084 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:25:28.368523 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b90589-b6bb-4bcd-bd5d-d0d28f221084 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:25:28.372216 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbf33d9-8ef1-4b1c-a4e8-e97c9e7e6e37 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e65f6d0598e4c539134292b86fb43d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:25:28.372851 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbf33d9-8ef1-4b1c-a4e8-e97c9e7e6e37 service neutron] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:25:28.373130 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbf33d9-8ef1-4b1c-a4e8-e97c9e7e6e37 service neutron] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:25:28.373403 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbf33d9-8ef1-4b1c-a4e8-e97c9e7e6e37 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:25:28.382433 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbf33d9-8ef1-4b1c-a4e8-e97c9e7e6e37 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:25:28.384383 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbf33d9-8ef1-4b1c-a4e8-e97c9e7e6e37 service neutron] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:25:28.393734 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1238/2463] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Oct 12 17:25:28 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 17:25:28.649560 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b949bbd-317e-4a2c-b8c6-c1218d77292e None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:25:28.651045 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-5b949bbd-317e-4a2c-b8c6-c1218d77292e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:25:28.664993 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b949bbd-317e-4a2c-b8c6-c1218d77292e None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:25:28.672181 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffd2f15-cc96-4d94-8126-08f79006b1c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:25:28.673334 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffd2f15-cc96-4d94-8126-08f79006b1c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:25:28.673789 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffd2f15-cc96-4d94-8126-08f79006b1c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:25:28.673993 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffd2f15-cc96-4d94-8126-08f79006b1c2 admin admin] PATH_INFO: `/v3/projects/aa856fb93ef84d3abcf17249f0be09a5` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:25:28.675210 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffd2f15-cc96-4d94-8126-08f79006b1c2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aa856fb93ef84d3abcf17249f0be09a5)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:25:28.677097 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffd2f15-cc96-4d94-8126-08f79006b1c2 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:25:28.721208 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-6ffd2f15-cc96-4d94-8126-08f79006b1c2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa856fb93ef84d3abcf17249f0be09a5', 'request_id': 'req-6ffd2f15-cc96-4d94-8126-08f79006b1c2'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:25:28.726903 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-6ffd2f15-cc96-4d94-8126-08f79006b1c2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa856fb93ef84d3abcf17249f0be09a5', 'request_id': 'req-6ffd2f15-cc96-4d94-8126-08f79006b1c2'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:25:28.732716 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-6ffd2f15-cc96-4d94-8126-08f79006b1c2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa856fb93ef84d3abcf17249f0be09a5', 'request_id': 'req-6ffd2f15-cc96-4d94-8126-08f79006b1c2'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:25:28.749589 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-6ffd2f15-cc96-4d94-8126-08f79006b1c2 admin admin] The token cache is being invalidate because project aa856fb93ef84d3abcf17249f0be09a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=85205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 17:25:28.749900 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-6ffd2f15-cc96-4d94-8126-08f79006b1c2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:25:28.750656 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-6ffd2f15-cc96-4d94-8126-08f79006b1c2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:25:28.752154 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1226/2464] 10.222.0.58 () {58 vars in 1232 bytes} [Tue Oct 12 17:25:28 2021] DELETE /identity/v3/projects/aa856fb93ef84d3abcf17249f0be09a5 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 17:25:28.756069 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbf33d9-8ef1-4b1c-a4e8-e97c9e7e6e37 service neutron] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:25:28.765660 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbf33d9-8ef1-4b1c-a4e8-e97c9e7e6e37 service neutron] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:25:28.819097 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32e915a-a33f-475d-81c0-8d08e9a5c6f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:25:28.819958 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32e915a-a33f-475d-81c0-8d08e9a5c6f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:25:28.820269 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32e915a-a33f-475d-81c0-8d08e9a5c6f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:25:28.820542 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32e915a-a33f-475d-81c0-8d08e9a5c6f4 admin admin] PATH_INFO: `/v3/users/6fbeaf72facb44c89f1330817bbbe6e1` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:25:28.821713 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32e915a-a33f-475d-81c0-8d08e9a5c6f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6fbeaf72facb44c89f1330817bbbe6e1)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:25:28.823621 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32e915a-a33f-475d-81c0-8d08e9a5c6f4 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:25:28.869536 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-f32e915a-a33f-475d-81c0-8d08e9a5c6f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6fbeaf72facb44c89f1330817bbbe6e1'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:25:28.880864 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-f32e915a-a33f-475d-81c0-8d08e9a5c6f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6fbeaf72facb44c89f1330817bbbe6e1'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:25:28.887689 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-f32e915a-a33f-475d-81c0-8d08e9a5c6f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6fbeaf72facb44c89f1330817bbbe6e1'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:25:28.894470 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-f32e915a-a33f-475d-81c0-8d08e9a5c6f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6fbeaf72facb44c89f1330817bbbe6e1'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:25:28.895086 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-f32e915a-a33f-475d-81c0-8d08e9a5c6f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6fbeaf72facb44c89f1330817bbbe6e1'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:25:28.901276 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1239/2465] 10.222.0.58 () {58 vars in 1223 bytes} [Tue Oct 12 17:25:28 2021] DELETE /identity/v3/users/6fbeaf72facb44c89f1330817bbbe6e1 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 17:25:29.163776 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffd2f15-cc96-4d94-8126-08f79006b1c2 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:25:29.165820 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-6ffd2f15-cc96-4d94-8126-08f79006b1c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:25:29.178706 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffd2f15-cc96-4d94-8126-08f79006b1c2 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:25:29.234119 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad659fea-2cdd-43d4-9caf-d90c742fd633 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:25:29.234965 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad659fea-2cdd-43d4-9caf-d90c742fd633 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:25:29.235244 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad659fea-2cdd-43d4-9caf-d90c742fd633 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:25:29.235513 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad659fea-2cdd-43d4-9caf-d90c742fd633 admin admin] PATH_INFO: `/v3/projects/2fb461b51d2042708632c6a8cbb5c691` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:25:29.236672 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad659fea-2cdd-43d4-9caf-d90c742fd633 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2fb461b51d2042708632c6a8cbb5c691)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:25:29.238586 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad659fea-2cdd-43d4-9caf-d90c742fd633 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:25:29.281923 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-ad659fea-2cdd-43d4-9caf-d90c742fd633 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2fb461b51d2042708632c6a8cbb5c691', 'request_id': 'req-ad659fea-2cdd-43d4-9caf-d90c742fd633'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:25:29.287039 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-ad659fea-2cdd-43d4-9caf-d90c742fd633 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2fb461b51d2042708632c6a8cbb5c691', 'request_id': 'req-ad659fea-2cdd-43d4-9caf-d90c742fd633'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:25:29.292782 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-ad659fea-2cdd-43d4-9caf-d90c742fd633 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2fb461b51d2042708632c6a8cbb5c691', 'request_id': 'req-ad659fea-2cdd-43d4-9caf-d90c742fd633'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:25:29.304835 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-ad659fea-2cdd-43d4-9caf-d90c742fd633 admin admin] The token cache is being invalidate because project 2fb461b51d2042708632c6a8cbb5c691 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=85205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 17:25:29.305168 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-ad659fea-2cdd-43d4-9caf-d90c742fd633 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:25:29.305957 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-ad659fea-2cdd-43d4-9caf-d90c742fd633 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:25:29.307503 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1227/2466] 10.222.0.58 () {58 vars in 1232 bytes} [Tue Oct 12 17:25:29 2021] DELETE /identity/v3/projects/2fb461b51d2042708632c6a8cbb5c691 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 17:25:29.313089 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd09919-038b-4a76-a5ce-5e2abfcf9bb5 None None] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:25:29.313563 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd09919-038b-4a76-a5ce-5e2abfcf9bb5 None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:25:29.313672 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd09919-038b-4a76-a5ce-5e2abfcf9bb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:25:29.330958 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.auth.core [None req-bdd09919-038b-4a76-a5ce-5e2abfcf9bb5 None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 17:25:29.332135 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-bdd09919-038b-4a76-a5ce-5e2abfcf9bb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:25:29.388279 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1240/2467] 10.222.0.58 () {58 vars in 957 bytes} [Tue Oct 12 17:25:29 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 17:25:29.396083 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e32672-9a23-4e4c-a479-c591212e8615 None None] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:25:29.396373 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e32672-9a23-4e4c-a479-c591212e8615 None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:25:29.396658 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e32672-9a23-4e4c-a479-c591212e8615 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:25:29.415019 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.auth.core [None req-43e32672-9a23-4e4c-a479-c591212e8615 None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 17:25:29.416278 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-43e32672-9a23-4e4c-a479-c591212e8615 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:25:29.424172 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1228/2468] 10.222.0.58 () {58 vars in 957 bytes} [Tue Oct 12 17:25:29 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 17:25:29.428112 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd09919-038b-4a76-a5ce-5e2abfcf9bb5 None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:25:29.437950 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd09919-038b-4a76-a5ce-5e2abfcf9bb5 None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:25:29.442556 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e115b205-a345-4112-89ff-229d3361bbcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:25:29.443292 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e115b205-a345-4112-89ff-229d3361bbcd admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:25:29.443636 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e115b205-a345-4112-89ff-229d3361bbcd admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:25:29.443982 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e115b205-a345-4112-89ff-229d3361bbcd admin admin] PATH_INFO: `/v3/domains` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:25:29.444777 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e115b205-a345-4112-89ff-229d3361bbcd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 17:25:29.445757 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e115b205-a345-4112-89ff-229d3361bbcd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:25:29.447413 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e115b205-a345-4112-89ff-229d3361bbcd admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:25:29.458904 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1241/2469] 10.222.0.58 () {58 vars in 1152 bytes} [Tue Oct 12 17:25:29 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 17:25:29.463744 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e32672-9a23-4e4c-a479-c591212e8615 None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:25:29.472826 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e32672-9a23-4e4c-a479-c591212e8615 None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:25:29.477432 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78201231-1b01-4c11-ad27-eeebd176e361 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:25:29.478101 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78201231-1b01-4c11-ad27-eeebd176e361 admin admin] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:25:29.478384 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78201231-1b01-4c11-ad27-eeebd176e361 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:25:29.478655 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78201231-1b01-4c11-ad27-eeebd176e361 admin admin] PATH_INFO: `/v3/projects` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:25:29.479359 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78201231-1b01-4c11-ad27-eeebd176e361 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:25:29.481202 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78201231-1b01-4c11-ad27-eeebd176e361 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:25:29.505185 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1229/2470] 10.222.0.58 () {60 vars in 1152 bytes} [Tue Oct 12 17:25:29 2021] POST /identity/v3/projects => generated 363 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 17:25:29.510446 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e115b205-a345-4112-89ff-229d3361bbcd admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:25:29.520025 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e115b205-a345-4112-89ff-229d3361bbcd admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:25:29.574090 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5237b6-a8b1-4739-9f0c-e88e3953aeff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:25:29.574684 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5237b6-a8b1-4739-9f0c-e88e3953aeff admin admin] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:25:29.574971 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5237b6-a8b1-4739-9f0c-e88e3953aeff admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:25:29.575248 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5237b6-a8b1-4739-9f0c-e88e3953aeff admin admin] PATH_INFO: `/v3/users` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:25:29.575960 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5237b6-a8b1-4739-9f0c-e88e3953aeff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:25:29.577851 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5237b6-a8b1-4739-9f0c-e88e3953aeff admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:25:29.596876 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1242/2471] 10.222.0.58 () {60 vars in 1143 bytes} [Tue Oct 12 17:25:29 2021] POST /identity/v3/users => generated 282 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 17:25:29.600923 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78201231-1b01-4c11-ad27-eeebd176e361 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:25:29.611067 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78201231-1b01-4c11-ad27-eeebd176e361 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:25:29.615664 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f46eb3e-0c2a-4fc0-8f66-f14efc04b8e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:25:29.616340 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f46eb3e-0c2a-4fc0-8f66-f14efc04b8e8 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:25:29.616625 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f46eb3e-0c2a-4fc0-8f66-f14efc04b8e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:25:29.617435 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f46eb3e-0c2a-4fc0-8f66-f14efc04b8e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:25:29.618232 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f46eb3e-0c2a-4fc0-8f66-f14efc04b8e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:25:29.619808 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f46eb3e-0c2a-4fc0-8f66-f14efc04b8e8 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:25:29.629862 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1230/2472] 10.222.0.58 () {58 vars in 1121 bytes} [Tue Oct 12 17:25:29 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 17:25:29.634481 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5237b6-a8b1-4739-9f0c-e88e3953aeff admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:25:29.644044 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5237b6-a8b1-4739-9f0c-e88e3953aeff admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:25:29.648683 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21c4178-7f61-40fc-a0a3-f6c884a81076 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:25:29.649325 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21c4178-7f61-40fc-a0a3-f6c884a81076 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:25:29.649610 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21c4178-7f61-40fc-a0a3-f6c884a81076 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:25:29.649972 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21c4178-7f61-40fc-a0a3-f6c884a81076 admin admin] PATH_INFO: `/v3/roles` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:25:29.650687 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21c4178-7f61-40fc-a0a3-f6c884a81076 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:25:29.652557 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21c4178-7f61-40fc-a0a3-f6c884a81076 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:25:29.662104 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1243/2473] 10.222.0.58 () {58 vars in 1121 bytes} [Tue Oct 12 17:25:29 2021] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 17:25:29.666041 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f46eb3e-0c2a-4fc0-8f66-f14efc04b8e8 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:25:29.675440 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f46eb3e-0c2a-4fc0-8f66-f14efc04b8e8 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:25:29.680635 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e3a4b0-f06a-428c-ad6b-60e9938d5456 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:25:29.681485 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e3a4b0-f06a-428c-ad6b-60e9938d5456 admin admin] REQUEST_METHOD: `PUT` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:25:29.681769 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e3a4b0-f06a-428c-ad6b-60e9938d5456 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:25:29.682082 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e3a4b0-f06a-428c-ad6b-60e9938d5456 admin admin] PATH_INFO: `/v3/projects/f43a3d510a57427c941a2318c40b8a70/users/eeea9a4b83db4dff90d0c121ec00a84e/roles/55ba49fe29884e64b57c3ad13188d554` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:25:29.696261 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e3a4b0-f06a-428c-ad6b-60e9938d5456 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f43a3d510a57427c941a2318c40b8a70, user_id=eeea9a4b83db4dff90d0c121ec00a84e, role_id=55ba49fe29884e64b57c3ad13188d554)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:25:29.698906 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e3a4b0-f06a-428c-ad6b-60e9938d5456 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:25:29.711348 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1231/2474] 10.222.0.58 () {60 vars in 1482 bytes} [Tue Oct 12 17:25:29 2021] PUT /identity/v3/projects/f43a3d510a57427c941a2318c40b8a70/users/eeea9a4b83db4dff90d0c121ec00a84e/roles/55ba49fe29884e64b57c3ad13188d554 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 17:25:29.721929 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb8b648-a067-4d72-bf25-3301b2c9df9d None None] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:25:29.722220 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb8b648-a067-4d72-bf25-3301b2c9df9d None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:25:29.722522 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb8b648-a067-4d72-bf25-3301b2c9df9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:25:29.748767 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.auth.core [None req-cfb8b648-a067-4d72-bf25-3301b2c9df9d None None] MFA Rules not processed for user `eeea9a4b83db4dff90d0c121ec00a84e`. Rule list: `[]` (Enabled: `True`). {{(pid=85204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 17:25:29.749985 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-cfb8b648-a067-4d72-bf25-3301b2c9df9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:25:29.813693 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1244/2475] 10.222.0.58 () {58 vars in 957 bytes} [Tue Oct 12 17:25:29 2021] POST /identity/v3/auth/tokens => generated 3383 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 17:25:29.818329 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e3a4b0-f06a-428c-ad6b-60e9938d5456 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:25:29.877701 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e3a4b0-f06a-428c-ad6b-60e9938d5456 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:25:29.883227 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff83338-3c0d-4c70-b563-d59cc626401c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:25:29.883879 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff83338-3c0d-4c70-b563-d59cc626401c admin admin] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:25:29.884162 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff83338-3c0d-4c70-b563-d59cc626401c admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:25:29.884437 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff83338-3c0d-4c70-b563-d59cc626401c admin admin] PATH_INFO: `/v3/projects` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:25:29.885128 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff83338-3c0d-4c70-b563-d59cc626401c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:25:29.887035 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff83338-3c0d-4c70-b563-d59cc626401c admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:25:29.910176 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1232/2476] 10.222.0.58 () {60 vars in 1152 bytes} [Tue Oct 12 17:25:29 2021] POST /identity/v3/projects => generated 363 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 17:25:29.914095 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb8b648-a067-4d72-bf25-3301b2c9df9d None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:25:29.924252 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb8b648-a067-4d72-bf25-3301b2c9df9d None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:25:29.977341 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78effb78-d553-4968-ba31-6afda632794d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:25:29.978026 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78effb78-d553-4968-ba31-6afda632794d admin admin] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:25:29.978304 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78effb78-d553-4968-ba31-6afda632794d admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:25:29.978575 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78effb78-d553-4968-ba31-6afda632794d admin admin] PATH_INFO: `/v3/users` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:25:29.979275 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78effb78-d553-4968-ba31-6afda632794d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:25:29.981174 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78effb78-d553-4968-ba31-6afda632794d admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:25:30.000354 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1245/2477] 10.222.0.58 () {60 vars in 1143 bytes} [Tue Oct 12 17:25:29 2021] POST /identity/v3/users => generated 288 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 17:25:30.004256 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff83338-3c0d-4c70-b563-d59cc626401c admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:25:30.014547 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff83338-3c0d-4c70-b563-d59cc626401c admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:25:30.019197 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1744b2-fda2-44b3-b137-9050f98f11c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:25:30.019850 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1744b2-fda2-44b3-b137-9050f98f11c7 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:25:30.020136 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1744b2-fda2-44b3-b137-9050f98f11c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:25:30.020415 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1744b2-fda2-44b3-b137-9050f98f11c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:25:30.021147 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1744b2-fda2-44b3-b137-9050f98f11c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:25:30.022758 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1744b2-fda2-44b3-b137-9050f98f11c7 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:25:30.032923 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1233/2478] 10.222.0.58 () {58 vars in 1121 bytes} [Tue Oct 12 17:25:30 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 17:25:30.036734 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78effb78-d553-4968-ba31-6afda632794d admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:25:30.046785 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78effb78-d553-4968-ba31-6afda632794d admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:25:30.051385 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6b6efb-d5d3-4415-b4b6-cb9481fa19f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:25:30.052237 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6b6efb-d5d3-4415-b4b6-cb9481fa19f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:25:30.052521 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6b6efb-d5d3-4415-b4b6-cb9481fa19f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:25:30.052793 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6b6efb-d5d3-4415-b4b6-cb9481fa19f4 admin admin] PATH_INFO: `/v3/projects/246eaf4f25604ac8a7720dff06b77f96/users/8afe07fd5ccc4827ad564864139feeb5/roles/610824e4f50f4fb8954610e98c1de784` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:25:30.067258 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6b6efb-d5d3-4415-b4b6-cb9481fa19f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=246eaf4f25604ac8a7720dff06b77f96, user_id=8afe07fd5ccc4827ad564864139feeb5, role_id=610824e4f50f4fb8954610e98c1de784)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:25:30.069847 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6b6efb-d5d3-4415-b4b6-cb9481fa19f4 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:25:30.082714 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1246/2479] 10.222.0.58 () {60 vars in 1482 bytes} [Tue Oct 12 17:25:30 2021] PUT /identity/v3/projects/246eaf4f25604ac8a7720dff06b77f96/users/8afe07fd5ccc4827ad564864139feeb5/roles/610824e4f50f4fb8954610e98c1de784 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 17:25:30.086457 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1744b2-fda2-44b3-b137-9050f98f11c7 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:25:30.096121 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1744b2-fda2-44b3-b137-9050f98f11c7 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:25:30.149055 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2d41bb-b100-4bc9-80c3-048ca7d956f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:25:30.149643 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2d41bb-b100-4bc9-80c3-048ca7d956f7 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:25:30.149955 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2d41bb-b100-4bc9-80c3-048ca7d956f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:25:30.150234 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2d41bb-b100-4bc9-80c3-048ca7d956f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:25:30.150971 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2d41bb-b100-4bc9-80c3-048ca7d956f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:25:30.152585 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2d41bb-b100-4bc9-80c3-048ca7d956f7 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:25:30.162304 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1234/2480] 10.222.0.58 () {58 vars in 1121 bytes} [Tue Oct 12 17:25:30 2021] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 17:25:30.166804 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6b6efb-d5d3-4415-b4b6-cb9481fa19f4 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:25:30.176814 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6b6efb-d5d3-4415-b4b6-cb9481fa19f4 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:25:30.182154 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a275bd-491b-46c6-9a40-a56c5c0072ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:25:30.183024 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a275bd-491b-46c6-9a40-a56c5c0072ce admin admin] REQUEST_METHOD: `PUT` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:25:30.183311 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a275bd-491b-46c6-9a40-a56c5c0072ce admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:25:30.183589 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a275bd-491b-46c6-9a40-a56c5c0072ce admin admin] PATH_INFO: `/v3/projects/246eaf4f25604ac8a7720dff06b77f96/users/8afe07fd5ccc4827ad564864139feeb5/roles/610824e4f50f4fb8954610e98c1de784` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:25:30.185580 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a275bd-491b-46c6-9a40-a56c5c0072ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=246eaf4f25604ac8a7720dff06b77f96, user_id=8afe07fd5ccc4827ad564864139feeb5, role_id=610824e4f50f4fb8954610e98c1de784)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:25:30.189201 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a275bd-491b-46c6-9a40-a56c5c0072ce admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:25:30.200119 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1247/2481] 10.222.0.58 () {60 vars in 1482 bytes} [Tue Oct 12 17:25:30 2021] PUT /identity/v3/projects/246eaf4f25604ac8a7720dff06b77f96/users/8afe07fd5ccc4827ad564864139feeb5/roles/610824e4f50f4fb8954610e98c1de784 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 17:25:30.213610 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df34cd8-888d-4ce4-8a51-f36c492f517b None None] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:25:30.213942 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df34cd8-888d-4ce4-8a51-f36c492f517b None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:25:30.214226 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df34cd8-888d-4ce4-8a51-f36c492f517b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:25:30.245239 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.auth.core [None req-0df34cd8-888d-4ce4-8a51-f36c492f517b None None] MFA Rules not processed for user `8afe07fd5ccc4827ad564864139feeb5`. Rule list: `[]` (Enabled: `True`). {{(pid=85205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 17:25:30.246475 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-0df34cd8-888d-4ce4-8a51-f36c492f517b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:25:30.310095 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1235/2482] 10.222.0.58 () {58 vars in 957 bytes} [Tue Oct 12 17:25:30 2021] POST /identity/v3/auth/tokens => generated 3450 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 17:25:30.321026 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a275bd-491b-46c6-9a40-a56c5c0072ce admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:25:30.322826 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-54a275bd-491b-46c6-9a40-a56c5c0072ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:25:30.376763 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a275bd-491b-46c6-9a40-a56c5c0072ce admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:25:30.380448 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4b2723-d388-4825-8c10-901849f3ca61 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04704222b3d64a33a6c092fc641ccbb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:25:30.381154 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4b2723-d388-4825-8c10-901849f3ca61 service cinder] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:25:30.381441 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4b2723-d388-4825-8c10-901849f3ca61 service cinder] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:25:30.381714 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4b2723-d388-4825-8c10-901849f3ca61 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:25:30.391264 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4b2723-d388-4825-8c10-901849f3ca61 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:25:30.392677 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4b2723-d388-4825-8c10-901849f3ca61 service cinder] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:25:30.401868 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1248/2483] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Oct 12 17:25:30 2021] GET /identity/v3/auth/tokens => generated 3450 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 17:25:30.562401 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df34cd8-888d-4ce4-8a51-f36c492f517b None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:25:30.621272 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df34cd8-888d-4ce4-8a51-f36c492f517b None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:25:30.625774 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf12ded-0c0e-43fd-99b7-1bdc950276c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:25:30.626660 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf12ded-0c0e-43fd-99b7-1bdc950276c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:25:30.626947 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf12ded-0c0e-43fd-99b7-1bdc950276c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:25:30.627223 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf12ded-0c0e-43fd-99b7-1bdc950276c3 admin admin] PATH_INFO: `/v3/users/eeea9a4b83db4dff90d0c121ec00a84e` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:25:30.628408 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf12ded-0c0e-43fd-99b7-1bdc950276c3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eeea9a4b83db4dff90d0c121ec00a84e)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:25:30.630349 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf12ded-0c0e-43fd-99b7-1bdc950276c3 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:25:30.674218 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-eaf12ded-0c0e-43fd-99b7-1bdc950276c3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eeea9a4b83db4dff90d0c121ec00a84e'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:25:30.685983 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-eaf12ded-0c0e-43fd-99b7-1bdc950276c3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eeea9a4b83db4dff90d0c121ec00a84e'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:25:30.694149 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-eaf12ded-0c0e-43fd-99b7-1bdc950276c3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eeea9a4b83db4dff90d0c121ec00a84e'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:25:30.701370 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-eaf12ded-0c0e-43fd-99b7-1bdc950276c3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eeea9a4b83db4dff90d0c121ec00a84e'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:25:30.702044 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-eaf12ded-0c0e-43fd-99b7-1bdc950276c3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eeea9a4b83db4dff90d0c121ec00a84e'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:25:30.707715 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1236/2484] 10.222.0.58 () {58 vars in 1223 bytes} [Tue Oct 12 17:25:30 2021] DELETE /identity/v3/users/eeea9a4b83db4dff90d0c121ec00a84e => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 17:25:30.712198 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f38915-7097-487e-a9b4-4e98b8c624ad None None] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:25:30.712491 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f38915-7097-487e-a9b4-4e98b8c624ad None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:25:30.712769 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f38915-7097-487e-a9b4-4e98b8c624ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:25:30.730243 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.auth.core [None req-c4f38915-7097-487e-a9b4-4e98b8c624ad None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 17:25:30.731431 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-c4f38915-7097-487e-a9b4-4e98b8c624ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:25:30.787709 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1249/2485] 10.222.0.58 () {58 vars in 957 bytes} [Tue Oct 12 17:25:30 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 17:25:30.798057 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf12ded-0c0e-43fd-99b7-1bdc950276c3 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:25:30.799450 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-eaf12ded-0c0e-43fd-99b7-1bdc950276c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:25:30.854627 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf12ded-0c0e-43fd-99b7-1bdc950276c3 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:25:30.858318 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f5e073-9fbc-455c-8458-cdaa5a6006dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e65f6d0598e4c539134292b86fb43d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:25:30.858962 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f5e073-9fbc-455c-8458-cdaa5a6006dd service neutron] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:25:30.859247 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f5e073-9fbc-455c-8458-cdaa5a6006dd service neutron] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:25:30.859523 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f5e073-9fbc-455c-8458-cdaa5a6006dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:25:30.869046 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f5e073-9fbc-455c-8458-cdaa5a6006dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:25:30.870518 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f5e073-9fbc-455c-8458-cdaa5a6006dd service neutron] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:25:30.886896 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1237/2486] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Oct 12 17:25:30 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 17:25:31.152092 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f38915-7097-487e-a9b4-4e98b8c624ad None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:25:31.154208 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-c4f38915-7097-487e-a9b4-4e98b8c624ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:25:31.176059 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f38915-7097-487e-a9b4-4e98b8c624ad None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:25:31.181447 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d167e092-e85f-4070-9073-c2aed0fb09b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:25:31.182412 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d167e092-e85f-4070-9073-c2aed0fb09b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:25:31.182785 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d167e092-e85f-4070-9073-c2aed0fb09b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:25:31.183066 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d167e092-e85f-4070-9073-c2aed0fb09b7 admin admin] PATH_INFO: `/v3/projects/f43a3d510a57427c941a2318c40b8a70` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:25:31.184317 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d167e092-e85f-4070-9073-c2aed0fb09b7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f43a3d510a57427c941a2318c40b8a70)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:25:31.186251 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d167e092-e85f-4070-9073-c2aed0fb09b7 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:25:31.235985 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-d167e092-e85f-4070-9073-c2aed0fb09b7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f43a3d510a57427c941a2318c40b8a70', 'request_id': 'req-d167e092-e85f-4070-9073-c2aed0fb09b7'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:25:31.242944 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-d167e092-e85f-4070-9073-c2aed0fb09b7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f43a3d510a57427c941a2318c40b8a70', 'request_id': 'req-d167e092-e85f-4070-9073-c2aed0fb09b7'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:25:31.249673 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-d167e092-e85f-4070-9073-c2aed0fb09b7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f43a3d510a57427c941a2318c40b8a70', 'request_id': 'req-d167e092-e85f-4070-9073-c2aed0fb09b7'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:25:31.262677 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-d167e092-e85f-4070-9073-c2aed0fb09b7 admin admin] The token cache is being invalidate because project f43a3d510a57427c941a2318c40b8a70 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=85204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 17:25:31.262972 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-d167e092-e85f-4070-9073-c2aed0fb09b7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:25:31.263616 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-d167e092-e85f-4070-9073-c2aed0fb09b7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:25:31.265346 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1250/2487] 10.222.0.58 () {58 vars in 1232 bytes} [Tue Oct 12 17:25:31 2021] DELETE /identity/v3/projects/f43a3d510a57427c941a2318c40b8a70 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 17:25:31.269324 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f5e073-9fbc-455c-8458-cdaa5a6006dd service neutron] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:25:31.278690 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f5e073-9fbc-455c-8458-cdaa5a6006dd service neutron] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:25:31.333850 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e26ad14-33be-4899-8def-2ce3dd6f60ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:25:31.334744 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e26ad14-33be-4899-8def-2ce3dd6f60ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:25:31.335031 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e26ad14-33be-4899-8def-2ce3dd6f60ac admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:25:31.335308 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e26ad14-33be-4899-8def-2ce3dd6f60ac admin admin] PATH_INFO: `/v3/users/8afe07fd5ccc4827ad564864139feeb5` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:25:31.336550 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e26ad14-33be-4899-8def-2ce3dd6f60ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=8afe07fd5ccc4827ad564864139feeb5)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:25:31.338470 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e26ad14-33be-4899-8def-2ce3dd6f60ac admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:25:31.384513 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-1e26ad14-33be-4899-8def-2ce3dd6f60ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8afe07fd5ccc4827ad564864139feeb5'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:25:31.397789 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-1e26ad14-33be-4899-8def-2ce3dd6f60ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8afe07fd5ccc4827ad564864139feeb5'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:25:31.404894 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-1e26ad14-33be-4899-8def-2ce3dd6f60ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8afe07fd5ccc4827ad564864139feeb5'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:25:31.411422 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-1e26ad14-33be-4899-8def-2ce3dd6f60ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8afe07fd5ccc4827ad564864139feeb5'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:25:31.412044 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-1e26ad14-33be-4899-8def-2ce3dd6f60ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8afe07fd5ccc4827ad564864139feeb5'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:25:31.422507 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1238/2488] 10.222.0.58 () {58 vars in 1223 bytes} [Tue Oct 12 17:25:31 2021] DELETE /identity/v3/users/8afe07fd5ccc4827ad564864139feeb5 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 17:25:31.699993 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d167e092-e85f-4070-9073-c2aed0fb09b7 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:25:31.701477 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-d167e092-e85f-4070-9073-c2aed0fb09b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:25:31.714176 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d167e092-e85f-4070-9073-c2aed0fb09b7 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:25:31.774929 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b075e498-1008-4a6a-9664-6dd87010ab87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:25:31.775704 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b075e498-1008-4a6a-9664-6dd87010ab87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:25:31.775990 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b075e498-1008-4a6a-9664-6dd87010ab87 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:25:31.776267 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b075e498-1008-4a6a-9664-6dd87010ab87 admin admin] PATH_INFO: `/v3/projects/246eaf4f25604ac8a7720dff06b77f96` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:25:31.777480 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b075e498-1008-4a6a-9664-6dd87010ab87 admin admin] RBAC: Authorizing `identity:delete_project(project_id=246eaf4f25604ac8a7720dff06b77f96)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:25:31.779776 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b075e498-1008-4a6a-9664-6dd87010ab87 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:25:31.824065 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-b075e498-1008-4a6a-9664-6dd87010ab87 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '246eaf4f25604ac8a7720dff06b77f96', 'request_id': 'req-b075e498-1008-4a6a-9664-6dd87010ab87'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:25:31.829252 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-b075e498-1008-4a6a-9664-6dd87010ab87 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '246eaf4f25604ac8a7720dff06b77f96', 'request_id': 'req-b075e498-1008-4a6a-9664-6dd87010ab87'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:25:31.835244 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-b075e498-1008-4a6a-9664-6dd87010ab87 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '246eaf4f25604ac8a7720dff06b77f96', 'request_id': 'req-b075e498-1008-4a6a-9664-6dd87010ab87'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:25:31.847872 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-b075e498-1008-4a6a-9664-6dd87010ab87 admin admin] The token cache is being invalidate because project 246eaf4f25604ac8a7720dff06b77f96 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=85204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 17:25:31.848173 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-b075e498-1008-4a6a-9664-6dd87010ab87 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:25:31.848802 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-b075e498-1008-4a6a-9664-6dd87010ab87 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:25:31.850399 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1251/2489] 10.222.0.58 () {58 vars in 1232 bytes} [Tue Oct 12 17:25:31 2021] DELETE /identity/v3/projects/246eaf4f25604ac8a7720dff06b77f96 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 17:25:31.857029 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4f5e03-e68e-41cb-b5cf-87f0eb136420 None None] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:25:31.857495 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4f5e03-e68e-41cb-b5cf-87f0eb136420 None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:25:31.857593 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4f5e03-e68e-41cb-b5cf-87f0eb136420 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:25:31.876677 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.auth.core [None req-4b4f5e03-e68e-41cb-b5cf-87f0eb136420 None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 17:25:31.877907 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-4b4f5e03-e68e-41cb-b5cf-87f0eb136420 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:25:31.938129 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1239/2490] 10.222.0.58 () {58 vars in 957 bytes} [Tue Oct 12 17:25:31 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 17:25:31.945805 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692f7dad-f3e9-4a0c-93a1-599dd6ab5bd5 None None] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:25:31.946125 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692f7dad-f3e9-4a0c-93a1-599dd6ab5bd5 None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:25:31.946406 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692f7dad-f3e9-4a0c-93a1-599dd6ab5bd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:25:31.964626 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.auth.core [None req-692f7dad-f3e9-4a0c-93a1-599dd6ab5bd5 None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 17:25:31.965826 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-692f7dad-f3e9-4a0c-93a1-599dd6ab5bd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:25:31.973614 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1252/2491] 10.222.0.58 () {58 vars in 957 bytes} [Tue Oct 12 17:25:31 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 17:25:31.978126 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4f5e03-e68e-41cb-b5cf-87f0eb136420 None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:25:31.987439 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4f5e03-e68e-41cb-b5cf-87f0eb136420 None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:25:31.991985 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3027c3-d423-4f62-b67b-1a790467d061 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:25:31.992628 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3027c3-d423-4f62-b67b-1a790467d061 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:25:31.992908 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3027c3-d423-4f62-b67b-1a790467d061 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:25:31.993180 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3027c3-d423-4f62-b67b-1a790467d061 admin admin] PATH_INFO: `/v3/domains` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:25:31.993932 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3027c3-d423-4f62-b67b-1a790467d061 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 17:25:31.994239 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3027c3-d423-4f62-b67b-1a790467d061 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:25:31.995807 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3027c3-d423-4f62-b67b-1a790467d061 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:25:32.007014 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1240/2492] 10.222.0.58 () {58 vars in 1152 bytes} [Tue Oct 12 17:25:31 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 17:25:32.012333 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692f7dad-f3e9-4a0c-93a1-599dd6ab5bd5 None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:25:32.021188 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692f7dad-f3e9-4a0c-93a1-599dd6ab5bd5 None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:25:32.026410 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75eaf66-e6c1-484f-a15d-43722f2bf24f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:25:32.026990 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75eaf66-e6c1-484f-a15d-43722f2bf24f admin admin] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:25:32.027274 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75eaf66-e6c1-484f-a15d-43722f2bf24f admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:25:32.027553 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75eaf66-e6c1-484f-a15d-43722f2bf24f admin admin] PATH_INFO: `/v3/projects` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:25:32.028261 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75eaf66-e6c1-484f-a15d-43722f2bf24f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:25:32.030170 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75eaf66-e6c1-484f-a15d-43722f2bf24f admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:25:32.055421 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1253/2493] 10.222.0.58 () {60 vars in 1152 bytes} [Tue Oct 12 17:25:32 2021] POST /identity/v3/projects => generated 365 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 17:25:32.059408 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3027c3-d423-4f62-b67b-1a790467d061 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:25:32.069248 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3027c3-d423-4f62-b67b-1a790467d061 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:25:32.122373 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbd0f20-c458-414e-a374-62e216ba1db2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:25:32.123026 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbd0f20-c458-414e-a374-62e216ba1db2 admin admin] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:25:32.123313 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbd0f20-c458-414e-a374-62e216ba1db2 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:25:32.123588 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbd0f20-c458-414e-a374-62e216ba1db2 admin admin] PATH_INFO: `/v3/users` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:25:32.124276 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbd0f20-c458-414e-a374-62e216ba1db2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:25:32.126188 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbd0f20-c458-414e-a374-62e216ba1db2 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:25:32.144973 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1241/2494] 10.222.0.58 () {60 vars in 1143 bytes} [Tue Oct 12 17:25:32 2021] POST /identity/v3/users => generated 283 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 17:25:32.149907 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75eaf66-e6c1-484f-a15d-43722f2bf24f admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:25:32.160130 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75eaf66-e6c1-484f-a15d-43722f2bf24f admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:25:32.164911 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d347fe1-b34a-4fb9-8866-deaaf232966d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:25:32.165563 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d347fe1-b34a-4fb9-8866-deaaf232966d admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:25:32.165851 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d347fe1-b34a-4fb9-8866-deaaf232966d admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:25:32.166180 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d347fe1-b34a-4fb9-8866-deaaf232966d admin admin] PATH_INFO: `/v3/roles` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:25:32.166899 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d347fe1-b34a-4fb9-8866-deaaf232966d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:25:32.168505 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d347fe1-b34a-4fb9-8866-deaaf232966d admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:25:32.178646 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1254/2495] 10.222.0.58 () {58 vars in 1121 bytes} [Tue Oct 12 17:25:32 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 17:25:32.182998 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbd0f20-c458-414e-a374-62e216ba1db2 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:25:32.193030 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbd0f20-c458-414e-a374-62e216ba1db2 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:25:32.198486 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e255bb-31ef-4eb4-b4e0-0144384b06e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:25:32.199163 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e255bb-31ef-4eb4-b4e0-0144384b06e3 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:25:32.199446 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e255bb-31ef-4eb4-b4e0-0144384b06e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:25:32.199719 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e255bb-31ef-4eb4-b4e0-0144384b06e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:25:32.200451 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e255bb-31ef-4eb4-b4e0-0144384b06e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:25:32.202039 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e255bb-31ef-4eb4-b4e0-0144384b06e3 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:25:32.211715 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1242/2496] 10.222.0.58 () {58 vars in 1121 bytes} [Tue Oct 12 17:25:32 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 17:25:32.215677 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d347fe1-b34a-4fb9-8866-deaaf232966d admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:25:32.225325 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d347fe1-b34a-4fb9-8866-deaaf232966d admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:25:32.230512 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e4c526-c291-4b52-935d-30139a096a31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:25:32.231380 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e4c526-c291-4b52-935d-30139a096a31 admin admin] REQUEST_METHOD: `PUT` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:25:32.231666 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e4c526-c291-4b52-935d-30139a096a31 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:25:32.231943 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e4c526-c291-4b52-935d-30139a096a31 admin admin] PATH_INFO: `/v3/projects/b9da18b9b2e144578c510cb72fbea32d/users/1f7a45903d69457c9e7f022fe7e18ed3/roles/55ba49fe29884e64b57c3ad13188d554` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:25:32.246427 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e4c526-c291-4b52-935d-30139a096a31 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9da18b9b2e144578c510cb72fbea32d, user_id=1f7a45903d69457c9e7f022fe7e18ed3, role_id=55ba49fe29884e64b57c3ad13188d554)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:25:32.249034 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e4c526-c291-4b52-935d-30139a096a31 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:25:32.262197 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1255/2497] 10.222.0.58 () {60 vars in 1482 bytes} [Tue Oct 12 17:25:32 2021] PUT /identity/v3/projects/b9da18b9b2e144578c510cb72fbea32d/users/1f7a45903d69457c9e7f022fe7e18ed3/roles/55ba49fe29884e64b57c3ad13188d554 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 17:25:32.271933 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46e45da-5369-4544-8ebc-7ac1852a00d9 None None] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:25:32.272224 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46e45da-5369-4544-8ebc-7ac1852a00d9 None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:25:32.272503 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46e45da-5369-4544-8ebc-7ac1852a00d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:25:32.298682 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.auth.core [None req-b46e45da-5369-4544-8ebc-7ac1852a00d9 None None] MFA Rules not processed for user `1f7a45903d69457c9e7f022fe7e18ed3`. Rule list: `[]` (Enabled: `True`). {{(pid=85205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 17:25:32.299826 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-b46e45da-5369-4544-8ebc-7ac1852a00d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:25:32.360691 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1243/2498] 10.222.0.58 () {58 vars in 957 bytes} [Tue Oct 12 17:25:32 2021] POST /identity/v3/auth/tokens => generated 3385 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 17:25:32.365010 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e4c526-c291-4b52-935d-30139a096a31 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:25:32.423552 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e4c526-c291-4b52-935d-30139a096a31 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:25:32.428400 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8810637-2861-489d-9dca-fd9ce5ad3543 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:25:32.429062 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8810637-2861-489d-9dca-fd9ce5ad3543 admin admin] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:25:32.430017 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8810637-2861-489d-9dca-fd9ce5ad3543 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:25:32.430438 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8810637-2861-489d-9dca-fd9ce5ad3543 admin admin] PATH_INFO: `/v3/projects` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:25:32.431144 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8810637-2861-489d-9dca-fd9ce5ad3543 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:25:32.433042 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8810637-2861-489d-9dca-fd9ce5ad3543 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:25:32.457232 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1256/2499] 10.222.0.58 () {60 vars in 1152 bytes} [Tue Oct 12 17:25:32 2021] POST /identity/v3/projects => generated 365 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 17:25:32.461274 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46e45da-5369-4544-8ebc-7ac1852a00d9 None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:25:32.471689 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46e45da-5369-4544-8ebc-7ac1852a00d9 None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:25:32.525636 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d38cf8-3377-4f5b-b7c8-7a2ab10ff7f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:25:32.526345 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d38cf8-3377-4f5b-b7c8-7a2ab10ff7f7 admin admin] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:25:32.526634 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d38cf8-3377-4f5b-b7c8-7a2ab10ff7f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:25:32.526912 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d38cf8-3377-4f5b-b7c8-7a2ab10ff7f7 admin admin] PATH_INFO: `/v3/users` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:25:32.527617 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d38cf8-3377-4f5b-b7c8-7a2ab10ff7f7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:25:32.529497 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d38cf8-3377-4f5b-b7c8-7a2ab10ff7f7 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:25:32.549029 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1244/2500] 10.222.0.58 () {60 vars in 1143 bytes} [Tue Oct 12 17:25:32 2021] POST /identity/v3/users => generated 289 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 17:25:32.552879 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8810637-2861-489d-9dca-fd9ce5ad3543 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:25:32.563487 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8810637-2861-489d-9dca-fd9ce5ad3543 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:25:32.568338 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879fbe27-8d58-4453-a270-f77f1f0817b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:25:32.569001 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879fbe27-8d58-4453-a270-f77f1f0817b9 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:25:32.569288 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879fbe27-8d58-4453-a270-f77f1f0817b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:25:32.569569 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879fbe27-8d58-4453-a270-f77f1f0817b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:25:32.570882 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879fbe27-8d58-4453-a270-f77f1f0817b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:25:32.572476 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879fbe27-8d58-4453-a270-f77f1f0817b9 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:25:32.583000 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1257/2501] 10.222.0.58 () {58 vars in 1121 bytes} [Tue Oct 12 17:25:32 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 17:25:32.587576 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d38cf8-3377-4f5b-b7c8-7a2ab10ff7f7 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:25:32.597281 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d38cf8-3377-4f5b-b7c8-7a2ab10ff7f7 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:25:32.601902 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87067417-bc06-4853-9b5c-76a006690071 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:25:32.602777 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87067417-bc06-4853-9b5c-76a006690071 admin admin] REQUEST_METHOD: `PUT` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:25:32.603058 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87067417-bc06-4853-9b5c-76a006690071 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:25:32.603331 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87067417-bc06-4853-9b5c-76a006690071 admin admin] PATH_INFO: `/v3/projects/4361973f87fa49858f0d3d882a9a7c86/users/fafddaec911c4e8388b050bfc837e03c/roles/610824e4f50f4fb8954610e98c1de784` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:25:32.619583 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87067417-bc06-4853-9b5c-76a006690071 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4361973f87fa49858f0d3d882a9a7c86, user_id=fafddaec911c4e8388b050bfc837e03c, role_id=610824e4f50f4fb8954610e98c1de784)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:25:32.622192 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87067417-bc06-4853-9b5c-76a006690071 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:25:32.635462 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1245/2502] 10.222.0.58 () {60 vars in 1482 bytes} [Tue Oct 12 17:25:32 2021] PUT /identity/v3/projects/4361973f87fa49858f0d3d882a9a7c86/users/fafddaec911c4e8388b050bfc837e03c/roles/610824e4f50f4fb8954610e98c1de784 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 17:25:32.639475 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879fbe27-8d58-4453-a270-f77f1f0817b9 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:25:32.649339 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879fbe27-8d58-4453-a270-f77f1f0817b9 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:25:32.702425 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a1c63c-9687-4da7-8e36-44ea18bf0cde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:25:32.703080 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a1c63c-9687-4da7-8e36-44ea18bf0cde admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:25:32.703363 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a1c63c-9687-4da7-8e36-44ea18bf0cde admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:25:32.703633 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a1c63c-9687-4da7-8e36-44ea18bf0cde admin admin] PATH_INFO: `/v3/roles` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:25:32.704357 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a1c63c-9687-4da7-8e36-44ea18bf0cde admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:25:32.705936 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a1c63c-9687-4da7-8e36-44ea18bf0cde admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:25:32.715085 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1258/2503] 10.222.0.58 () {58 vars in 1121 bytes} [Tue Oct 12 17:25:32 2021] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 17:25:32.719149 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87067417-bc06-4853-9b5c-76a006690071 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:25:32.728956 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87067417-bc06-4853-9b5c-76a006690071 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:25:32.733468 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ae2938-815e-4aa9-a9bb-c52b57564182 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:25:32.734361 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ae2938-815e-4aa9-a9bb-c52b57564182 admin admin] REQUEST_METHOD: `PUT` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:25:32.734703 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ae2938-815e-4aa9-a9bb-c52b57564182 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:25:32.734992 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ae2938-815e-4aa9-a9bb-c52b57564182 admin admin] PATH_INFO: `/v3/projects/4361973f87fa49858f0d3d882a9a7c86/users/fafddaec911c4e8388b050bfc837e03c/roles/610824e4f50f4fb8954610e98c1de784` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:25:32.736924 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ae2938-815e-4aa9-a9bb-c52b57564182 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4361973f87fa49858f0d3d882a9a7c86, user_id=fafddaec911c4e8388b050bfc837e03c, role_id=610824e4f50f4fb8954610e98c1de784)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:25:32.739516 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ae2938-815e-4aa9-a9bb-c52b57564182 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:25:32.750051 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1246/2504] 10.222.0.58 () {60 vars in 1482 bytes} [Tue Oct 12 17:25:32 2021] PUT /identity/v3/projects/4361973f87fa49858f0d3d882a9a7c86/users/fafddaec911c4e8388b050bfc837e03c/roles/610824e4f50f4fb8954610e98c1de784 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 17:25:32.760154 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b648d12-c539-4cd7-9545-d006a90d3e42 None None] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:25:32.760441 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b648d12-c539-4cd7-9545-d006a90d3e42 None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:25:32.760717 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b648d12-c539-4cd7-9545-d006a90d3e42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:25:32.786919 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.auth.core [None req-6b648d12-c539-4cd7-9545-d006a90d3e42 None None] MFA Rules not processed for user `fafddaec911c4e8388b050bfc837e03c`. Rule list: `[]` (Enabled: `True`). {{(pid=85204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 17:25:32.788111 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-6b648d12-c539-4cd7-9545-d006a90d3e42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:25:32.853004 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1259/2505] 10.222.0.58 () {58 vars in 957 bytes} [Tue Oct 12 17:25:32 2021] POST /identity/v3/auth/tokens => generated 3452 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 17:25:32.863229 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ae2938-815e-4aa9-a9bb-c52b57564182 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:25:32.864920 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-65ae2938-815e-4aa9-a9bb-c52b57564182 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:25:32.921644 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ae2938-815e-4aa9-a9bb-c52b57564182 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:25:32.925319 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b22be2-ad25-4a83-8425-d2106ee372ae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04704222b3d64a33a6c092fc641ccbb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:25:32.925993 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b22be2-ad25-4a83-8425-d2106ee372ae service cinder] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:25:32.926278 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b22be2-ad25-4a83-8425-d2106ee372ae service cinder] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:25:32.926555 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b22be2-ad25-4a83-8425-d2106ee372ae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:25:32.936157 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b22be2-ad25-4a83-8425-d2106ee372ae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:25:32.937553 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b22be2-ad25-4a83-8425-d2106ee372ae service cinder] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:25:32.947450 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1247/2506] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Oct 12 17:25:32 2021] GET /identity/v3/auth/tokens => generated 3452 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 17:25:33.015596 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b648d12-c539-4cd7-9545-d006a90d3e42 None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:25:33.025202 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b648d12-c539-4cd7-9545-d006a90d3e42 None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:25:33.028768 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571f22e0-7523-4d33-b6e9-57e3eb271658 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04704222b3d64a33a6c092fc641ccbb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:25:33.029652 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571f22e0-7523-4d33-b6e9-57e3eb271658 service cinder] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:25:33.029977 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571f22e0-7523-4d33-b6e9-57e3eb271658 service cinder] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:25:33.030251 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571f22e0-7523-4d33-b6e9-57e3eb271658 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:25:33.084643 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571f22e0-7523-4d33-b6e9-57e3eb271658 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:25:33.086054 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571f22e0-7523-4d33-b6e9-57e3eb271658 service cinder] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:25:33.094673 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1260/2507] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Oct 12 17:25:33 2021] GET /identity/v3/auth/tokens => generated 3385 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 17:25:43.137632 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b22be2-ad25-4a83-8425-d2106ee372ae service cinder] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:25:43.198008 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b22be2-ad25-4a83-8425-d2106ee372ae service cinder] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:25:43.202676 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d39956b-e270-4cef-8247-a02f7907512c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:25:43.203528 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d39956b-e270-4cef-8247-a02f7907512c admin admin] REQUEST_METHOD: `DELETE` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:25:43.203809 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d39956b-e270-4cef-8247-a02f7907512c admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:25:43.204081 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d39956b-e270-4cef-8247-a02f7907512c admin admin] PATH_INFO: `/v3/users/1f7a45903d69457c9e7f022fe7e18ed3` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:25:43.205270 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d39956b-e270-4cef-8247-a02f7907512c admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f7a45903d69457c9e7f022fe7e18ed3)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:25:43.207188 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d39956b-e270-4cef-8247-a02f7907512c admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:25:43.251588 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-4d39956b-e270-4cef-8247-a02f7907512c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f7a45903d69457c9e7f022fe7e18ed3'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:25:43.264229 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-4d39956b-e270-4cef-8247-a02f7907512c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f7a45903d69457c9e7f022fe7e18ed3'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:25:43.271870 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-4d39956b-e270-4cef-8247-a02f7907512c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f7a45903d69457c9e7f022fe7e18ed3'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:25:43.280156 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-4d39956b-e270-4cef-8247-a02f7907512c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f7a45903d69457c9e7f022fe7e18ed3'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:25:43.280798 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-4d39956b-e270-4cef-8247-a02f7907512c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f7a45903d69457c9e7f022fe7e18ed3'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:25:43.286537 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1248/2508] 10.222.0.58 () {58 vars in 1223 bytes} [Tue Oct 12 17:25:43 2021] DELETE /identity/v3/users/1f7a45903d69457c9e7f022fe7e18ed3 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 17:25:43.291607 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56c6c88-a67b-4e5f-a0a0-338fa87ccbdd None None] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:25:43.292078 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56c6c88-a67b-4e5f-a0a0-338fa87ccbdd None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:25:43.292176 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56c6c88-a67b-4e5f-a0a0-338fa87ccbdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:25:43.308620 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.auth.core [None req-c56c6c88-a67b-4e5f-a0a0-338fa87ccbdd None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 17:25:43.309811 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-c56c6c88-a67b-4e5f-a0a0-338fa87ccbdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:25:43.366437 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1261/2509] 10.222.0.58 () {58 vars in 957 bytes} [Tue Oct 12 17:25:43 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 17:25:43.376567 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d39956b-e270-4cef-8247-a02f7907512c admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:25:43.377963 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-4d39956b-e270-4cef-8247-a02f7907512c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:25:43.431789 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d39956b-e270-4cef-8247-a02f7907512c admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:25:43.435531 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8552bd-7d98-43d1-9a5b-3c0c4a160850 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e65f6d0598e4c539134292b86fb43d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:25:43.436170 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8552bd-7d98-43d1-9a5b-3c0c4a160850 service neutron] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:25:43.436451 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8552bd-7d98-43d1-9a5b-3c0c4a160850 service neutron] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:25:43.436725 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8552bd-7d98-43d1-9a5b-3c0c4a160850 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:25:43.446017 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8552bd-7d98-43d1-9a5b-3c0c4a160850 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:25:43.447419 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8552bd-7d98-43d1-9a5b-3c0c4a160850 service neutron] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:25:43.456498 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1249/2510] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Oct 12 17:25:43 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 17:25:43.712017 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56c6c88-a67b-4e5f-a0a0-338fa87ccbdd None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:25:43.713418 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-c56c6c88-a67b-4e5f-a0a0-338fa87ccbdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:25:43.728081 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56c6c88-a67b-4e5f-a0a0-338fa87ccbdd None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:25:43.733828 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a2db39-bdd3-48a6-8bb2-b47be26b9e81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:25:43.734824 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a2db39-bdd3-48a6-8bb2-b47be26b9e81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:25:43.735120 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a2db39-bdd3-48a6-8bb2-b47be26b9e81 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:25:43.735470 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a2db39-bdd3-48a6-8bb2-b47be26b9e81 admin admin] PATH_INFO: `/v3/projects/b9da18b9b2e144578c510cb72fbea32d` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:25:43.736533 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a2db39-bdd3-48a6-8bb2-b47be26b9e81 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b9da18b9b2e144578c510cb72fbea32d)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:25:43.738625 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a2db39-bdd3-48a6-8bb2-b47be26b9e81 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:25:43.783748 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-78a2db39-bdd3-48a6-8bb2-b47be26b9e81 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b9da18b9b2e144578c510cb72fbea32d', 'request_id': 'req-78a2db39-bdd3-48a6-8bb2-b47be26b9e81'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:25:43.789426 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-78a2db39-bdd3-48a6-8bb2-b47be26b9e81 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b9da18b9b2e144578c510cb72fbea32d', 'request_id': 'req-78a2db39-bdd3-48a6-8bb2-b47be26b9e81'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:25:43.795727 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-78a2db39-bdd3-48a6-8bb2-b47be26b9e81 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b9da18b9b2e144578c510cb72fbea32d', 'request_id': 'req-78a2db39-bdd3-48a6-8bb2-b47be26b9e81'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:25:43.806486 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-78a2db39-bdd3-48a6-8bb2-b47be26b9e81 admin admin] The token cache is being invalidate because project b9da18b9b2e144578c510cb72fbea32d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=85204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 17:25:43.806771 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-78a2db39-bdd3-48a6-8bb2-b47be26b9e81 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:25:43.807392 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-78a2db39-bdd3-48a6-8bb2-b47be26b9e81 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:25:43.809006 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1262/2511] 10.222.0.58 () {58 vars in 1232 bytes} [Tue Oct 12 17:25:43 2021] DELETE /identity/v3/projects/b9da18b9b2e144578c510cb72fbea32d => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 17:25:43.813068 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8552bd-7d98-43d1-9a5b-3c0c4a160850 service neutron] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:25:43.823184 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8552bd-7d98-43d1-9a5b-3c0c4a160850 service neutron] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:25:43.876518 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74eb140-937b-4589-97df-0e0207e8cbc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:25:43.877375 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74eb140-937b-4589-97df-0e0207e8cbc4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:25:43.877656 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74eb140-937b-4589-97df-0e0207e8cbc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:25:43.877962 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74eb140-937b-4589-97df-0e0207e8cbc4 admin admin] PATH_INFO: `/v3/users/fafddaec911c4e8388b050bfc837e03c` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:25:43.879179 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74eb140-937b-4589-97df-0e0207e8cbc4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fafddaec911c4e8388b050bfc837e03c)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:25:43.881050 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74eb140-937b-4589-97df-0e0207e8cbc4 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:25:43.923381 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-b74eb140-937b-4589-97df-0e0207e8cbc4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fafddaec911c4e8388b050bfc837e03c'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:25:43.934983 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-b74eb140-937b-4589-97df-0e0207e8cbc4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fafddaec911c4e8388b050bfc837e03c'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:25:43.941723 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-b74eb140-937b-4589-97df-0e0207e8cbc4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fafddaec911c4e8388b050bfc837e03c'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:25:43.948856 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-b74eb140-937b-4589-97df-0e0207e8cbc4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fafddaec911c4e8388b050bfc837e03c'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:25:43.949494 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-b74eb140-937b-4589-97df-0e0207e8cbc4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fafddaec911c4e8388b050bfc837e03c'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:25:43.955174 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1250/2512] 10.222.0.58 () {58 vars in 1223 bytes} [Tue Oct 12 17:25:43 2021] DELETE /identity/v3/users/fafddaec911c4e8388b050bfc837e03c => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 17:25:44.206108 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a2db39-bdd3-48a6-8bb2-b47be26b9e81 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:25:44.207554 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-78a2db39-bdd3-48a6-8bb2-b47be26b9e81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:25:44.222527 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a2db39-bdd3-48a6-8bb2-b47be26b9e81 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:25:44.277632 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868a44a7-1ac1-4276-b062-ea1b2f5037c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:25:44.278514 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868a44a7-1ac1-4276-b062-ea1b2f5037c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:25:44.278799 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868a44a7-1ac1-4276-b062-ea1b2f5037c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:25:44.279070 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868a44a7-1ac1-4276-b062-ea1b2f5037c2 admin admin] PATH_INFO: `/v3/projects/4361973f87fa49858f0d3d882a9a7c86` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:25:44.280249 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868a44a7-1ac1-4276-b062-ea1b2f5037c2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4361973f87fa49858f0d3d882a9a7c86)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:25:44.282141 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868a44a7-1ac1-4276-b062-ea1b2f5037c2 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:25:44.326276 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-868a44a7-1ac1-4276-b062-ea1b2f5037c2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4361973f87fa49858f0d3d882a9a7c86', 'request_id': 'req-868a44a7-1ac1-4276-b062-ea1b2f5037c2'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:25:44.331743 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-868a44a7-1ac1-4276-b062-ea1b2f5037c2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4361973f87fa49858f0d3d882a9a7c86', 'request_id': 'req-868a44a7-1ac1-4276-b062-ea1b2f5037c2'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:25:44.338099 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-868a44a7-1ac1-4276-b062-ea1b2f5037c2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4361973f87fa49858f0d3d882a9a7c86', 'request_id': 'req-868a44a7-1ac1-4276-b062-ea1b2f5037c2'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:25:44.354602 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-868a44a7-1ac1-4276-b062-ea1b2f5037c2 admin admin] The token cache is being invalidate because project 4361973f87fa49858f0d3d882a9a7c86 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=85204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 17:25:44.354890 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-868a44a7-1ac1-4276-b062-ea1b2f5037c2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:25:44.355505 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-868a44a7-1ac1-4276-b062-ea1b2f5037c2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:25:44.357013 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1263/2513] 10.222.0.58 () {58 vars in 1232 bytes} [Tue Oct 12 17:25:44 2021] DELETE /identity/v3/projects/4361973f87fa49858f0d3d882a9a7c86 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 17:25:44.362692 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda74e4e-1f13-4f0d-82d4-9e027fa0750a None None] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:25:44.363137 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda74e4e-1f13-4f0d-82d4-9e027fa0750a None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:25:44.363265 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda74e4e-1f13-4f0d-82d4-9e027fa0750a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:25:44.380585 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.auth.core [None req-cda74e4e-1f13-4f0d-82d4-9e027fa0750a None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 17:25:44.381826 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-cda74e4e-1f13-4f0d-82d4-9e027fa0750a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:25:44.437762 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1251/2514] 10.222.0.58 () {58 vars in 957 bytes} [Tue Oct 12 17:25:44 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 17:25:44.487331 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba65ce35-2a1a-4bda-8e2b-4df54af1f85a None None] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:25:44.487528 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba65ce35-2a1a-4bda-8e2b-4df54af1f85a None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:25:44.487797 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba65ce35-2a1a-4bda-8e2b-4df54af1f85a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:25:44.505930 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.auth.core [None req-ba65ce35-2a1a-4bda-8e2b-4df54af1f85a None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 17:25:44.508092 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-ba65ce35-2a1a-4bda-8e2b-4df54af1f85a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:25:44.516864 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1264/2515] 10.222.0.58 () {58 vars in 957 bytes} [Tue Oct 12 17:25:44 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 17:25:44.521012 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda74e4e-1f13-4f0d-82d4-9e027fa0750a None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:25:44.531582 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda74e4e-1f13-4f0d-82d4-9e027fa0750a None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:25:44.536269 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238e4122-ae88-489a-b3ec-062105f90c09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:25:44.536917 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238e4122-ae88-489a-b3ec-062105f90c09 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:25:44.537203 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238e4122-ae88-489a-b3ec-062105f90c09 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:25:44.537480 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238e4122-ae88-489a-b3ec-062105f90c09 admin admin] PATH_INFO: `/v3/domains` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:25:44.538281 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238e4122-ae88-489a-b3ec-062105f90c09 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 17:25:44.538600 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238e4122-ae88-489a-b3ec-062105f90c09 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:25:44.540201 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238e4122-ae88-489a-b3ec-062105f90c09 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:25:44.551309 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1252/2516] 10.222.0.58 () {58 vars in 1152 bytes} [Tue Oct 12 17:25:44 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 17:25:44.555501 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba65ce35-2a1a-4bda-8e2b-4df54af1f85a None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:25:44.564451 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba65ce35-2a1a-4bda-8e2b-4df54af1f85a None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:25:44.569068 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5e5c46-e3f7-4bc9-aa26-ff81eef8696f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:25:44.569709 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5e5c46-e3f7-4bc9-aa26-ff81eef8696f admin admin] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:25:44.570529 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5e5c46-e3f7-4bc9-aa26-ff81eef8696f admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:25:44.570812 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5e5c46-e3f7-4bc9-aa26-ff81eef8696f admin admin] PATH_INFO: `/v3/projects` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:25:44.571517 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5e5c46-e3f7-4bc9-aa26-ff81eef8696f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:25:44.573436 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5e5c46-e3f7-4bc9-aa26-ff81eef8696f admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:25:44.601975 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1265/2517] 10.222.0.58 () {60 vars in 1152 bytes} [Tue Oct 12 17:25:44 2021] POST /identity/v3/projects => generated 379 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 17:25:44.603445 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238e4122-ae88-489a-b3ec-062105f90c09 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:25:44.613174 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238e4122-ae88-489a-b3ec-062105f90c09 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:25:44.667778 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e028b30c-79d5-4e39-9f05-21b67edd4eca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:25:44.668439 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e028b30c-79d5-4e39-9f05-21b67edd4eca admin admin] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:25:44.668727 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e028b30c-79d5-4e39-9f05-21b67edd4eca admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:25:44.669034 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e028b30c-79d5-4e39-9f05-21b67edd4eca admin admin] PATH_INFO: `/v3/users` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:25:44.669856 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e028b30c-79d5-4e39-9f05-21b67edd4eca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:25:44.671760 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e028b30c-79d5-4e39-9f05-21b67edd4eca admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:25:44.691009 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1253/2518] 10.222.0.58 () {60 vars in 1143 bytes} [Tue Oct 12 17:25:44 2021] POST /identity/v3/users => generated 290 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 17:25:44.695714 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5e5c46-e3f7-4bc9-aa26-ff81eef8696f admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:25:44.705741 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5e5c46-e3f7-4bc9-aa26-ff81eef8696f admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:25:44.710386 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5926cc50-6a48-45e7-96ec-bee4367f59bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:25:44.711065 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5926cc50-6a48-45e7-96ec-bee4367f59bc admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:25:44.711347 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5926cc50-6a48-45e7-96ec-bee4367f59bc admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:25:44.711620 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5926cc50-6a48-45e7-96ec-bee4367f59bc admin admin] PATH_INFO: `/v3/roles` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:25:44.712349 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5926cc50-6a48-45e7-96ec-bee4367f59bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:25:44.713948 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5926cc50-6a48-45e7-96ec-bee4367f59bc admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:25:44.723924 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1266/2519] 10.222.0.58 () {58 vars in 1121 bytes} [Tue Oct 12 17:25:44 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 17:25:44.727581 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e028b30c-79d5-4e39-9f05-21b67edd4eca admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:25:44.737183 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e028b30c-79d5-4e39-9f05-21b67edd4eca admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:25:44.742463 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b58feb-4aa8-470f-ae1b-484e2aa337e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:25:44.743060 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b58feb-4aa8-470f-ae1b-484e2aa337e2 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:25:44.743345 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b58feb-4aa8-470f-ae1b-484e2aa337e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:25:44.743619 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b58feb-4aa8-470f-ae1b-484e2aa337e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:25:44.744354 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b58feb-4aa8-470f-ae1b-484e2aa337e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:25:44.745943 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b58feb-4aa8-470f-ae1b-484e2aa337e2 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:25:44.755657 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1254/2520] 10.222.0.58 () {58 vars in 1121 bytes} [Tue Oct 12 17:25:44 2021] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 17:25:44.760062 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5926cc50-6a48-45e7-96ec-bee4367f59bc admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:25:44.769867 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5926cc50-6a48-45e7-96ec-bee4367f59bc admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:25:44.774944 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a44aa6-b8ec-4f3f-88c0-2e645cc0c033 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:25:44.775799 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a44aa6-b8ec-4f3f-88c0-2e645cc0c033 admin admin] REQUEST_METHOD: `PUT` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:25:44.776078 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a44aa6-b8ec-4f3f-88c0-2e645cc0c033 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:25:44.776530 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a44aa6-b8ec-4f3f-88c0-2e645cc0c033 admin admin] PATH_INFO: `/v3/projects/2fa2ebe640ce4614904e250b1f3e29ed/users/d3b168cfa89242c498e5cd63aa4babc1/roles/55ba49fe29884e64b57c3ad13188d554` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:25:44.793420 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a44aa6-b8ec-4f3f-88c0-2e645cc0c033 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2fa2ebe640ce4614904e250b1f3e29ed, user_id=d3b168cfa89242c498e5cd63aa4babc1, role_id=55ba49fe29884e64b57c3ad13188d554)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:25:44.796221 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a44aa6-b8ec-4f3f-88c0-2e645cc0c033 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:25:44.808684 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1267/2521] 10.222.0.58 () {60 vars in 1482 bytes} [Tue Oct 12 17:25:44 2021] PUT /identity/v3/projects/2fa2ebe640ce4614904e250b1f3e29ed/users/d3b168cfa89242c498e5cd63aa4babc1/roles/55ba49fe29884e64b57c3ad13188d554 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 17:25:44.818571 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b30a9d5-5902-4374-a3a1-607689106320 None None] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:25:44.818866 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b30a9d5-5902-4374-a3a1-607689106320 None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:25:44.819152 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b30a9d5-5902-4374-a3a1-607689106320 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:25:44.845131 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.auth.core [None req-6b30a9d5-5902-4374-a3a1-607689106320 None None] MFA Rules not processed for user `d3b168cfa89242c498e5cd63aa4babc1`. Rule list: `[]` (Enabled: `True`). {{(pid=85205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 17:25:44.846364 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-6b30a9d5-5902-4374-a3a1-607689106320 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:25:44.906998 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1255/2522] 10.222.0.58 () {58 vars in 957 bytes} [Tue Oct 12 17:25:44 2021] POST /identity/v3/auth/tokens => generated 3399 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 17:25:44.911548 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a44aa6-b8ec-4f3f-88c0-2e645cc0c033 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:25:44.970514 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a44aa6-b8ec-4f3f-88c0-2e645cc0c033 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:25:44.975155 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522ae2be-0c49-48fa-8241-6b0d2c98559f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:25:44.975804 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522ae2be-0c49-48fa-8241-6b0d2c98559f admin admin] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:25:44.976088 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522ae2be-0c49-48fa-8241-6b0d2c98559f admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:25:44.976900 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522ae2be-0c49-48fa-8241-6b0d2c98559f admin admin] PATH_INFO: `/v3/projects` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:25:44.977598 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522ae2be-0c49-48fa-8241-6b0d2c98559f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:25:44.979496 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522ae2be-0c49-48fa-8241-6b0d2c98559f admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:25:45.003930 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1268/2523] 10.222.0.58 () {60 vars in 1152 bytes} [Tue Oct 12 17:25:44 2021] POST /identity/v3/projects => generated 381 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 17:25:45.008773 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b30a9d5-5902-4374-a3a1-607689106320 None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:25:45.019107 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b30a9d5-5902-4374-a3a1-607689106320 None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:25:45.072297 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286e1319-a9e2-4237-8508-90acf58c0dbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:25:45.072956 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286e1319-a9e2-4237-8508-90acf58c0dbe admin admin] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:25:45.073243 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286e1319-a9e2-4237-8508-90acf58c0dbe admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:25:45.073601 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286e1319-a9e2-4237-8508-90acf58c0dbe admin admin] PATH_INFO: `/v3/users` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:25:45.074491 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286e1319-a9e2-4237-8508-90acf58c0dbe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:25:45.076490 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286e1319-a9e2-4237-8508-90acf58c0dbe admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:25:45.096446 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1256/2524] 10.222.0.58 () {60 vars in 1143 bytes} [Tue Oct 12 17:25:45 2021] POST /identity/v3/users => generated 297 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 17:25:45.099760 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522ae2be-0c49-48fa-8241-6b0d2c98559f admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:25:45.110455 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522ae2be-0c49-48fa-8241-6b0d2c98559f admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:25:45.115073 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d0c272-6d52-4e08-a2bd-84d1579a7104 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:25:45.115733 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d0c272-6d52-4e08-a2bd-84d1579a7104 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:25:45.116017 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d0c272-6d52-4e08-a2bd-84d1579a7104 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:25:45.116357 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d0c272-6d52-4e08-a2bd-84d1579a7104 admin admin] PATH_INFO: `/v3/roles` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:25:45.117681 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d0c272-6d52-4e08-a2bd-84d1579a7104 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:25:45.119320 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d0c272-6d52-4e08-a2bd-84d1579a7104 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:25:45.129947 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1269/2525] 10.222.0.58 () {58 vars in 1121 bytes} [Tue Oct 12 17:25:45 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 17:25:45.134365 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286e1319-a9e2-4237-8508-90acf58c0dbe admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:25:45.144103 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286e1319-a9e2-4237-8508-90acf58c0dbe admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:25:45.148738 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d20bbcf-5d63-488d-9a7a-9b1c1f9df079 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:25:45.149609 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d20bbcf-5d63-488d-9a7a-9b1c1f9df079 admin admin] REQUEST_METHOD: `PUT` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:25:45.149923 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d20bbcf-5d63-488d-9a7a-9b1c1f9df079 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:25:45.150205 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d20bbcf-5d63-488d-9a7a-9b1c1f9df079 admin admin] PATH_INFO: `/v3/projects/566ff3c822074105a335bde4b5594e6d/users/baccbcfaf5c940b3ac2a2b6ba30618c9/roles/610824e4f50f4fb8954610e98c1de784` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:25:45.166384 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d20bbcf-5d63-488d-9a7a-9b1c1f9df079 admin admin] RBAC: Authorizing `identity:create_grant(project_id=566ff3c822074105a335bde4b5594e6d, user_id=baccbcfaf5c940b3ac2a2b6ba30618c9, role_id=610824e4f50f4fb8954610e98c1de784)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:25:45.169017 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d20bbcf-5d63-488d-9a7a-9b1c1f9df079 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:25:45.182331 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1257/2526] 10.222.0.58 () {60 vars in 1482 bytes} [Tue Oct 12 17:25:45 2021] PUT /identity/v3/projects/566ff3c822074105a335bde4b5594e6d/users/baccbcfaf5c940b3ac2a2b6ba30618c9/roles/610824e4f50f4fb8954610e98c1de784 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 17:25:45.186170 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d0c272-6d52-4e08-a2bd-84d1579a7104 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:25:45.196562 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d0c272-6d52-4e08-a2bd-84d1579a7104 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:25:45.250727 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5defde-cbaf-4da5-ae21-190cdc4bca0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:25:45.251394 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5defde-cbaf-4da5-ae21-190cdc4bca0f admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:25:45.251682 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5defde-cbaf-4da5-ae21-190cdc4bca0f admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:25:45.251961 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5defde-cbaf-4da5-ae21-190cdc4bca0f admin admin] PATH_INFO: `/v3/roles` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:25:45.252698 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5defde-cbaf-4da5-ae21-190cdc4bca0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:25:45.254377 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5defde-cbaf-4da5-ae21-190cdc4bca0f admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:25:45.264490 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1270/2527] 10.222.0.58 () {58 vars in 1121 bytes} [Tue Oct 12 17:25:45 2021] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 17:25:45.268629 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d20bbcf-5d63-488d-9a7a-9b1c1f9df079 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:25:45.279750 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d20bbcf-5d63-488d-9a7a-9b1c1f9df079 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:25:45.284383 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e92f3aa-1b12-4a96-a75c-12b9564e81a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:25:45.285254 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e92f3aa-1b12-4a96-a75c-12b9564e81a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:25:45.285539 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e92f3aa-1b12-4a96-a75c-12b9564e81a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:25:45.285816 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e92f3aa-1b12-4a96-a75c-12b9564e81a8 admin admin] PATH_INFO: `/v3/projects/566ff3c822074105a335bde4b5594e6d/users/baccbcfaf5c940b3ac2a2b6ba30618c9/roles/610824e4f50f4fb8954610e98c1de784` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:25:45.287828 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e92f3aa-1b12-4a96-a75c-12b9564e81a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=566ff3c822074105a335bde4b5594e6d, user_id=baccbcfaf5c940b3ac2a2b6ba30618c9, role_id=610824e4f50f4fb8954610e98c1de784)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:25:45.290954 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e92f3aa-1b12-4a96-a75c-12b9564e81a8 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:25:45.302686 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1258/2528] 10.222.0.58 () {60 vars in 1482 bytes} [Tue Oct 12 17:25:45 2021] PUT /identity/v3/projects/566ff3c822074105a335bde4b5594e6d/users/baccbcfaf5c940b3ac2a2b6ba30618c9/roles/610824e4f50f4fb8954610e98c1de784 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 17:25:45.313739 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a567c6-37cc-4f80-a418-76e788182a93 None None] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:25:45.314062 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a567c6-37cc-4f80-a418-76e788182a93 None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:25:45.314346 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a567c6-37cc-4f80-a418-76e788182a93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:25:45.340834 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.auth.core [None req-69a567c6-37cc-4f80-a418-76e788182a93 None None] MFA Rules not processed for user `baccbcfaf5c940b3ac2a2b6ba30618c9`. Rule list: `[]` (Enabled: `True`). {{(pid=85204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 17:25:45.342074 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-69a567c6-37cc-4f80-a418-76e788182a93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:25:45.405489 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1271/2529] 10.222.0.58 () {58 vars in 957 bytes} [Tue Oct 12 17:25:45 2021] POST /identity/v3/auth/tokens => generated 3468 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 17:25:45.415559 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e92f3aa-1b12-4a96-a75c-12b9564e81a8 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:25:45.417546 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-3e92f3aa-1b12-4a96-a75c-12b9564e81a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:25:45.472194 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e92f3aa-1b12-4a96-a75c-12b9564e81a8 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:25:45.475858 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2def17ba-d30c-4a18-9105-7070bed9aee4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04704222b3d64a33a6c092fc641ccbb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:25:45.476496 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2def17ba-d30c-4a18-9105-7070bed9aee4 service cinder] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:25:45.476783 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2def17ba-d30c-4a18-9105-7070bed9aee4 service cinder] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:25:45.477064 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2def17ba-d30c-4a18-9105-7070bed9aee4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:25:45.485718 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2def17ba-d30c-4a18-9105-7070bed9aee4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:25:45.487158 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2def17ba-d30c-4a18-9105-7070bed9aee4 service cinder] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:25:45.496775 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1259/2530] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Oct 12 17:25:45 2021] GET /identity/v3/auth/tokens => generated 3468 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 17:25:45.819559 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a567c6-37cc-4f80-a418-76e788182a93 None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:25:45.880032 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a567c6-37cc-4f80-a418-76e788182a93 None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:25:45.885274 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd588d4-7b85-4190-ae6c-ce156d53ff59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:25:45.886159 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd588d4-7b85-4190-ae6c-ce156d53ff59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:25:45.886434 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd588d4-7b85-4190-ae6c-ce156d53ff59 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:25:45.886699 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd588d4-7b85-4190-ae6c-ce156d53ff59 admin admin] PATH_INFO: `/v3/users/d3b168cfa89242c498e5cd63aa4babc1` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:25:45.887875 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd588d4-7b85-4190-ae6c-ce156d53ff59 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d3b168cfa89242c498e5cd63aa4babc1)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:25:45.889746 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd588d4-7b85-4190-ae6c-ce156d53ff59 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:25:45.933802 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-4fd588d4-7b85-4190-ae6c-ce156d53ff59 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd3b168cfa89242c498e5cd63aa4babc1'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:25:45.945536 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-4fd588d4-7b85-4190-ae6c-ce156d53ff59 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd3b168cfa89242c498e5cd63aa4babc1'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:25:45.952387 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-4fd588d4-7b85-4190-ae6c-ce156d53ff59 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd3b168cfa89242c498e5cd63aa4babc1'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:25:45.959452 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-4fd588d4-7b85-4190-ae6c-ce156d53ff59 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd3b168cfa89242c498e5cd63aa4babc1'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:25:45.960196 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-4fd588d4-7b85-4190-ae6c-ce156d53ff59 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd3b168cfa89242c498e5cd63aa4babc1'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:25:45.966599 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1272/2531] 10.222.0.58 () {58 vars in 1223 bytes} [Tue Oct 12 17:25:45 2021] DELETE /identity/v3/users/d3b168cfa89242c498e5cd63aa4babc1 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 17:25:45.971281 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a691492a-8a5f-461d-bdd6-29cf0d02b034 None None] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:25:45.971577 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a691492a-8a5f-461d-bdd6-29cf0d02b034 None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:25:45.971858 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a691492a-8a5f-461d-bdd6-29cf0d02b034 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:25:45.989015 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.auth.core [None req-a691492a-8a5f-461d-bdd6-29cf0d02b034 None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 17:25:45.990286 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-a691492a-8a5f-461d-bdd6-29cf0d02b034 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:25:46.045500 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1260/2532] 10.222.0.58 () {58 vars in 957 bytes} [Tue Oct 12 17:25:45 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 17:25:46.055371 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd588d4-7b85-4190-ae6c-ce156d53ff59 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:25:46.056702 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-4fd588d4-7b85-4190-ae6c-ce156d53ff59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:25:46.111947 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd588d4-7b85-4190-ae6c-ce156d53ff59 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:25:46.115631 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875dd1a5-d5b0-4b6a-bc27-e72088484d62 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e65f6d0598e4c539134292b86fb43d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:25:46.116271 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875dd1a5-d5b0-4b6a-bc27-e72088484d62 service neutron] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:25:46.116553 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875dd1a5-d5b0-4b6a-bc27-e72088484d62 service neutron] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:25:46.117375 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875dd1a5-d5b0-4b6a-bc27-e72088484d62 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:25:46.126062 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875dd1a5-d5b0-4b6a-bc27-e72088484d62 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:25:46.127484 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875dd1a5-d5b0-4b6a-bc27-e72088484d62 service neutron] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:25:46.137346 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1273/2533] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Oct 12 17:25:46 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 17:25:46.390117 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a691492a-8a5f-461d-bdd6-29cf0d02b034 None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:25:46.391526 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-a691492a-8a5f-461d-bdd6-29cf0d02b034 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:25:46.403290 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a691492a-8a5f-461d-bdd6-29cf0d02b034 None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:25:46.408465 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43562e8-735b-4361-a698-25525541ede9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:25:46.409347 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43562e8-735b-4361-a698-25525541ede9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:25:46.409613 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43562e8-735b-4361-a698-25525541ede9 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:25:46.410148 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43562e8-735b-4361-a698-25525541ede9 admin admin] PATH_INFO: `/v3/projects/2fa2ebe640ce4614904e250b1f3e29ed` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:25:46.411447 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43562e8-735b-4361-a698-25525541ede9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2fa2ebe640ce4614904e250b1f3e29ed)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:25:46.413215 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43562e8-735b-4361-a698-25525541ede9 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:25:46.479324 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-e43562e8-735b-4361-a698-25525541ede9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2fa2ebe640ce4614904e250b1f3e29ed', 'request_id': 'req-e43562e8-735b-4361-a698-25525541ede9'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:25:46.484600 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-e43562e8-735b-4361-a698-25525541ede9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2fa2ebe640ce4614904e250b1f3e29ed', 'request_id': 'req-e43562e8-735b-4361-a698-25525541ede9'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:25:46.490566 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-e43562e8-735b-4361-a698-25525541ede9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2fa2ebe640ce4614904e250b1f3e29ed', 'request_id': 'req-e43562e8-735b-4361-a698-25525541ede9'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:25:46.503687 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-e43562e8-735b-4361-a698-25525541ede9 admin admin] The token cache is being invalidate because project 2fa2ebe640ce4614904e250b1f3e29ed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=85205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 17:25:46.503997 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-e43562e8-735b-4361-a698-25525541ede9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:25:46.504622 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-e43562e8-735b-4361-a698-25525541ede9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:25:46.506374 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1261/2534] 10.222.0.58 () {58 vars in 1232 bytes} [Tue Oct 12 17:25:46 2021] DELETE /identity/v3/projects/2fa2ebe640ce4614904e250b1f3e29ed => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 17:25:46.511567 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875dd1a5-d5b0-4b6a-bc27-e72088484d62 service neutron] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:25:46.521030 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875dd1a5-d5b0-4b6a-bc27-e72088484d62 service neutron] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:25:46.574980 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b31f095-3ff5-4dd8-848c-ed37e4deb78b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:25:46.575727 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b31f095-3ff5-4dd8-848c-ed37e4deb78b admin admin] REQUEST_METHOD: `DELETE` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:25:46.576012 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b31f095-3ff5-4dd8-848c-ed37e4deb78b admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:25:46.576278 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b31f095-3ff5-4dd8-848c-ed37e4deb78b admin admin] PATH_INFO: `/v3/users/baccbcfaf5c940b3ac2a2b6ba30618c9` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:25:46.577460 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b31f095-3ff5-4dd8-848c-ed37e4deb78b admin admin] RBAC: Authorizing `identity:delete_user(user_id=baccbcfaf5c940b3ac2a2b6ba30618c9)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:25:46.579387 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b31f095-3ff5-4dd8-848c-ed37e4deb78b admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:25:46.621638 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-5b31f095-3ff5-4dd8-848c-ed37e4deb78b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'baccbcfaf5c940b3ac2a2b6ba30618c9'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:25:46.633772 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-5b31f095-3ff5-4dd8-848c-ed37e4deb78b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'baccbcfaf5c940b3ac2a2b6ba30618c9'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:25:46.640600 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-5b31f095-3ff5-4dd8-848c-ed37e4deb78b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'baccbcfaf5c940b3ac2a2b6ba30618c9'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:25:46.647733 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-5b31f095-3ff5-4dd8-848c-ed37e4deb78b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'baccbcfaf5c940b3ac2a2b6ba30618c9'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:25:46.649009 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-5b31f095-3ff5-4dd8-848c-ed37e4deb78b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'baccbcfaf5c940b3ac2a2b6ba30618c9'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:25:46.654789 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1274/2535] 10.222.0.58 () {58 vars in 1223 bytes} [Tue Oct 12 17:25:46 2021] DELETE /identity/v3/users/baccbcfaf5c940b3ac2a2b6ba30618c9 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 17:25:46.915440 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43562e8-735b-4361-a698-25525541ede9 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:25:46.916936 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-e43562e8-735b-4361-a698-25525541ede9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:25:46.931765 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43562e8-735b-4361-a698-25525541ede9 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:25:46.985996 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88e42d9-a48f-40cc-a3a6-fca2da708def admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:25:46.986846 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88e42d9-a48f-40cc-a3a6-fca2da708def admin admin] REQUEST_METHOD: `DELETE` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:25:46.987126 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88e42d9-a48f-40cc-a3a6-fca2da708def admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:25:46.987396 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88e42d9-a48f-40cc-a3a6-fca2da708def admin admin] PATH_INFO: `/v3/projects/566ff3c822074105a335bde4b5594e6d` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:25:46.988575 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88e42d9-a48f-40cc-a3a6-fca2da708def admin admin] RBAC: Authorizing `identity:delete_project(project_id=566ff3c822074105a335bde4b5594e6d)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:25:46.990471 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88e42d9-a48f-40cc-a3a6-fca2da708def admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:25:47.036570 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-a88e42d9-a48f-40cc-a3a6-fca2da708def admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '566ff3c822074105a335bde4b5594e6d', 'request_id': 'req-a88e42d9-a48f-40cc-a3a6-fca2da708def'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:25:47.042193 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-a88e42d9-a48f-40cc-a3a6-fca2da708def admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '566ff3c822074105a335bde4b5594e6d', 'request_id': 'req-a88e42d9-a48f-40cc-a3a6-fca2da708def'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:25:47.048486 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-a88e42d9-a48f-40cc-a3a6-fca2da708def admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '566ff3c822074105a335bde4b5594e6d', 'request_id': 'req-a88e42d9-a48f-40cc-a3a6-fca2da708def'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:25:47.062658 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-a88e42d9-a48f-40cc-a3a6-fca2da708def admin admin] The token cache is being invalidate because project 566ff3c822074105a335bde4b5594e6d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=85205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 17:25:47.063038 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-a88e42d9-a48f-40cc-a3a6-fca2da708def admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:25:47.063725 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-a88e42d9-a48f-40cc-a3a6-fca2da708def admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:25:47.065702 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1262/2536] 10.222.0.58 () {58 vars in 1232 bytes} [Tue Oct 12 17:25:46 2021] DELETE /identity/v3/projects/566ff3c822074105a335bde4b5594e6d => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 17:25:47.071946 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47079d81-3cb8-47e3-a4cb-60ef208d7320 None None] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:25:47.072232 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47079d81-3cb8-47e3-a4cb-60ef208d7320 None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:25:47.072501 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47079d81-3cb8-47e3-a4cb-60ef208d7320 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:25:47.100799 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.auth.core [None req-47079d81-3cb8-47e3-a4cb-60ef208d7320 None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 17:25:47.102442 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-47079d81-3cb8-47e3-a4cb-60ef208d7320 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:25:47.160652 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1275/2537] 10.222.0.58 () {58 vars in 957 bytes} [Tue Oct 12 17:25:47 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 17:25:47.168554 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd1e1f3-a44e-4fe2-bfed-ce66f7eeb6f2 None None] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:25:47.168850 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd1e1f3-a44e-4fe2-bfed-ce66f7eeb6f2 None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:25:47.169131 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd1e1f3-a44e-4fe2-bfed-ce66f7eeb6f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:25:47.187691 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.auth.core [None req-0dd1e1f3-a44e-4fe2-bfed-ce66f7eeb6f2 None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 17:25:47.188899 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-0dd1e1f3-a44e-4fe2-bfed-ce66f7eeb6f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:25:47.200733 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1263/2538] 10.222.0.58 () {58 vars in 957 bytes} [Tue Oct 12 17:25:47 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 17:25:47.201722 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47079d81-3cb8-47e3-a4cb-60ef208d7320 None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:25:47.212688 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47079d81-3cb8-47e3-a4cb-60ef208d7320 None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:25:47.224049 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd4b68b-bbfd-474f-b451-11b7e7882122 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:25:47.224935 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd4b68b-bbfd-474f-b451-11b7e7882122 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:25:47.225242 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd4b68b-bbfd-474f-b451-11b7e7882122 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:25:47.225474 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd4b68b-bbfd-474f-b451-11b7e7882122 admin admin] PATH_INFO: `/v3/domains` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:25:47.226808 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd4b68b-bbfd-474f-b451-11b7e7882122 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 17:25:47.227118 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd4b68b-bbfd-474f-b451-11b7e7882122 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:25:47.228737 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd4b68b-bbfd-474f-b451-11b7e7882122 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:25:47.246004 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1276/2539] 10.222.0.58 () {58 vars in 1152 bytes} [Tue Oct 12 17:25:47 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 17:25:47.247337 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd1e1f3-a44e-4fe2-bfed-ce66f7eeb6f2 None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:25:47.257643 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd1e1f3-a44e-4fe2-bfed-ce66f7eeb6f2 None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:25:47.262395 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946b14bf-9e1c-4c78-ad7b-d56849bbfe01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:25:47.263049 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946b14bf-9e1c-4c78-ad7b-d56849bbfe01 admin admin] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:25:47.263332 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946b14bf-9e1c-4c78-ad7b-d56849bbfe01 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:25:47.263608 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946b14bf-9e1c-4c78-ad7b-d56849bbfe01 admin admin] PATH_INFO: `/v3/projects` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:25:47.264314 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946b14bf-9e1c-4c78-ad7b-d56849bbfe01 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:25:47.266242 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946b14bf-9e1c-4c78-ad7b-d56849bbfe01 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:25:47.291625 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1264/2540] 10.222.0.58 () {60 vars in 1152 bytes} [Tue Oct 12 17:25:47 2021] POST /identity/v3/projects => generated 377 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 17:25:47.295753 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd4b68b-bbfd-474f-b451-11b7e7882122 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:25:47.306202 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd4b68b-bbfd-474f-b451-11b7e7882122 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:25:47.366478 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007c1af6-0700-46bb-b489-9ca98edc621b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:25:47.367600 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007c1af6-0700-46bb-b489-9ca98edc621b admin admin] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:25:47.367878 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007c1af6-0700-46bb-b489-9ca98edc621b admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:25:47.368147 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007c1af6-0700-46bb-b489-9ca98edc621b admin admin] PATH_INFO: `/v3/users` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:25:47.368846 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007c1af6-0700-46bb-b489-9ca98edc621b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:25:47.370752 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007c1af6-0700-46bb-b489-9ca98edc621b admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:25:47.390307 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1277/2541] 10.222.0.58 () {60 vars in 1143 bytes} [Tue Oct 12 17:25:47 2021] POST /identity/v3/users => generated 289 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 17:25:47.394592 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946b14bf-9e1c-4c78-ad7b-d56849bbfe01 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:25:47.405143 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946b14bf-9e1c-4c78-ad7b-d56849bbfe01 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:25:47.409862 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3244d9c5-83c9-421c-8da0-5b8a6e9a6c47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:25:47.410540 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3244d9c5-83c9-421c-8da0-5b8a6e9a6c47 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:25:47.410824 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3244d9c5-83c9-421c-8da0-5b8a6e9a6c47 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:25:47.411099 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3244d9c5-83c9-421c-8da0-5b8a6e9a6c47 admin admin] PATH_INFO: `/v3/roles` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:25:47.411836 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3244d9c5-83c9-421c-8da0-5b8a6e9a6c47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:25:47.413394 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3244d9c5-83c9-421c-8da0-5b8a6e9a6c47 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:25:47.423410 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1265/2542] 10.222.0.58 () {58 vars in 1121 bytes} [Tue Oct 12 17:25:47 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 17:25:47.426983 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007c1af6-0700-46bb-b489-9ca98edc621b admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:25:47.436446 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007c1af6-0700-46bb-b489-9ca98edc621b admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:25:47.440985 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f84ad42-245d-4331-8e76-c2bd8f3c0cac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:25:47.441617 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f84ad42-245d-4331-8e76-c2bd8f3c0cac admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:25:47.441928 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f84ad42-245d-4331-8e76-c2bd8f3c0cac admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:25:47.442204 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f84ad42-245d-4331-8e76-c2bd8f3c0cac admin admin] PATH_INFO: `/v3/roles` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:25:47.442929 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f84ad42-245d-4331-8e76-c2bd8f3c0cac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:25:47.444472 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f84ad42-245d-4331-8e76-c2bd8f3c0cac admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:25:47.454393 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1278/2543] 10.222.0.58 () {58 vars in 1121 bytes} [Tue Oct 12 17:25:47 2021] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 17:25:47.458047 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3244d9c5-83c9-421c-8da0-5b8a6e9a6c47 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:25:47.468116 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3244d9c5-83c9-421c-8da0-5b8a6e9a6c47 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:25:47.472784 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcef374-eaef-49b6-b083-e7d04d803d38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:25:47.473635 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcef374-eaef-49b6-b083-e7d04d803d38 admin admin] REQUEST_METHOD: `PUT` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:25:47.473952 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcef374-eaef-49b6-b083-e7d04d803d38 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:25:47.474234 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcef374-eaef-49b6-b083-e7d04d803d38 admin admin] PATH_INFO: `/v3/projects/3aa1f8fd23394390976036c7772bdf9c/users/7da1fea5cd334132ae7ac82a5f290499/roles/55ba49fe29884e64b57c3ad13188d554` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:25:47.488595 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcef374-eaef-49b6-b083-e7d04d803d38 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3aa1f8fd23394390976036c7772bdf9c, user_id=7da1fea5cd334132ae7ac82a5f290499, role_id=55ba49fe29884e64b57c3ad13188d554)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:25:47.491274 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcef374-eaef-49b6-b083-e7d04d803d38 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:25:47.503840 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1266/2544] 10.222.0.58 () {60 vars in 1482 bytes} [Tue Oct 12 17:25:47 2021] PUT /identity/v3/projects/3aa1f8fd23394390976036c7772bdf9c/users/7da1fea5cd334132ae7ac82a5f290499/roles/55ba49fe29884e64b57c3ad13188d554 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 17:25:47.515062 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e423eed-8447-482a-8bb7-be4c099a7036 None None] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:25:47.515552 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e423eed-8447-482a-8bb7-be4c099a7036 None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:25:47.515653 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e423eed-8447-482a-8bb7-be4c099a7036 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:25:47.541386 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.auth.core [None req-5e423eed-8447-482a-8bb7-be4c099a7036 None None] MFA Rules not processed for user `7da1fea5cd334132ae7ac82a5f290499`. Rule list: `[]` (Enabled: `True`). {{(pid=85204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 17:25:47.542626 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-5e423eed-8447-482a-8bb7-be4c099a7036 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:25:47.602976 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1279/2545] 10.222.0.58 () {58 vars in 957 bytes} [Tue Oct 12 17:25:47 2021] POST /identity/v3/auth/tokens => generated 3397 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 17:25:47.607426 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcef374-eaef-49b6-b083-e7d04d803d38 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:25:47.666477 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcef374-eaef-49b6-b083-e7d04d803d38 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:25:47.671096 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0cacc3-7fbb-40b0-8932-b4e36f5d2dbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:25:47.671745 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0cacc3-7fbb-40b0-8932-b4e36f5d2dbe admin admin] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:25:47.672033 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0cacc3-7fbb-40b0-8932-b4e36f5d2dbe admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:25:47.672311 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0cacc3-7fbb-40b0-8932-b4e36f5d2dbe admin admin] PATH_INFO: `/v3/projects` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:25:47.673042 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0cacc3-7fbb-40b0-8932-b4e36f5d2dbe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:25:47.674982 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0cacc3-7fbb-40b0-8932-b4e36f5d2dbe admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:25:47.699585 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1267/2546] 10.222.0.58 () {60 vars in 1152 bytes} [Tue Oct 12 17:25:47 2021] POST /identity/v3/projects => generated 375 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 17:25:47.703521 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e423eed-8447-482a-8bb7-be4c099a7036 None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:25:47.714226 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e423eed-8447-482a-8bb7-be4c099a7036 None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:25:47.769039 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078acb71-17de-46f1-9cb0-2451da313348 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:25:47.769713 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078acb71-17de-46f1-9cb0-2451da313348 admin admin] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:25:47.770036 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078acb71-17de-46f1-9cb0-2451da313348 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:25:47.770314 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078acb71-17de-46f1-9cb0-2451da313348 admin admin] PATH_INFO: `/v3/users` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:25:47.771018 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078acb71-17de-46f1-9cb0-2451da313348 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:25:47.772897 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078acb71-17de-46f1-9cb0-2451da313348 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:25:47.792071 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1280/2547] 10.222.0.58 () {60 vars in 1143 bytes} [Tue Oct 12 17:25:47 2021] POST /identity/v3/users => generated 288 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 17:25:47.795764 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0cacc3-7fbb-40b0-8932-b4e36f5d2dbe admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:25:47.806183 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0cacc3-7fbb-40b0-8932-b4e36f5d2dbe admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:25:47.810867 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026a7aee-4a15-421a-ab22-c3955354ba1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:25:47.811592 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026a7aee-4a15-421a-ab22-c3955354ba1e admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:25:47.811779 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026a7aee-4a15-421a-ab22-c3955354ba1e admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:25:47.812057 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026a7aee-4a15-421a-ab22-c3955354ba1e admin admin] PATH_INFO: `/v3/roles` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:25:47.812792 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026a7aee-4a15-421a-ab22-c3955354ba1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:25:47.814399 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026a7aee-4a15-421a-ab22-c3955354ba1e admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:25:47.825252 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1268/2548] 10.222.0.58 () {58 vars in 1121 bytes} [Tue Oct 12 17:25:47 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 17:25:47.829073 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078acb71-17de-46f1-9cb0-2451da313348 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:25:47.838792 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078acb71-17de-46f1-9cb0-2451da313348 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:25:47.843485 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c42653-1da0-4ab8-8239-8a7eaaca1aab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:25:47.844135 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c42653-1da0-4ab8-8239-8a7eaaca1aab admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:25:47.844420 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c42653-1da0-4ab8-8239-8a7eaaca1aab admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:25:47.844698 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c42653-1da0-4ab8-8239-8a7eaaca1aab admin admin] PATH_INFO: `/v3/roles` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:25:47.845463 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c42653-1da0-4ab8-8239-8a7eaaca1aab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:25:47.847073 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c42653-1da0-4ab8-8239-8a7eaaca1aab admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:25:47.856577 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1281/2549] 10.222.0.58 () {58 vars in 1121 bytes} [Tue Oct 12 17:25:47 2021] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 17:25:47.860163 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026a7aee-4a15-421a-ab22-c3955354ba1e admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:25:47.870340 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026a7aee-4a15-421a-ab22-c3955354ba1e admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:25:47.874931 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b0c7e4-6aee-443d-aa82-e8dbe5f9420c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:25:47.875785 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b0c7e4-6aee-443d-aa82-e8dbe5f9420c admin admin] REQUEST_METHOD: `PUT` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:25:47.876062 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b0c7e4-6aee-443d-aa82-e8dbe5f9420c admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:25:47.876334 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b0c7e4-6aee-443d-aa82-e8dbe5f9420c admin admin] PATH_INFO: `/v3/projects/65cf537a1fba4554baad3f91452cdc4b/users/01d8f9770cbe4a16904dc3f41546672a/roles/55ba49fe29884e64b57c3ad13188d554` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:25:47.892618 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b0c7e4-6aee-443d-aa82-e8dbe5f9420c admin admin] RBAC: Authorizing `identity:create_grant(project_id=65cf537a1fba4554baad3f91452cdc4b, user_id=01d8f9770cbe4a16904dc3f41546672a, role_id=55ba49fe29884e64b57c3ad13188d554)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:25:47.895223 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b0c7e4-6aee-443d-aa82-e8dbe5f9420c admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:25:47.907823 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1269/2550] 10.222.0.58 () {60 vars in 1482 bytes} [Tue Oct 12 17:25:47 2021] PUT /identity/v3/projects/65cf537a1fba4554baad3f91452cdc4b/users/01d8f9770cbe4a16904dc3f41546672a/roles/55ba49fe29884e64b57c3ad13188d554 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 17:25:47.918934 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae25b37d-f8b6-4ddd-ab05-2828271911a5 None None] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:25:47.919165 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae25b37d-f8b6-4ddd-ab05-2828271911a5 None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:25:47.919447 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae25b37d-f8b6-4ddd-ab05-2828271911a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:25:47.946214 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.auth.core [None req-ae25b37d-f8b6-4ddd-ab05-2828271911a5 None None] MFA Rules not processed for user `01d8f9770cbe4a16904dc3f41546672a`. Rule list: `[]` (Enabled: `True`). {{(pid=85204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 17:25:47.947448 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-ae25b37d-f8b6-4ddd-ab05-2828271911a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:25:48.008216 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1282/2551] 10.222.0.58 () {58 vars in 957 bytes} [Tue Oct 12 17:25:47 2021] POST /identity/v3/auth/tokens => generated 3395 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 17:25:48.012556 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b0c7e4-6aee-443d-aa82-e8dbe5f9420c admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:25:48.069526 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b0c7e4-6aee-443d-aa82-e8dbe5f9420c admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:25:48.074128 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35aae4d-f31c-4f1e-9857-64b0b19a86c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:25:48.074769 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35aae4d-f31c-4f1e-9857-64b0b19a86c6 admin admin] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:25:48.075049 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35aae4d-f31c-4f1e-9857-64b0b19a86c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:25:48.075321 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35aae4d-f31c-4f1e-9857-64b0b19a86c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:25:48.076014 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35aae4d-f31c-4f1e-9857-64b0b19a86c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:25:48.077960 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35aae4d-f31c-4f1e-9857-64b0b19a86c6 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:25:48.100988 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1270/2552] 10.222.0.58 () {60 vars in 1152 bytes} [Tue Oct 12 17:25:48 2021] POST /identity/v3/projects => generated 375 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 17:25:48.105457 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae25b37d-f8b6-4ddd-ab05-2828271911a5 None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:25:48.115963 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae25b37d-f8b6-4ddd-ab05-2828271911a5 None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:25:48.170535 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ad2030-cfcc-4c21-9d58-cbcfc3c9c3ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:25:48.171131 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ad2030-cfcc-4c21-9d58-cbcfc3c9c3ff admin admin] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:25:48.171417 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ad2030-cfcc-4c21-9d58-cbcfc3c9c3ff admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:25:48.171693 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ad2030-cfcc-4c21-9d58-cbcfc3c9c3ff admin admin] PATH_INFO: `/v3/users` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:25:48.172399 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ad2030-cfcc-4c21-9d58-cbcfc3c9c3ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:25:48.174318 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ad2030-cfcc-4c21-9d58-cbcfc3c9c3ff admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:25:48.193343 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1283/2553] 10.222.0.58 () {60 vars in 1143 bytes} [Tue Oct 12 17:25:48 2021] POST /identity/v3/users => generated 294 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 17:25:48.197248 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35aae4d-f31c-4f1e-9857-64b0b19a86c6 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:25:48.207266 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35aae4d-f31c-4f1e-9857-64b0b19a86c6 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:25:48.211897 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c22daea-bf0f-42ef-b0b7-a5934cf71d0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:25:48.212544 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c22daea-bf0f-42ef-b0b7-a5934cf71d0d admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:25:48.212824 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c22daea-bf0f-42ef-b0b7-a5934cf71d0d admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:25:48.213096 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c22daea-bf0f-42ef-b0b7-a5934cf71d0d admin admin] PATH_INFO: `/v3/roles` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:25:48.213852 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c22daea-bf0f-42ef-b0b7-a5934cf71d0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:25:48.215449 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c22daea-bf0f-42ef-b0b7-a5934cf71d0d admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:25:48.225794 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1271/2554] 10.222.0.58 () {58 vars in 1121 bytes} [Tue Oct 12 17:25:48 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 17:25:48.230120 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ad2030-cfcc-4c21-9d58-cbcfc3c9c3ff admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:25:48.239779 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ad2030-cfcc-4c21-9d58-cbcfc3c9c3ff admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:25:48.245016 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f3e188-4254-4823-94ac-3a34e2d5550c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:25:48.245892 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f3e188-4254-4823-94ac-3a34e2d5550c admin admin] REQUEST_METHOD: `PUT` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:25:48.246190 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f3e188-4254-4823-94ac-3a34e2d5550c admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:25:48.246469 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f3e188-4254-4823-94ac-3a34e2d5550c admin admin] PATH_INFO: `/v3/projects/96ec391c0bb14e388fdf4c1ccff0a324/users/c987e8d3148f4fcba00b50623bfaeea9/roles/610824e4f50f4fb8954610e98c1de784` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:25:48.260910 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f3e188-4254-4823-94ac-3a34e2d5550c admin admin] RBAC: Authorizing `identity:create_grant(project_id=96ec391c0bb14e388fdf4c1ccff0a324, user_id=c987e8d3148f4fcba00b50623bfaeea9, role_id=610824e4f50f4fb8954610e98c1de784)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:25:48.263726 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f3e188-4254-4823-94ac-3a34e2d5550c admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:25:48.276261 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1284/2555] 10.222.0.58 () {60 vars in 1482 bytes} [Tue Oct 12 17:25:48 2021] PUT /identity/v3/projects/96ec391c0bb14e388fdf4c1ccff0a324/users/c987e8d3148f4fcba00b50623bfaeea9/roles/610824e4f50f4fb8954610e98c1de784 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 17:25:48.280255 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c22daea-bf0f-42ef-b0b7-a5934cf71d0d admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:25:48.290697 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c22daea-bf0f-42ef-b0b7-a5934cf71d0d admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:25:48.344150 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd10e108-7f12-4e5f-965a-c2e6b734dd72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:25:48.344808 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd10e108-7f12-4e5f-965a-c2e6b734dd72 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:25:48.345091 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd10e108-7f12-4e5f-965a-c2e6b734dd72 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:25:48.345364 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd10e108-7f12-4e5f-965a-c2e6b734dd72 admin admin] PATH_INFO: `/v3/roles` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:25:48.346239 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd10e108-7f12-4e5f-965a-c2e6b734dd72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:25:48.347806 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd10e108-7f12-4e5f-965a-c2e6b734dd72 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:25:48.357675 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1272/2556] 10.222.0.58 () {58 vars in 1121 bytes} [Tue Oct 12 17:25:48 2021] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 17:25:48.361713 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f3e188-4254-4823-94ac-3a34e2d5550c admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:25:48.371814 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f3e188-4254-4823-94ac-3a34e2d5550c admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:25:48.376446 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0082884-e54a-45df-9cac-227d8a5fecca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:25:48.377313 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0082884-e54a-45df-9cac-227d8a5fecca admin admin] REQUEST_METHOD: `PUT` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:25:48.377593 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0082884-e54a-45df-9cac-227d8a5fecca admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:25:48.377864 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0082884-e54a-45df-9cac-227d8a5fecca admin admin] PATH_INFO: `/v3/projects/96ec391c0bb14e388fdf4c1ccff0a324/users/c987e8d3148f4fcba00b50623bfaeea9/roles/610824e4f50f4fb8954610e98c1de784` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:25:48.379856 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0082884-e54a-45df-9cac-227d8a5fecca admin admin] RBAC: Authorizing `identity:create_grant(project_id=96ec391c0bb14e388fdf4c1ccff0a324, user_id=c987e8d3148f4fcba00b50623bfaeea9, role_id=610824e4f50f4fb8954610e98c1de784)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:25:48.382761 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0082884-e54a-45df-9cac-227d8a5fecca admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:25:48.392596 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1285/2557] 10.222.0.58 () {60 vars in 1482 bytes} [Tue Oct 12 17:25:48 2021] PUT /identity/v3/projects/96ec391c0bb14e388fdf4c1ccff0a324/users/c987e8d3148f4fcba00b50623bfaeea9/roles/610824e4f50f4fb8954610e98c1de784 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 17:25:48.402692 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18920ecd-6be2-44d4-aca9-43dc44b580a0 None None] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:25:48.402984 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18920ecd-6be2-44d4-aca9-43dc44b580a0 None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:25:48.403264 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18920ecd-6be2-44d4-aca9-43dc44b580a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:25:48.428526 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.auth.core [None req-18920ecd-6be2-44d4-aca9-43dc44b580a0 None None] MFA Rules not processed for user `c987e8d3148f4fcba00b50623bfaeea9`. Rule list: `[]` (Enabled: `True`). {{(pid=85205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 17:25:48.429714 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-18920ecd-6be2-44d4-aca9-43dc44b580a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:25:48.492965 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1273/2558] 10.222.0.58 () {58 vars in 957 bytes} [Tue Oct 12 17:25:48 2021] POST /identity/v3/auth/tokens => generated 3462 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 17:25:48.503172 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0082884-e54a-45df-9cac-227d8a5fecca admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:25:48.504896 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-b0082884-e54a-45df-9cac-227d8a5fecca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:25:48.559922 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0082884-e54a-45df-9cac-227d8a5fecca admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:25:48.563608 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc0cbf1-e8e4-4c56-bc3d-53e455c31c02 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04704222b3d64a33a6c092fc641ccbb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:25:48.564246 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc0cbf1-e8e4-4c56-bc3d-53e455c31c02 service cinder] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:25:48.564535 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc0cbf1-e8e4-4c56-bc3d-53e455c31c02 service cinder] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:25:48.564810 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc0cbf1-e8e4-4c56-bc3d-53e455c31c02 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:25:48.617685 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc0cbf1-e8e4-4c56-bc3d-53e455c31c02 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:25:48.619135 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc0cbf1-e8e4-4c56-bc3d-53e455c31c02 service cinder] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:25:48.627913 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1286/2559] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Oct 12 17:25:48 2021] GET /identity/v3/auth/tokens => generated 3397 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 17:25:50.083077 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18920ecd-6be2-44d4-aca9-43dc44b580a0 None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:25:50.084457 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-18920ecd-6be2-44d4-aca9-43dc44b580a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:25:50.095880 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18920ecd-6be2-44d4-aca9-43dc44b580a0 None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:25:50.099681 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ef4132-f230-4f83-a8d2-0777b61dcf3f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04704222b3d64a33a6c092fc641ccbb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:25:50.100315 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ef4132-f230-4f83-a8d2-0777b61dcf3f service cinder] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:25:50.100598 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ef4132-f230-4f83-a8d2-0777b61dcf3f service cinder] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:25:50.100873 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ef4132-f230-4f83-a8d2-0777b61dcf3f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:25:50.153993 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ef4132-f230-4f83-a8d2-0777b61dcf3f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:25:50.155390 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ef4132-f230-4f83-a8d2-0777b61dcf3f service cinder] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:25:50.163828 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1274/2560] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Oct 12 17:25:50 2021] GET /identity/v3/auth/tokens => generated 3395 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 17:25:50.642844 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc0cbf1-e8e4-4c56-bc3d-53e455c31c02 service cinder] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:25:50.651726 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc0cbf1-e8e4-4c56-bc3d-53e455c31c02 service cinder] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:25:50.655301 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b87bbb-8dd9-4ce7-a937-dcb6243680df service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04704222b3d64a33a6c092fc641ccbb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:25:50.655931 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b87bbb-8dd9-4ce7-a937-dcb6243680df service cinder] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:25:50.656209 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b87bbb-8dd9-4ce7-a937-dcb6243680df service cinder] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:25:50.656480 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b87bbb-8dd9-4ce7-a937-dcb6243680df service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:25:50.665186 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b87bbb-8dd9-4ce7-a937-dcb6243680df service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:25:50.666628 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b87bbb-8dd9-4ce7-a937-dcb6243680df service cinder] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:25:50.675678 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1287/2561] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Oct 12 17:25:50 2021] GET /identity/v3/auth/tokens => generated 3462 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 17:25:54.452092 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ef4132-f230-4f83-a8d2-0777b61dcf3f service cinder] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:25:54.510858 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ef4132-f230-4f83-a8d2-0777b61dcf3f service cinder] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:25:54.515424 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c038a90b-fc62-4716-932e-b38511179c08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:25:54.516273 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c038a90b-fc62-4716-932e-b38511179c08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:25:54.516563 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c038a90b-fc62-4716-932e-b38511179c08 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:25:54.516838 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c038a90b-fc62-4716-932e-b38511179c08 admin admin] PATH_INFO: `/v3/users/7da1fea5cd334132ae7ac82a5f290499` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:25:54.518053 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c038a90b-fc62-4716-932e-b38511179c08 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7da1fea5cd334132ae7ac82a5f290499)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:25:54.519942 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c038a90b-fc62-4716-932e-b38511179c08 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:25:54.565103 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-c038a90b-fc62-4716-932e-b38511179c08 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7da1fea5cd334132ae7ac82a5f290499'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:25:54.577165 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-c038a90b-fc62-4716-932e-b38511179c08 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7da1fea5cd334132ae7ac82a5f290499'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:25:54.583379 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-c038a90b-fc62-4716-932e-b38511179c08 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7da1fea5cd334132ae7ac82a5f290499'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:25:54.591435 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-c038a90b-fc62-4716-932e-b38511179c08 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7da1fea5cd334132ae7ac82a5f290499'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:25:54.592076 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-c038a90b-fc62-4716-932e-b38511179c08 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7da1fea5cd334132ae7ac82a5f290499'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:25:54.597782 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1275/2562] 10.222.0.58 () {58 vars in 1223 bytes} [Tue Oct 12 17:25:54 2021] DELETE /identity/v3/users/7da1fea5cd334132ae7ac82a5f290499 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 17:25:54.602271 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e467b305-26e1-4df3-abb0-9fd2fde0d58e None None] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:25:54.602733 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e467b305-26e1-4df3-abb0-9fd2fde0d58e None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:25:54.602850 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e467b305-26e1-4df3-abb0-9fd2fde0d58e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:25:54.620102 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.auth.core [None req-e467b305-26e1-4df3-abb0-9fd2fde0d58e None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 17:25:54.621330 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-e467b305-26e1-4df3-abb0-9fd2fde0d58e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:25:54.675221 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1288/2563] 10.222.0.58 () {58 vars in 957 bytes} [Tue Oct 12 17:25:54 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 17:25:54.685415 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c038a90b-fc62-4716-932e-b38511179c08 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:25:54.686913 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-c038a90b-fc62-4716-932e-b38511179c08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:25:54.742861 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c038a90b-fc62-4716-932e-b38511179c08 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:25:54.746628 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49070f20-5f68-4391-9f03-ccb5d050602f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e65f6d0598e4c539134292b86fb43d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:25:54.747280 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49070f20-5f68-4391-9f03-ccb5d050602f service neutron] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:25:54.747591 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49070f20-5f68-4391-9f03-ccb5d050602f service neutron] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:25:54.747871 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49070f20-5f68-4391-9f03-ccb5d050602f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:25:54.756959 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49070f20-5f68-4391-9f03-ccb5d050602f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:25:54.758657 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49070f20-5f68-4391-9f03-ccb5d050602f service neutron] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:25:54.767920 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1276/2564] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Oct 12 17:25:54 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 12 17:25:55.018746 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e467b305-26e1-4df3-abb0-9fd2fde0d58e None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:25:55.020306 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-e467b305-26e1-4df3-abb0-9fd2fde0d58e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:25:55.035862 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e467b305-26e1-4df3-abb0-9fd2fde0d58e None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:25:55.042112 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33fa06c-a53e-47eb-ac43-52d50589f2cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:25:55.043010 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33fa06c-a53e-47eb-ac43-52d50589f2cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:25:55.043351 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33fa06c-a53e-47eb-ac43-52d50589f2cf admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:25:55.043506 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33fa06c-a53e-47eb-ac43-52d50589f2cf admin admin] PATH_INFO: `/v3/projects/3aa1f8fd23394390976036c7772bdf9c` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:25:55.044737 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33fa06c-a53e-47eb-ac43-52d50589f2cf admin admin] RBAC: Authorizing `identity:delete_project(project_id=3aa1f8fd23394390976036c7772bdf9c)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:25:55.046748 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33fa06c-a53e-47eb-ac43-52d50589f2cf admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:25:55.093035 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-e33fa06c-a53e-47eb-ac43-52d50589f2cf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3aa1f8fd23394390976036c7772bdf9c', 'request_id': 'req-e33fa06c-a53e-47eb-ac43-52d50589f2cf'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:25:55.098289 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-e33fa06c-a53e-47eb-ac43-52d50589f2cf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3aa1f8fd23394390976036c7772bdf9c', 'request_id': 'req-e33fa06c-a53e-47eb-ac43-52d50589f2cf'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:25:55.104754 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-e33fa06c-a53e-47eb-ac43-52d50589f2cf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3aa1f8fd23394390976036c7772bdf9c', 'request_id': 'req-e33fa06c-a53e-47eb-ac43-52d50589f2cf'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:25:55.116360 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-e33fa06c-a53e-47eb-ac43-52d50589f2cf admin admin] The token cache is being invalidate because project 3aa1f8fd23394390976036c7772bdf9c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=85204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 17:25:55.116640 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-e33fa06c-a53e-47eb-ac43-52d50589f2cf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:25:55.117293 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-e33fa06c-a53e-47eb-ac43-52d50589f2cf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:25:55.118891 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1289/2565] 10.222.0.58 () {58 vars in 1232 bytes} [Tue Oct 12 17:25:55 2021] DELETE /identity/v3/projects/3aa1f8fd23394390976036c7772bdf9c => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 17:25:55.123013 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49070f20-5f68-4391-9f03-ccb5d050602f service neutron] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:25:55.132938 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49070f20-5f68-4391-9f03-ccb5d050602f service neutron] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:25:55.186388 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0cd248-7823-4693-a3a0-bd79f743eafe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:25:55.187338 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0cd248-7823-4693-a3a0-bd79f743eafe admin admin] REQUEST_METHOD: `DELETE` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:25:55.187556 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0cd248-7823-4693-a3a0-bd79f743eafe admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:25:55.187881 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0cd248-7823-4693-a3a0-bd79f743eafe admin admin] PATH_INFO: `/v3/users/01d8f9770cbe4a16904dc3f41546672a` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:25:55.189028 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0cd248-7823-4693-a3a0-bd79f743eafe admin admin] RBAC: Authorizing `identity:delete_user(user_id=01d8f9770cbe4a16904dc3f41546672a)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:25:55.190948 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0cd248-7823-4693-a3a0-bd79f743eafe admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:25:55.246515 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-8c0cd248-7823-4693-a3a0-bd79f743eafe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '01d8f9770cbe4a16904dc3f41546672a'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:25:55.258749 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-8c0cd248-7823-4693-a3a0-bd79f743eafe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '01d8f9770cbe4a16904dc3f41546672a'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:25:55.265791 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-8c0cd248-7823-4693-a3a0-bd79f743eafe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '01d8f9770cbe4a16904dc3f41546672a'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:25:55.272233 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-8c0cd248-7823-4693-a3a0-bd79f743eafe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '01d8f9770cbe4a16904dc3f41546672a'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:25:55.272853 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-8c0cd248-7823-4693-a3a0-bd79f743eafe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '01d8f9770cbe4a16904dc3f41546672a'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:25:55.279301 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1277/2566] 10.222.0.58 () {58 vars in 1223 bytes} [Tue Oct 12 17:25:55 2021] DELETE /identity/v3/users/01d8f9770cbe4a16904dc3f41546672a => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 17:25:55.542958 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33fa06c-a53e-47eb-ac43-52d50589f2cf admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:25:55.544497 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-e33fa06c-a53e-47eb-ac43-52d50589f2cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:25:55.557899 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33fa06c-a53e-47eb-ac43-52d50589f2cf admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:25:55.624696 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1123e684-85ce-4730-bcdb-01974eaf4229 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:25:55.626126 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1123e684-85ce-4730-bcdb-01974eaf4229 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:25:55.626600 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1123e684-85ce-4730-bcdb-01974eaf4229 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:25:55.626954 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1123e684-85ce-4730-bcdb-01974eaf4229 admin admin] PATH_INFO: `/v3/projects/65cf537a1fba4554baad3f91452cdc4b` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:25:55.628851 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1123e684-85ce-4730-bcdb-01974eaf4229 admin admin] RBAC: Authorizing `identity:delete_project(project_id=65cf537a1fba4554baad3f91452cdc4b)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:25:55.632199 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1123e684-85ce-4730-bcdb-01974eaf4229 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:25:55.677016 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-1123e684-85ce-4730-bcdb-01974eaf4229 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '65cf537a1fba4554baad3f91452cdc4b', 'request_id': 'req-1123e684-85ce-4730-bcdb-01974eaf4229'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:25:55.683314 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-1123e684-85ce-4730-bcdb-01974eaf4229 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '65cf537a1fba4554baad3f91452cdc4b', 'request_id': 'req-1123e684-85ce-4730-bcdb-01974eaf4229'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:25:55.689210 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-1123e684-85ce-4730-bcdb-01974eaf4229 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '65cf537a1fba4554baad3f91452cdc4b', 'request_id': 'req-1123e684-85ce-4730-bcdb-01974eaf4229'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:25:55.700923 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-1123e684-85ce-4730-bcdb-01974eaf4229 admin admin] The token cache is being invalidate because project 65cf537a1fba4554baad3f91452cdc4b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=85204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 17:25:55.701207 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-1123e684-85ce-4730-bcdb-01974eaf4229 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:25:55.701821 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-1123e684-85ce-4730-bcdb-01974eaf4229 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:25:55.703346 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1290/2567] 10.222.0.58 () {58 vars in 1232 bytes} [Tue Oct 12 17:25:55 2021] DELETE /identity/v3/projects/65cf537a1fba4554baad3f91452cdc4b => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 17:25:55.707447 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0cd248-7823-4693-a3a0-bd79f743eafe admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:25:55.708859 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-8c0cd248-7823-4693-a3a0-bd79f743eafe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:25:55.721235 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0cd248-7823-4693-a3a0-bd79f743eafe admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:25:55.776639 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526e4a8d-8128-417b-a2be-2f00ebf8b0e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:25:55.777504 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526e4a8d-8128-417b-a2be-2f00ebf8b0e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:25:55.777789 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526e4a8d-8128-417b-a2be-2f00ebf8b0e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:25:55.778248 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526e4a8d-8128-417b-a2be-2f00ebf8b0e9 admin admin] PATH_INFO: `/v3/users/c987e8d3148f4fcba00b50623bfaeea9` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:25:55.779446 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526e4a8d-8128-417b-a2be-2f00ebf8b0e9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c987e8d3148f4fcba00b50623bfaeea9)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:25:55.781331 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526e4a8d-8128-417b-a2be-2f00ebf8b0e9 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:25:55.825275 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-526e4a8d-8128-417b-a2be-2f00ebf8b0e9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c987e8d3148f4fcba00b50623bfaeea9'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:25:55.836828 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-526e4a8d-8128-417b-a2be-2f00ebf8b0e9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c987e8d3148f4fcba00b50623bfaeea9'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:25:55.842974 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-526e4a8d-8128-417b-a2be-2f00ebf8b0e9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c987e8d3148f4fcba00b50623bfaeea9'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:25:55.849455 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-526e4a8d-8128-417b-a2be-2f00ebf8b0e9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c987e8d3148f4fcba00b50623bfaeea9'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:25:55.850111 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-526e4a8d-8128-417b-a2be-2f00ebf8b0e9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c987e8d3148f4fcba00b50623bfaeea9'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:25:55.856346 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1278/2568] 10.222.0.58 () {58 vars in 1223 bytes} [Tue Oct 12 17:25:55 2021] DELETE /identity/v3/users/c987e8d3148f4fcba00b50623bfaeea9 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 17:25:56.114426 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1123e684-85ce-4730-bcdb-01974eaf4229 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:25:56.116481 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-1123e684-85ce-4730-bcdb-01974eaf4229 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:25:56.130309 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1123e684-85ce-4730-bcdb-01974eaf4229 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:25:56.185596 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efb6723-04bc-455d-b77b-bb876418da74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:25:56.186483 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efb6723-04bc-455d-b77b-bb876418da74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:25:56.186774 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efb6723-04bc-455d-b77b-bb876418da74 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:25:56.187053 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efb6723-04bc-455d-b77b-bb876418da74 admin admin] PATH_INFO: `/v3/projects/96ec391c0bb14e388fdf4c1ccff0a324` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:25:56.188241 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efb6723-04bc-455d-b77b-bb876418da74 admin admin] RBAC: Authorizing `identity:delete_project(project_id=96ec391c0bb14e388fdf4c1ccff0a324)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:25:56.190148 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efb6723-04bc-455d-b77b-bb876418da74 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:25:56.233778 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-4efb6723-04bc-455d-b77b-bb876418da74 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '96ec391c0bb14e388fdf4c1ccff0a324', 'request_id': 'req-4efb6723-04bc-455d-b77b-bb876418da74'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:25:56.239122 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-4efb6723-04bc-455d-b77b-bb876418da74 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '96ec391c0bb14e388fdf4c1ccff0a324', 'request_id': 'req-4efb6723-04bc-455d-b77b-bb876418da74'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:25:56.245122 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-4efb6723-04bc-455d-b77b-bb876418da74 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '96ec391c0bb14e388fdf4c1ccff0a324', 'request_id': 'req-4efb6723-04bc-455d-b77b-bb876418da74'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:25:56.258128 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-4efb6723-04bc-455d-b77b-bb876418da74 admin admin] The token cache is being invalidate because project 96ec391c0bb14e388fdf4c1ccff0a324 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=85204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 17:25:56.258412 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-4efb6723-04bc-455d-b77b-bb876418da74 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:25:56.259035 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-4efb6723-04bc-455d-b77b-bb876418da74 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:25:56.260523 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1291/2569] 10.222.0.58 () {58 vars in 1232 bytes} [Tue Oct 12 17:25:56 2021] DELETE /identity/v3/projects/96ec391c0bb14e388fdf4c1ccff0a324 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 17:25:56.266225 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2239ec52-215a-42ad-ad53-5895c715a3f9 None None] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:25:56.266530 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2239ec52-215a-42ad-ad53-5895c715a3f9 None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:25:56.266808 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2239ec52-215a-42ad-ad53-5895c715a3f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:25:56.284606 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.auth.core [None req-2239ec52-215a-42ad-ad53-5895c715a3f9 None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 17:25:56.285813 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-2239ec52-215a-42ad-ad53-5895c715a3f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:25:56.341386 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1279/2570] 10.222.0.58 () {58 vars in 957 bytes} [Tue Oct 12 17:25:56 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 17:25:56.349136 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddade7d-a95d-4517-b31b-53cc00378678 None None] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:25:56.349430 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddade7d-a95d-4517-b31b-53cc00378678 None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:25:56.349708 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddade7d-a95d-4517-b31b-53cc00378678 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:25:56.367412 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.auth.core [None req-9ddade7d-a95d-4517-b31b-53cc00378678 None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 17:25:56.368599 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-9ddade7d-a95d-4517-b31b-53cc00378678 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:25:56.376347 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1292/2571] 10.222.0.58 () {58 vars in 957 bytes} [Tue Oct 12 17:25:56 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 17:25:56.380261 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2239ec52-215a-42ad-ad53-5895c715a3f9 None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:25:56.390202 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2239ec52-215a-42ad-ad53-5895c715a3f9 None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:25:56.394759 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92121e16-22dd-4443-bede-0064dcfe8d0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:25:56.395401 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92121e16-22dd-4443-bede-0064dcfe8d0a admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:25:56.395687 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92121e16-22dd-4443-bede-0064dcfe8d0a admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:25:56.395963 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92121e16-22dd-4443-bede-0064dcfe8d0a admin admin] PATH_INFO: `/v3/domains` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:25:56.396693 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92121e16-22dd-4443-bede-0064dcfe8d0a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 17:25:56.397005 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92121e16-22dd-4443-bede-0064dcfe8d0a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:25:56.399235 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92121e16-22dd-4443-bede-0064dcfe8d0a admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:25:56.410378 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1280/2572] 10.222.0.58 () {58 vars in 1152 bytes} [Tue Oct 12 17:25:56 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 17:25:56.414160 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddade7d-a95d-4517-b31b-53cc00378678 None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:25:56.423030 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddade7d-a95d-4517-b31b-53cc00378678 None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:25:56.427627 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e425fb08-a292-4fc8-87b1-cf4d866d2557 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:25:56.428259 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e425fb08-a292-4fc8-87b1-cf4d866d2557 admin admin] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:25:56.428543 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e425fb08-a292-4fc8-87b1-cf4d866d2557 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:25:56.428822 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e425fb08-a292-4fc8-87b1-cf4d866d2557 admin admin] PATH_INFO: `/v3/projects` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:25:56.429572 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e425fb08-a292-4fc8-87b1-cf4d866d2557 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:25:56.431474 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e425fb08-a292-4fc8-87b1-cf4d866d2557 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:25:56.456012 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1293/2573] 10.222.0.58 () {60 vars in 1152 bytes} [Tue Oct 12 17:25:56 2021] POST /identity/v3/projects => generated 373 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 17:25:56.459817 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92121e16-22dd-4443-bede-0064dcfe8d0a admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:25:56.469967 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92121e16-22dd-4443-bede-0064dcfe8d0a admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:25:56.525351 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e755f0dd-b26b-49e6-8b44-077e5c4b2f0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:25:56.526049 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e755f0dd-b26b-49e6-8b44-077e5c4b2f0c admin admin] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:25:56.526332 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e755f0dd-b26b-49e6-8b44-077e5c4b2f0c admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:25:56.526600 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e755f0dd-b26b-49e6-8b44-077e5c4b2f0c admin admin] PATH_INFO: `/v3/users` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:25:56.527293 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e755f0dd-b26b-49e6-8b44-077e5c4b2f0c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:25:56.529191 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e755f0dd-b26b-49e6-8b44-077e5c4b2f0c admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:25:56.548000 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1281/2574] 10.222.0.58 () {60 vars in 1143 bytes} [Tue Oct 12 17:25:56 2021] POST /identity/v3/users => generated 287 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 17:25:56.552060 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e425fb08-a292-4fc8-87b1-cf4d866d2557 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:25:56.562066 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e425fb08-a292-4fc8-87b1-cf4d866d2557 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:25:56.566674 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f9ea48-978c-46e6-bdac-ecbfde41cfdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:25:56.567321 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f9ea48-978c-46e6-bdac-ecbfde41cfdc admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:25:56.567604 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f9ea48-978c-46e6-bdac-ecbfde41cfdc admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:25:56.567878 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f9ea48-978c-46e6-bdac-ecbfde41cfdc admin admin] PATH_INFO: `/v3/roles` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:25:56.568616 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f9ea48-978c-46e6-bdac-ecbfde41cfdc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:25:56.570737 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f9ea48-978c-46e6-bdac-ecbfde41cfdc admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:25:56.580846 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1294/2575] 10.222.0.58 () {58 vars in 1121 bytes} [Tue Oct 12 17:25:56 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 17:25:56.584620 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e755f0dd-b26b-49e6-8b44-077e5c4b2f0c admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:25:56.594978 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e755f0dd-b26b-49e6-8b44-077e5c4b2f0c admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:25:56.599539 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cf3d1a-687d-4028-b7f9-3e1a4cd89de6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:25:56.600186 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cf3d1a-687d-4028-b7f9-3e1a4cd89de6 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:25:56.600474 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cf3d1a-687d-4028-b7f9-3e1a4cd89de6 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:25:56.600751 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cf3d1a-687d-4028-b7f9-3e1a4cd89de6 admin admin] PATH_INFO: `/v3/roles` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:25:56.601482 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cf3d1a-687d-4028-b7f9-3e1a4cd89de6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:25:56.603131 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cf3d1a-687d-4028-b7f9-3e1a4cd89de6 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:25:56.612608 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1282/2576] 10.222.0.58 () {58 vars in 1121 bytes} [Tue Oct 12 17:25:56 2021] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 17:25:56.616413 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f9ea48-978c-46e6-bdac-ecbfde41cfdc admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:25:56.628537 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f9ea48-978c-46e6-bdac-ecbfde41cfdc admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:25:56.634020 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227c02e5-3c48-449a-8ecf-92c575e3f4b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:25:56.634887 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227c02e5-3c48-449a-8ecf-92c575e3f4b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:25:56.635172 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227c02e5-3c48-449a-8ecf-92c575e3f4b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:25:56.635475 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227c02e5-3c48-449a-8ecf-92c575e3f4b7 admin admin] PATH_INFO: `/v3/projects/951bc69025d048d4b8b8a9b55c135139/users/6e4ee434245a474ab97f3396f1e2e5c8/roles/55ba49fe29884e64b57c3ad13188d554` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:25:56.651452 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227c02e5-3c48-449a-8ecf-92c575e3f4b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=951bc69025d048d4b8b8a9b55c135139, user_id=6e4ee434245a474ab97f3396f1e2e5c8, role_id=55ba49fe29884e64b57c3ad13188d554)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:25:56.654139 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227c02e5-3c48-449a-8ecf-92c575e3f4b7 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:25:56.667362 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1295/2577] 10.222.0.58 () {60 vars in 1482 bytes} [Tue Oct 12 17:25:56 2021] PUT /identity/v3/projects/951bc69025d048d4b8b8a9b55c135139/users/6e4ee434245a474ab97f3396f1e2e5c8/roles/55ba49fe29884e64b57c3ad13188d554 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 17:25:56.678267 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb77c2b8-2b2f-4c43-a9ab-0edc9b1d48d8 None None] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:25:56.678734 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb77c2b8-2b2f-4c43-a9ab-0edc9b1d48d8 None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:25:56.679020 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb77c2b8-2b2f-4c43-a9ab-0edc9b1d48d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:25:56.706208 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.auth.core [None req-cb77c2b8-2b2f-4c43-a9ab-0edc9b1d48d8 None None] MFA Rules not processed for user `6e4ee434245a474ab97f3396f1e2e5c8`. Rule list: `[]` (Enabled: `True`). {{(pid=85205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 17:25:56.707418 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-cb77c2b8-2b2f-4c43-a9ab-0edc9b1d48d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:25:56.767762 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1283/2578] 10.222.0.58 () {58 vars in 957 bytes} [Tue Oct 12 17:25:56 2021] POST /identity/v3/auth/tokens => generated 3393 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 17:25:56.777323 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227c02e5-3c48-449a-8ecf-92c575e3f4b7 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:25:56.779032 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-227c02e5-3c48-449a-8ecf-92c575e3f4b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:25:56.833097 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227c02e5-3c48-449a-8ecf-92c575e3f4b7 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:25:56.836751 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983b0948-05f0-4bcc-bff7-c5e185c4e1d6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04704222b3d64a33a6c092fc641ccbb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:25:56.837388 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983b0948-05f0-4bcc-bff7-c5e185c4e1d6 service cinder] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:25:56.837673 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983b0948-05f0-4bcc-bff7-c5e185c4e1d6 service cinder] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:25:56.837987 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983b0948-05f0-4bcc-bff7-c5e185c4e1d6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:25:56.846150 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983b0948-05f0-4bcc-bff7-c5e185c4e1d6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:25:56.847501 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983b0948-05f0-4bcc-bff7-c5e185c4e1d6 service cinder] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:25:56.856150 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1296/2579] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Oct 12 17:25:56 2021] GET /identity/v3/auth/tokens => generated 3393 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 17:26:06.530411 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb77c2b8-2b2f-4c43-a9ab-0edc9b1d48d8 None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:26:06.589916 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb77c2b8-2b2f-4c43-a9ab-0edc9b1d48d8 None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:26:06.594435 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0255b422-031c-49e4-99a5-5ac6408c14f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:26:06.595297 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0255b422-031c-49e4-99a5-5ac6408c14f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:26:06.595583 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0255b422-031c-49e4-99a5-5ac6408c14f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:26:06.595863 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0255b422-031c-49e4-99a5-5ac6408c14f3 admin admin] PATH_INFO: `/v3/users/6e4ee434245a474ab97f3396f1e2e5c8` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:26:06.597070 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0255b422-031c-49e4-99a5-5ac6408c14f3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6e4ee434245a474ab97f3396f1e2e5c8)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:26:06.599006 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0255b422-031c-49e4-99a5-5ac6408c14f3 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:26:06.651434 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-0255b422-031c-49e4-99a5-5ac6408c14f3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6e4ee434245a474ab97f3396f1e2e5c8'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:26:06.660123 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-0255b422-031c-49e4-99a5-5ac6408c14f3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6e4ee434245a474ab97f3396f1e2e5c8'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:26:06.668859 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-0255b422-031c-49e4-99a5-5ac6408c14f3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6e4ee434245a474ab97f3396f1e2e5c8'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:26:06.676270 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-0255b422-031c-49e4-99a5-5ac6408c14f3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6e4ee434245a474ab97f3396f1e2e5c8'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:26:06.677042 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-0255b422-031c-49e4-99a5-5ac6408c14f3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6e4ee434245a474ab97f3396f1e2e5c8'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:26:06.683730 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1284/2580] 10.222.0.58 () {58 vars in 1223 bytes} [Tue Oct 12 17:26:06 2021] DELETE /identity/v3/users/6e4ee434245a474ab97f3396f1e2e5c8 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 17:26:06.690957 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7fe828-2028-4a37-bb00-eb66ba663ca3 None None] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:26:06.691454 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7fe828-2028-4a37-bb00-eb66ba663ca3 None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:26:06.691568 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7fe828-2028-4a37-bb00-eb66ba663ca3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:26:06.709332 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.auth.core [None req-2f7fe828-2028-4a37-bb00-eb66ba663ca3 None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 17:26:06.710656 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-2f7fe828-2028-4a37-bb00-eb66ba663ca3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:26:06.768841 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1297/2581] 10.222.0.58 () {58 vars in 957 bytes} [Tue Oct 12 17:26:06 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 17:26:06.778714 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0255b422-031c-49e4-99a5-5ac6408c14f3 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:26:06.780112 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-0255b422-031c-49e4-99a5-5ac6408c14f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:26:06.835480 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0255b422-031c-49e4-99a5-5ac6408c14f3 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:26:06.839148 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0284b25-887c-4d96-bc04-8c3985b3bc32 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e65f6d0598e4c539134292b86fb43d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:26:06.839792 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0284b25-887c-4d96-bc04-8c3985b3bc32 service neutron] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:26:06.840076 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0284b25-887c-4d96-bc04-8c3985b3bc32 service neutron] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:26:06.840358 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0284b25-887c-4d96-bc04-8c3985b3bc32 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:26:06.849095 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0284b25-887c-4d96-bc04-8c3985b3bc32 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:26:06.850542 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0284b25-887c-4d96-bc04-8c3985b3bc32 service neutron] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:26:06.860220 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1285/2582] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Oct 12 17:26:06 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 17:26:07.113080 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7fe828-2028-4a37-bb00-eb66ba663ca3 None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:26:07.114527 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-2f7fe828-2028-4a37-bb00-eb66ba663ca3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:26:07.138864 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7fe828-2028-4a37-bb00-eb66ba663ca3 None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:26:07.143968 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c361f0b0-3758-42d1-8f40-1d6888f0f272 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:26:07.144713 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c361f0b0-3758-42d1-8f40-1d6888f0f272 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:26:07.144996 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c361f0b0-3758-42d1-8f40-1d6888f0f272 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:26:07.145273 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c361f0b0-3758-42d1-8f40-1d6888f0f272 admin admin] PATH_INFO: `/v3/projects/951bc69025d048d4b8b8a9b55c135139` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:26:07.146501 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c361f0b0-3758-42d1-8f40-1d6888f0f272 admin admin] RBAC: Authorizing `identity:delete_project(project_id=951bc69025d048d4b8b8a9b55c135139)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:26:07.148369 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c361f0b0-3758-42d1-8f40-1d6888f0f272 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:26:07.194576 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-c361f0b0-3758-42d1-8f40-1d6888f0f272 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '951bc69025d048d4b8b8a9b55c135139', 'request_id': 'req-c361f0b0-3758-42d1-8f40-1d6888f0f272'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:26:07.200291 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-c361f0b0-3758-42d1-8f40-1d6888f0f272 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '951bc69025d048d4b8b8a9b55c135139', 'request_id': 'req-c361f0b0-3758-42d1-8f40-1d6888f0f272'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:26:07.206129 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-c361f0b0-3758-42d1-8f40-1d6888f0f272 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '951bc69025d048d4b8b8a9b55c135139', 'request_id': 'req-c361f0b0-3758-42d1-8f40-1d6888f0f272'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:26:07.217760 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-c361f0b0-3758-42d1-8f40-1d6888f0f272 admin admin] The token cache is being invalidate because project 951bc69025d048d4b8b8a9b55c135139 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=85204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 17:26:07.218075 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-c361f0b0-3758-42d1-8f40-1d6888f0f272 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:26:07.218687 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-c361f0b0-3758-42d1-8f40-1d6888f0f272 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:26:07.220240 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1298/2583] 10.222.0.58 () {58 vars in 1232 bytes} [Tue Oct 12 17:26:07 2021] DELETE /identity/v3/projects/951bc69025d048d4b8b8a9b55c135139 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 17:26:07.225826 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01aa36b-d3d8-4e37-8866-40167e6dc953 None None] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:26:07.226184 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01aa36b-d3d8-4e37-8866-40167e6dc953 None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:26:07.226967 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01aa36b-d3d8-4e37-8866-40167e6dc953 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:26:07.243999 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.auth.core [None req-e01aa36b-d3d8-4e37-8866-40167e6dc953 None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 17:26:07.245235 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-e01aa36b-d3d8-4e37-8866-40167e6dc953 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:26:07.302913 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1286/2584] 10.222.0.58 () {58 vars in 957 bytes} [Tue Oct 12 17:26:07 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 17:26:07.310910 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa4ebbd-4fb2-4e1b-a257-639b8526f2d2 None None] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:26:07.311202 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa4ebbd-4fb2-4e1b-a257-639b8526f2d2 None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:26:07.311547 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa4ebbd-4fb2-4e1b-a257-639b8526f2d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:26:07.329244 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.auth.core [None req-0aa4ebbd-4fb2-4e1b-a257-639b8526f2d2 None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 17:26:07.330479 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-0aa4ebbd-4fb2-4e1b-a257-639b8526f2d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:26:07.338707 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1299/2585] 10.222.0.58 () {58 vars in 957 bytes} [Tue Oct 12 17:26:07 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 17:26:07.342621 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01aa36b-d3d8-4e37-8866-40167e6dc953 None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:26:07.352434 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01aa36b-d3d8-4e37-8866-40167e6dc953 None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:26:07.356989 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16e8f26-49bc-4c60-a41b-2d0120a320b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:26:07.357629 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16e8f26-49bc-4c60-a41b-2d0120a320b8 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:26:07.357948 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16e8f26-49bc-4c60-a41b-2d0120a320b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:26:07.358228 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16e8f26-49bc-4c60-a41b-2d0120a320b8 admin admin] PATH_INFO: `/v3/domains` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:26:07.358958 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16e8f26-49bc-4c60-a41b-2d0120a320b8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 17:26:07.359266 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16e8f26-49bc-4c60-a41b-2d0120a320b8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:26:07.360845 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16e8f26-49bc-4c60-a41b-2d0120a320b8 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:26:07.371841 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1287/2586] 10.222.0.58 () {58 vars in 1152 bytes} [Tue Oct 12 17:26:07 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 17:26:07.375968 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa4ebbd-4fb2-4e1b-a257-639b8526f2d2 None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:26:07.385115 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa4ebbd-4fb2-4e1b-a257-639b8526f2d2 None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:26:07.389668 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d61763b-7208-4d57-9876-e4826c650903 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:26:07.390341 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d61763b-7208-4d57-9876-e4826c650903 admin admin] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:26:07.390622 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d61763b-7208-4d57-9876-e4826c650903 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:26:07.390894 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d61763b-7208-4d57-9876-e4826c650903 admin admin] PATH_INFO: `/v3/projects` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:26:07.391599 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d61763b-7208-4d57-9876-e4826c650903 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:26:07.393444 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d61763b-7208-4d57-9876-e4826c650903 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:26:07.418324 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1300/2587] 10.222.0.58 () {60 vars in 1152 bytes} [Tue Oct 12 17:26:07 2021] POST /identity/v3/projects => generated 385 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 17:26:07.422278 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16e8f26-49bc-4c60-a41b-2d0120a320b8 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:26:07.431888 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16e8f26-49bc-4c60-a41b-2d0120a320b8 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:26:07.484706 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a2c47a-78dd-4974-bb5b-c993b7c18393 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:26:07.485359 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a2c47a-78dd-4974-bb5b-c993b7c18393 admin admin] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:26:07.485645 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a2c47a-78dd-4974-bb5b-c993b7c18393 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:26:07.485950 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a2c47a-78dd-4974-bb5b-c993b7c18393 admin admin] PATH_INFO: `/v3/users` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:26:07.486650 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a2c47a-78dd-4974-bb5b-c993b7c18393 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:26:07.488528 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a2c47a-78dd-4974-bb5b-c993b7c18393 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:26:07.521761 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1288/2588] 10.222.0.58 () {60 vars in 1143 bytes} [Tue Oct 12 17:26:07 2021] POST /identity/v3/users => generated 293 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 17:26:07.524329 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d61763b-7208-4d57-9876-e4826c650903 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:26:07.534237 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d61763b-7208-4d57-9876-e4826c650903 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:26:07.538772 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c0301e-f000-49f7-bf95-791ec51325a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:26:07.539446 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c0301e-f000-49f7-bf95-791ec51325a9 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:26:07.539725 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c0301e-f000-49f7-bf95-791ec51325a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:26:07.540007 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c0301e-f000-49f7-bf95-791ec51325a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:26:07.540721 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c0301e-f000-49f7-bf95-791ec51325a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:26:07.542330 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c0301e-f000-49f7-bf95-791ec51325a9 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:26:07.552757 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1301/2589] 10.222.0.58 () {58 vars in 1121 bytes} [Tue Oct 12 17:26:07 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 17:26:07.556511 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a2c47a-78dd-4974-bb5b-c993b7c18393 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:26:07.566025 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a2c47a-78dd-4974-bb5b-c993b7c18393 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:26:07.571132 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6154161-1166-409e-a880-c8cf09cee932 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:26:07.571776 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6154161-1166-409e-a880-c8cf09cee932 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:26:07.572060 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6154161-1166-409e-a880-c8cf09cee932 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:26:07.572335 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6154161-1166-409e-a880-c8cf09cee932 admin admin] PATH_INFO: `/v3/roles` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:26:07.573061 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6154161-1166-409e-a880-c8cf09cee932 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:26:07.574667 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6154161-1166-409e-a880-c8cf09cee932 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:26:07.584092 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1289/2590] 10.222.0.58 () {58 vars in 1121 bytes} [Tue Oct 12 17:26:07 2021] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 17:26:07.588457 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c0301e-f000-49f7-bf95-791ec51325a9 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:26:07.598470 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c0301e-f000-49f7-bf95-791ec51325a9 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:26:07.603076 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c514720-73b2-43cf-8cfa-4d87db1b74ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:26:07.603928 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c514720-73b2-43cf-8cfa-4d87db1b74ca admin admin] REQUEST_METHOD: `PUT` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:26:07.604207 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c514720-73b2-43cf-8cfa-4d87db1b74ca admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:26:07.604477 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c514720-73b2-43cf-8cfa-4d87db1b74ca admin admin] PATH_INFO: `/v3/projects/f77ac05b3c03484f88e6f24b224b6d13/users/6df5de308125437a91acabc3d7b4b387/roles/55ba49fe29884e64b57c3ad13188d554` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:26:07.618247 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c514720-73b2-43cf-8cfa-4d87db1b74ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=f77ac05b3c03484f88e6f24b224b6d13, user_id=6df5de308125437a91acabc3d7b4b387, role_id=55ba49fe29884e64b57c3ad13188d554)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:26:07.620829 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c514720-73b2-43cf-8cfa-4d87db1b74ca admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:26:07.633837 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1302/2591] 10.222.0.58 () {60 vars in 1482 bytes} [Tue Oct 12 17:26:07 2021] PUT /identity/v3/projects/f77ac05b3c03484f88e6f24b224b6d13/users/6df5de308125437a91acabc3d7b4b387/roles/55ba49fe29884e64b57c3ad13188d554 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 17:26:07.638706 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ceee1be-f397-4024-abf2-2ebd54ecbbf7 None None] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:26:07.639000 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ceee1be-f397-4024-abf2-2ebd54ecbbf7 None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:26:07.639280 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ceee1be-f397-4024-abf2-2ebd54ecbbf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:26:07.657024 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.auth.core [None req-7ceee1be-f397-4024-abf2-2ebd54ecbbf7 None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 17:26:07.658306 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-7ceee1be-f397-4024-abf2-2ebd54ecbbf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:26:07.714838 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1290/2592] 10.222.0.58 () {58 vars in 957 bytes} [Tue Oct 12 17:26:07 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 17:26:07.724680 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c514720-73b2-43cf-8cfa-4d87db1b74ca admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:26:07.726955 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-5c514720-73b2-43cf-8cfa-4d87db1b74ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:26:07.787553 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c514720-73b2-43cf-8cfa-4d87db1b74ca admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:26:07.792144 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4186f8cf-4a3b-410b-84e2-f3fab2dc749d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e65f6d0598e4c539134292b86fb43d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:26:07.792802 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4186f8cf-4a3b-410b-84e2-f3fab2dc749d service neutron] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:26:07.793086 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4186f8cf-4a3b-410b-84e2-f3fab2dc749d service neutron] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:26:07.793357 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4186f8cf-4a3b-410b-84e2-f3fab2dc749d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:26:07.802719 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4186f8cf-4a3b-410b-84e2-f3fab2dc749d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:26:07.804137 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4186f8cf-4a3b-410b-84e2-f3fab2dc749d service neutron] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:26:07.814449 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1303/2593] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Oct 12 17:26:07 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 17:26:07.824773 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ceee1be-f397-4024-abf2-2ebd54ecbbf7 None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:26:07.826203 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-7ceee1be-f397-4024-abf2-2ebd54ecbbf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:26:07.838377 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ceee1be-f397-4024-abf2-2ebd54ecbbf7 None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:26:07.842207 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2091fa10-c690-4dee-b6fc-055e2d121a86 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e65f6d0598e4c539134292b86fb43d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:26:07.843002 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2091fa10-c690-4dee-b6fc-055e2d121a86 service neutron] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:26:07.843352 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2091fa10-c690-4dee-b6fc-055e2d121a86 service neutron] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:26:07.843628 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2091fa10-c690-4dee-b6fc-055e2d121a86 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:26:07.845853 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-2091fa10-c690-4dee-b6fc-055e2d121a86 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:26:07.858557 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2091fa10-c690-4dee-b6fc-055e2d121a86 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:26:07.859965 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2091fa10-c690-4dee-b6fc-055e2d121a86 service neutron] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:26:07.869807 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1291/2594] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Oct 12 17:26:07 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 17:26:12.282715 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4186f8cf-4a3b-410b-84e2-f3fab2dc749d service neutron] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:26:12.284747 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-4186f8cf-4a3b-410b-84e2-f3fab2dc749d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:26:12.305743 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4186f8cf-4a3b-410b-84e2-f3fab2dc749d service neutron] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:26:12.317641 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5bded3-e46b-47fa-9b2a-c83a67667e5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:26:12.321410 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5bded3-e46b-47fa-9b2a-c83a67667e5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:26:12.322197 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5bded3-e46b-47fa-9b2a-c83a67667e5e admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:26:12.328513 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5bded3-e46b-47fa-9b2a-c83a67667e5e admin admin] PATH_INFO: `/v3/users/aef11be7bb50427fb18d1ff2d29e9fac` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:26:12.346858 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5bded3-e46b-47fa-9b2a-c83a67667e5e admin admin] RBAC: Authorizing `identity:delete_user(user_id=aef11be7bb50427fb18d1ff2d29e9fac)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:26:12.348748 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5bded3-e46b-47fa-9b2a-c83a67667e5e admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:26:12.451369 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-7b5bded3-e46b-47fa-9b2a-c83a67667e5e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aef11be7bb50427fb18d1ff2d29e9fac'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:26:12.495903 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-7b5bded3-e46b-47fa-9b2a-c83a67667e5e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aef11be7bb50427fb18d1ff2d29e9fac'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:26:12.512420 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-7b5bded3-e46b-47fa-9b2a-c83a67667e5e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aef11be7bb50427fb18d1ff2d29e9fac'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:26:12.526844 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-7b5bded3-e46b-47fa-9b2a-c83a67667e5e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aef11be7bb50427fb18d1ff2d29e9fac'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:26:12.527807 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-7b5bded3-e46b-47fa-9b2a-c83a67667e5e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aef11be7bb50427fb18d1ff2d29e9fac'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:26:12.537322 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1304/2595] 10.222.0.58 () {58 vars in 1223 bytes} [Tue Oct 12 17:26:12 2021] DELETE /identity/v3/users/aef11be7bb50427fb18d1ff2d29e9fac => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 17:26:12.679987 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fff067-a6d2-4d46-92bf-d9690071aacc None None] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:26:12.680474 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fff067-a6d2-4d46-92bf-d9690071aacc None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:26:12.680571 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fff067-a6d2-4d46-92bf-d9690071aacc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:26:12.708492 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.auth.core [None req-c8fff067-a6d2-4d46-92bf-d9690071aacc None None] MFA Rules not processed for user `6df5de308125437a91acabc3d7b4b387`. Rule list: `[]` (Enabled: `True`). {{(pid=85205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 17:26:12.709769 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-c8fff067-a6d2-4d46-92bf-d9690071aacc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:26:12.757077 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5bded3-e46b-47fa-9b2a-c83a67667e5e admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:26:12.761016 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-7b5bded3-e46b-47fa-9b2a-c83a67667e5e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:26:12.835925 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1292/2596] 10.222.0.58 () {58 vars in 957 bytes} [Tue Oct 12 17:26:12 2021] POST /identity/v3/auth/tokens => generated 3405 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 17:26:12.840340 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fff067-a6d2-4d46-92bf-d9690071aacc None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:26:12.841908 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-c8fff067-a6d2-4d46-92bf-d9690071aacc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:26:12.850189 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5bded3-e46b-47fa-9b2a-c83a67667e5e admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:26:12.855695 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a60711-6be0-4299-8324-1931ba67bafd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:26:12.856074 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fff067-a6d2-4d46-92bf-d9690071aacc None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:26:12.856567 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a60711-6be0-4299-8324-1931ba67bafd admin admin] REQUEST_METHOD: `DELETE` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:26:12.856847 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a60711-6be0-4299-8324-1931ba67bafd admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:26:12.857120 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a60711-6be0-4299-8324-1931ba67bafd admin admin] PATH_INFO: `/v3/projects/2e0c9fd106594f5796ff041037814e2b` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:26:12.858353 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a60711-6be0-4299-8324-1931ba67bafd admin admin] RBAC: Authorizing `identity:delete_project(project_id=2e0c9fd106594f5796ff041037814e2b)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:26:12.860401 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a60711-6be0-4299-8324-1931ba67bafd admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:26:12.860749 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee35060-7db7-47d1-8d88-7fca239a5587 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:26:12.861416 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee35060-7db7-47d1-8d88-7fca239a5587 admin admin] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:26:12.861704 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee35060-7db7-47d1-8d88-7fca239a5587 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:26:12.862154 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee35060-7db7-47d1-8d88-7fca239a5587 admin admin] PATH_INFO: `/v3/projects` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:26:12.862871 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee35060-7db7-47d1-8d88-7fca239a5587 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:26:12.864789 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee35060-7db7-47d1-8d88-7fca239a5587 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:26:12.894894 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1293/2597] 10.222.0.58 () {60 vars in 1152 bytes} [Tue Oct 12 17:26:12 2021] POST /identity/v3/projects => generated 383 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 17:26:12.898491 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee35060-7db7-47d1-8d88-7fca239a5587 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:26:12.918468 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-96a60711-6be0-4299-8324-1931ba67bafd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2e0c9fd106594f5796ff041037814e2b', 'request_id': 'req-96a60711-6be0-4299-8324-1931ba67bafd'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:26:12.924305 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-96a60711-6be0-4299-8324-1931ba67bafd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2e0c9fd106594f5796ff041037814e2b', 'request_id': 'req-96a60711-6be0-4299-8324-1931ba67bafd'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:26:12.931195 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-96a60711-6be0-4299-8324-1931ba67bafd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2e0c9fd106594f5796ff041037814e2b', 'request_id': 'req-96a60711-6be0-4299-8324-1931ba67bafd'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:26:12.945743 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-96a60711-6be0-4299-8324-1931ba67bafd admin admin] The token cache is being invalidate because project 2e0c9fd106594f5796ff041037814e2b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=85204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 17:26:12.946133 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-96a60711-6be0-4299-8324-1931ba67bafd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:26:12.946827 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-96a60711-6be0-4299-8324-1931ba67bafd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:26:12.948694 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1305/2598] 10.222.0.58 () {58 vars in 1232 bytes} [Tue Oct 12 17:26:12 2021] DELETE /identity/v3/projects/2e0c9fd106594f5796ff041037814e2b => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 17:26:12.959223 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3ee9eb-db5e-43c7-92f3-8591e1519ab5 None None] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:26:12.959813 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3ee9eb-db5e-43c7-92f3-8591e1519ab5 None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:26:12.960190 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3ee9eb-db5e-43c7-92f3-8591e1519ab5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:26:12.967890 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee35060-7db7-47d1-8d88-7fca239a5587 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:26:12.979538 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.auth.core [None req-0c3ee9eb-db5e-43c7-92f3-8591e1519ab5 None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 17:26:12.980979 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-0c3ee9eb-db5e-43c7-92f3-8591e1519ab5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:26:13.025450 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc74696-7b63-430e-9921-c3fb5e4286cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:26:13.026163 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc74696-7b63-430e-9921-c3fb5e4286cc admin admin] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:26:13.026447 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc74696-7b63-430e-9921-c3fb5e4286cc admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:26:13.026724 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc74696-7b63-430e-9921-c3fb5e4286cc admin admin] PATH_INFO: `/v3/users` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:26:13.027427 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc74696-7b63-430e-9921-c3fb5e4286cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:26:13.029327 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc74696-7b63-430e-9921-c3fb5e4286cc admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:26:13.048319 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1306/2599] 10.222.0.58 () {58 vars in 957 bytes} [Tue Oct 12 17:26:12 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 17:26:13.056056 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5324ac9-09e6-4b43-83fb-9532da634b86 None None] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:26:13.056840 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5324ac9-09e6-4b43-83fb-9532da634b86 None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:26:13.057384 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5324ac9-09e6-4b43-83fb-9532da634b86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:26:13.059042 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1294/2600] 10.222.0.58 () {60 vars in 1143 bytes} [Tue Oct 12 17:26:12 2021] POST /identity/v3/users => generated 298 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 17:26:13.062898 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc74696-7b63-430e-9921-c3fb5e4286cc admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:26:13.064847 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-abc74696-7b63-430e-9921-c3fb5e4286cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:26:13.078743 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.auth.core [None req-c5324ac9-09e6-4b43-83fb-9532da634b86 None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 17:26:13.079961 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-c5324ac9-09e6-4b43-83fb-9532da634b86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:26:13.081746 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc74696-7b63-430e-9921-c3fb5e4286cc admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:26:13.087143 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d547dc82-a6e7-42b7-8dc6-c22e6c767aae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:26:13.087808 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d547dc82-a6e7-42b7-8dc6-c22e6c767aae admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:26:13.088092 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d547dc82-a6e7-42b7-8dc6-c22e6c767aae admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:26:13.088368 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d547dc82-a6e7-42b7-8dc6-c22e6c767aae admin admin] PATH_INFO: `/v3/roles` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:26:13.088985 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1307/2601] 10.222.0.58 () {58 vars in 957 bytes} [Tue Oct 12 17:26:13 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 17:26:13.089119 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d547dc82-a6e7-42b7-8dc6-c22e6c767aae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:26:13.090892 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d547dc82-a6e7-42b7-8dc6-c22e6c767aae admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:26:13.093097 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5324ac9-09e6-4b43-83fb-9532da634b86 None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:26:13.101616 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1295/2602] 10.222.0.58 () {58 vars in 1121 bytes} [Tue Oct 12 17:26:13 2021] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 17:26:13.102249 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5324ac9-09e6-4b43-83fb-9532da634b86 None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:26:13.105268 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d547dc82-a6e7-42b7-8dc6-c22e6c767aae admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:26:13.109097 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6877d6-114e-431a-98a0-c0aa2036469d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:26:13.109952 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6877d6-114e-431a-98a0-c0aa2036469d admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:26:13.110290 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6877d6-114e-431a-98a0-c0aa2036469d admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:26:13.110575 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6877d6-114e-431a-98a0-c0aa2036469d admin admin] PATH_INFO: `/v3/domains` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:26:13.111975 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6877d6-114e-431a-98a0-c0aa2036469d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 17:26:13.112293 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6877d6-114e-431a-98a0-c0aa2036469d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:26:13.115052 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6877d6-114e-431a-98a0-c0aa2036469d admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:26:13.115949 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d547dc82-a6e7-42b7-8dc6-c22e6c767aae admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:26:13.122292 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5785de-2293-4a1e-a46c-8c0e22e10242 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:26:13.123208 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5785de-2293-4a1e-a46c-8c0e22e10242 admin admin] REQUEST_METHOD: `PUT` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:26:13.123500 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5785de-2293-4a1e-a46c-8c0e22e10242 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:26:13.123772 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5785de-2293-4a1e-a46c-8c0e22e10242 admin admin] PATH_INFO: `/v3/projects/e52b0e0a8ded4261b3057d438631edd6/users/bc72d7500ddb4854ac7ddc9b8965dfa3/roles/610824e4f50f4fb8954610e98c1de784` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:26:13.128569 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1308/2603] 10.222.0.58 () {58 vars in 1152 bytes} [Tue Oct 12 17:26:13 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 17:26:13.133292 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6877d6-114e-431a-98a0-c0aa2036469d admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:26:13.139190 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5785de-2293-4a1e-a46c-8c0e22e10242 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e52b0e0a8ded4261b3057d438631edd6, user_id=bc72d7500ddb4854ac7ddc9b8965dfa3, role_id=610824e4f50f4fb8954610e98c1de784)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:26:13.141803 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5785de-2293-4a1e-a46c-8c0e22e10242 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:26:13.143289 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6877d6-114e-431a-98a0-c0aa2036469d admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:26:13.148086 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661223d3-471d-4dd3-9c6e-1544653c23e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:26:13.148773 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661223d3-471d-4dd3-9c6e-1544653c23e4 admin admin] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:26:13.149033 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661223d3-471d-4dd3-9c6e-1544653c23e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:26:13.149300 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661223d3-471d-4dd3-9c6e-1544653c23e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:26:13.150031 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661223d3-471d-4dd3-9c6e-1544653c23e4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:26:13.151901 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661223d3-471d-4dd3-9c6e-1544653c23e4 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:26:13.154735 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1296/2604] 10.222.0.58 () {60 vars in 1482 bytes} [Tue Oct 12 17:26:13 2021] PUT /identity/v3/projects/e52b0e0a8ded4261b3057d438631edd6/users/bc72d7500ddb4854ac7ddc9b8965dfa3/roles/610824e4f50f4fb8954610e98c1de784 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 17:26:13.158573 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5785de-2293-4a1e-a46c-8c0e22e10242 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:26:13.178561 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1309/2605] 10.222.0.58 () {60 vars in 1152 bytes} [Tue Oct 12 17:26:13 2021] POST /identity/v3/projects => generated 387 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 17:26:13.182977 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661223d3-471d-4dd3-9c6e-1544653c23e4 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:26:13.220011 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5785de-2293-4a1e-a46c-8c0e22e10242 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:26:13.240138 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661223d3-471d-4dd3-9c6e-1544653c23e4 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:26:13.246788 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55bf124-e449-45da-82a1-fee31bff6f2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:26:13.247464 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55bf124-e449-45da-82a1-fee31bff6f2b admin admin] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:26:13.247747 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55bf124-e449-45da-82a1-fee31bff6f2b admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:26:13.248031 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55bf124-e449-45da-82a1-fee31bff6f2b admin admin] PATH_INFO: `/v3/users` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:26:13.248755 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55bf124-e449-45da-82a1-fee31bff6f2b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:26:13.250856 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55bf124-e449-45da-82a1-fee31bff6f2b admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:26:13.275933 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1310/2606] 10.222.0.58 () {60 vars in 1143 bytes} [Tue Oct 12 17:26:13 2021] POST /identity/v3/users => generated 294 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 17:26:13.276980 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55bf124-e449-45da-82a1-fee31bff6f2b admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:26:13.277599 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd0df2a-b339-4c22-8022-a70ac87746f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:26:13.278426 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd0df2a-b339-4c22-8022-a70ac87746f6 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:26:13.278712 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd0df2a-b339-4c22-8022-a70ac87746f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:26:13.279042 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd0df2a-b339-4c22-8022-a70ac87746f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:26:13.279789 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd0df2a-b339-4c22-8022-a70ac87746f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:26:13.281364 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd0df2a-b339-4c22-8022-a70ac87746f6 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:26:13.286356 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55bf124-e449-45da-82a1-fee31bff6f2b admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:26:13.291244 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4eaa549-d047-4557-8cda-8a8a4cf8dae2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:26:13.294697 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1297/2607] 10.222.0.58 () {58 vars in 1121 bytes} [Tue Oct 12 17:26:13 2021] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 17:26:13.294845 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4eaa549-d047-4557-8cda-8a8a4cf8dae2 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:26:13.294845 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4eaa549-d047-4557-8cda-8a8a4cf8dae2 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:26:13.294845 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4eaa549-d047-4557-8cda-8a8a4cf8dae2 admin admin] PATH_INFO: `/v3/roles` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:26:13.294845 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4eaa549-d047-4557-8cda-8a8a4cf8dae2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:26:13.294845 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4eaa549-d047-4557-8cda-8a8a4cf8dae2 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:26:13.297057 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd0df2a-b339-4c22-8022-a70ac87746f6 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:26:13.306195 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1311/2608] 10.222.0.58 () {58 vars in 1121 bytes} [Tue Oct 12 17:26:13 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 17:26:13.306737 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd0df2a-b339-4c22-8022-a70ac87746f6 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:26:13.309749 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4eaa549-d047-4557-8cda-8a8a4cf8dae2 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:26:13.311909 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2830ed-b034-4b35-a3c2-4e7a4ed52845 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:26:13.312806 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2830ed-b034-4b35-a3c2-4e7a4ed52845 admin admin] REQUEST_METHOD: `PUT` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:26:13.313081 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2830ed-b034-4b35-a3c2-4e7a4ed52845 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:26:13.313359 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2830ed-b034-4b35-a3c2-4e7a4ed52845 admin admin] PATH_INFO: `/v3/projects/e52b0e0a8ded4261b3057d438631edd6/users/bc72d7500ddb4854ac7ddc9b8965dfa3/roles/610824e4f50f4fb8954610e98c1de784` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:26:13.315404 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2830ed-b034-4b35-a3c2-4e7a4ed52845 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e52b0e0a8ded4261b3057d438631edd6, user_id=bc72d7500ddb4854ac7ddc9b8965dfa3, role_id=610824e4f50f4fb8954610e98c1de784)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:26:13.318056 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2830ed-b034-4b35-a3c2-4e7a4ed52845 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:26:13.320592 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4eaa549-d047-4557-8cda-8a8a4cf8dae2 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:26:13.325849 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d1a87f-0ba4-4136-858a-94204cf98ffb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:26:13.326672 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d1a87f-0ba4-4136-858a-94204cf98ffb admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:26:13.326964 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d1a87f-0ba4-4136-858a-94204cf98ffb admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:26:13.327240 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d1a87f-0ba4-4136-858a-94204cf98ffb admin admin] PATH_INFO: `/v3/roles` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:26:13.327975 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d1a87f-0ba4-4136-858a-94204cf98ffb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:26:13.328594 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1298/2609] 10.222.0.58 () {60 vars in 1482 bytes} [Tue Oct 12 17:26:13 2021] PUT /identity/v3/projects/e52b0e0a8ded4261b3057d438631edd6/users/bc72d7500ddb4854ac7ddc9b8965dfa3/roles/610824e4f50f4fb8954610e98c1de784 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 17:26:13.329546 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d1a87f-0ba4-4136-858a-94204cf98ffb admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:26:13.340312 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1312/2610] 10.222.0.58 () {58 vars in 1121 bytes} [Tue Oct 12 17:26:13 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 17:26:13.344204 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2830ed-b034-4b35-a3c2-4e7a4ed52845 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:26:13.408871 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2830ed-b034-4b35-a3c2-4e7a4ed52845 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:26:13.414839 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c470c6-988e-485f-86ac-cffde5328174 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:26:13.415997 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c470c6-988e-485f-86ac-cffde5328174 admin admin] REQUEST_METHOD: `PUT` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:26:13.416387 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c470c6-988e-485f-86ac-cffde5328174 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:26:13.416767 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c470c6-988e-485f-86ac-cffde5328174 admin admin] PATH_INFO: `/v3/projects/bd8c030e24be495b9af421c282a4eb43/users/eef8b40c77764838ad0b1b7ab7989b54/roles/55ba49fe29884e64b57c3ad13188d554` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:26:13.435888 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c470c6-988e-485f-86ac-cffde5328174 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd8c030e24be495b9af421c282a4eb43, user_id=eef8b40c77764838ad0b1b7ab7989b54, role_id=55ba49fe29884e64b57c3ad13188d554)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:26:13.438566 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c470c6-988e-485f-86ac-cffde5328174 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:26:13.454978 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1299/2611] 10.222.0.58 () {60 vars in 1482 bytes} [Tue Oct 12 17:26:13 2021] PUT /identity/v3/projects/bd8c030e24be495b9af421c282a4eb43/users/eef8b40c77764838ad0b1b7ab7989b54/roles/55ba49fe29884e64b57c3ad13188d554 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 17:26:13.466879 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c44037b-d6a7-40e6-b10f-98fbc2461905 None None] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:26:13.467311 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c44037b-d6a7-40e6-b10f-98fbc2461905 None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:26:13.467691 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c44037b-d6a7-40e6-b10f-98fbc2461905 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:26:13.509309 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.auth.core [None req-9c44037b-d6a7-40e6-b10f-98fbc2461905 None None] MFA Rules not processed for user `eef8b40c77764838ad0b1b7ab7989b54`. Rule list: `[]` (Enabled: `True`). {{(pid=85204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 17:26:13.510630 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-9c44037b-d6a7-40e6-b10f-98fbc2461905 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:26:13.590583 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1313/2612] 10.222.0.58 () {58 vars in 957 bytes} [Tue Oct 12 17:26:13 2021] POST /identity/v3/auth/tokens => generated 3407 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 17:26:13.594928 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c470c6-988e-485f-86ac-cffde5328174 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:26:13.674122 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c470c6-988e-485f-86ac-cffde5328174 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:26:13.681225 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc2ecc6-7f00-4894-8210-82fba279bec1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:26:13.681985 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc2ecc6-7f00-4894-8210-82fba279bec1 admin admin] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:26:13.682262 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc2ecc6-7f00-4894-8210-82fba279bec1 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:26:13.682542 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc2ecc6-7f00-4894-8210-82fba279bec1 admin admin] PATH_INFO: `/v3/projects` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:26:13.683300 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc2ecc6-7f00-4894-8210-82fba279bec1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:26:13.685247 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc2ecc6-7f00-4894-8210-82fba279bec1 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:26:13.717463 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1300/2613] 10.222.0.58 () {60 vars in 1152 bytes} [Tue Oct 12 17:26:13 2021] POST /identity/v3/projects => generated 387 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 17:26:13.719190 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c44037b-d6a7-40e6-b10f-98fbc2461905 None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:26:13.732986 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c44037b-d6a7-40e6-b10f-98fbc2461905 None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:26:13.836211 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb47042e-241a-48a2-82ef-ebe1ef30f471 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:26:13.836897 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb47042e-241a-48a2-82ef-ebe1ef30f471 admin admin] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:26:13.837200 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb47042e-241a-48a2-82ef-ebe1ef30f471 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:26:13.837461 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb47042e-241a-48a2-82ef-ebe1ef30f471 admin admin] PATH_INFO: `/v3/users` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:26:13.838222 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb47042e-241a-48a2-82ef-ebe1ef30f471 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:26:13.840135 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb47042e-241a-48a2-82ef-ebe1ef30f471 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:26:13.869271 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1314/2614] 10.222.0.58 () {60 vars in 1143 bytes} [Tue Oct 12 17:26:13 2021] POST /identity/v3/users => generated 300 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 17:26:13.874063 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc2ecc6-7f00-4894-8210-82fba279bec1 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:26:13.887027 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc2ecc6-7f00-4894-8210-82fba279bec1 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:26:13.892786 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b468070c-c50c-4666-bfb7-e9c469becadc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:26:13.893757 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b468070c-c50c-4666-bfb7-e9c469becadc admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:26:13.895837 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b468070c-c50c-4666-bfb7-e9c469becadc admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:26:13.896304 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b468070c-c50c-4666-bfb7-e9c469becadc admin admin] PATH_INFO: `/v3/roles` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:26:13.898738 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b468070c-c50c-4666-bfb7-e9c469becadc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:26:13.902770 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b468070c-c50c-4666-bfb7-e9c469becadc admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:26:13.915631 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1301/2615] 10.222.0.58 () {58 vars in 1121 bytes} [Tue Oct 12 17:26:13 2021] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 17:26:13.919878 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb47042e-241a-48a2-82ef-ebe1ef30f471 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:26:13.932145 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb47042e-241a-48a2-82ef-ebe1ef30f471 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:26:13.937657 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16594560-a513-4695-94ba-dd8482000eb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:26:13.938803 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16594560-a513-4695-94ba-dd8482000eb3 admin admin] REQUEST_METHOD: `PUT` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:26:13.939160 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16594560-a513-4695-94ba-dd8482000eb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:26:13.939505 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16594560-a513-4695-94ba-dd8482000eb3 admin admin] PATH_INFO: `/v3/projects/760a5e6bf2c446d3b468fbdc4b9a2c57/users/7f561e7edde6467c91cdcf4656dd1225/roles/610824e4f50f4fb8954610e98c1de784` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:26:13.954994 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16594560-a513-4695-94ba-dd8482000eb3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=760a5e6bf2c446d3b468fbdc4b9a2c57, user_id=7f561e7edde6467c91cdcf4656dd1225, role_id=610824e4f50f4fb8954610e98c1de784)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:26:13.957785 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16594560-a513-4695-94ba-dd8482000eb3 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:26:13.974510 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1315/2616] 10.222.0.58 () {60 vars in 1482 bytes} [Tue Oct 12 17:26:13 2021] PUT /identity/v3/projects/760a5e6bf2c446d3b468fbdc4b9a2c57/users/7f561e7edde6467c91cdcf4656dd1225/roles/610824e4f50f4fb8954610e98c1de784 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 17:26:13.979460 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b468070c-c50c-4666-bfb7-e9c469becadc admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:26:13.990018 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b468070c-c50c-4666-bfb7-e9c469becadc admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:26:14.054929 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78164bd9-5048-4924-baee-bd84b3026656 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:26:14.055802 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78164bd9-5048-4924-baee-bd84b3026656 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:26:14.056184 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78164bd9-5048-4924-baee-bd84b3026656 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:26:14.056529 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78164bd9-5048-4924-baee-bd84b3026656 admin admin] PATH_INFO: `/v3/roles` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:26:14.057348 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78164bd9-5048-4924-baee-bd84b3026656 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:26:14.059101 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78164bd9-5048-4924-baee-bd84b3026656 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:26:14.071050 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1302/2617] 10.222.0.58 () {58 vars in 1121 bytes} [Tue Oct 12 17:26:13 2021] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 17:26:14.075308 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16594560-a513-4695-94ba-dd8482000eb3 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:26:14.086788 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16594560-a513-4695-94ba-dd8482000eb3 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:26:14.094652 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d0ab15-19ff-4064-b625-92e4f702065c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:26:14.095927 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d0ab15-19ff-4064-b625-92e4f702065c admin admin] REQUEST_METHOD: `PUT` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:26:14.095927 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d0ab15-19ff-4064-b625-92e4f702065c admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:26:14.096150 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d0ab15-19ff-4064-b625-92e4f702065c admin admin] PATH_INFO: `/v3/projects/760a5e6bf2c446d3b468fbdc4b9a2c57/users/7f561e7edde6467c91cdcf4656dd1225/roles/610824e4f50f4fb8954610e98c1de784` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:26:14.098270 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d0ab15-19ff-4064-b625-92e4f702065c admin admin] RBAC: Authorizing `identity:create_grant(project_id=760a5e6bf2c446d3b468fbdc4b9a2c57, user_id=7f561e7edde6467c91cdcf4656dd1225, role_id=610824e4f50f4fb8954610e98c1de784)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:26:14.100804 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d0ab15-19ff-4064-b625-92e4f702065c admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:26:14.113026 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1316/2618] 10.222.0.58 () {60 vars in 1482 bytes} [Tue Oct 12 17:26:14 2021] PUT /identity/v3/projects/760a5e6bf2c446d3b468fbdc4b9a2c57/users/7f561e7edde6467c91cdcf4656dd1225/roles/610824e4f50f4fb8954610e98c1de784 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 17:26:14.123765 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a33821c-ad52-4078-bd2c-736c4d81e3e7 None None] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:26:14.124325 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a33821c-ad52-4078-bd2c-736c4d81e3e7 None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:26:14.124595 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a33821c-ad52-4078-bd2c-736c4d81e3e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:26:14.151426 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.auth.core [None req-7a33821c-ad52-4078-bd2c-736c4d81e3e7 None None] MFA Rules not processed for user `7f561e7edde6467c91cdcf4656dd1225`. Rule list: `[]` (Enabled: `True`). {{(pid=85205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 17:26:14.152598 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-7a33821c-ad52-4078-bd2c-736c4d81e3e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:26:14.223357 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1303/2619] 10.222.0.58 () {58 vars in 957 bytes} [Tue Oct 12 17:26:14 2021] POST /identity/v3/auth/tokens => generated 3474 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 17:26:14.231508 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d0ab15-19ff-4064-b625-92e4f702065c admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:26:14.233327 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-e4d0ab15-19ff-4064-b625-92e4f702065c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:26:14.306306 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d0ab15-19ff-4064-b625-92e4f702065c admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:26:14.310974 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c116d0-0c5d-46db-b119-897e8e8175ec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04704222b3d64a33a6c092fc641ccbb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:26:14.311736 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c116d0-0c5d-46db-b119-897e8e8175ec service cinder] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:26:14.312113 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c116d0-0c5d-46db-b119-897e8e8175ec service cinder] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:26:14.312447 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c116d0-0c5d-46db-b119-897e8e8175ec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:26:14.322825 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c116d0-0c5d-46db-b119-897e8e8175ec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:26:14.324379 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c116d0-0c5d-46db-b119-897e8e8175ec service cinder] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:26:14.344308 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1317/2620] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Oct 12 17:26:14 2021] GET /identity/v3/auth/tokens => generated 3474 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 17:26:14.404098 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a33821c-ad52-4078-bd2c-736c4d81e3e7 None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:26:14.486868 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a33821c-ad52-4078-bd2c-736c4d81e3e7 None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:26:14.494893 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05246ee4-b9a4-4a42-a2ab-91492f84e1b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:26:14.496149 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05246ee4-b9a4-4a42-a2ab-91492f84e1b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:26:14.496444 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05246ee4-b9a4-4a42-a2ab-91492f84e1b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:26:14.496762 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05246ee4-b9a4-4a42-a2ab-91492f84e1b3 admin admin] PATH_INFO: `/v3/users/eef8b40c77764838ad0b1b7ab7989b54` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:26:14.498146 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05246ee4-b9a4-4a42-a2ab-91492f84e1b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eef8b40c77764838ad0b1b7ab7989b54)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:26:14.500204 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05246ee4-b9a4-4a42-a2ab-91492f84e1b3 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:26:14.562863 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-05246ee4-b9a4-4a42-a2ab-91492f84e1b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eef8b40c77764838ad0b1b7ab7989b54'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:26:14.580566 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-05246ee4-b9a4-4a42-a2ab-91492f84e1b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eef8b40c77764838ad0b1b7ab7989b54'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:26:14.590597 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-05246ee4-b9a4-4a42-a2ab-91492f84e1b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eef8b40c77764838ad0b1b7ab7989b54'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:26:14.601161 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-05246ee4-b9a4-4a42-a2ab-91492f84e1b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eef8b40c77764838ad0b1b7ab7989b54'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:26:14.602684 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-05246ee4-b9a4-4a42-a2ab-91492f84e1b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eef8b40c77764838ad0b1b7ab7989b54'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:26:14.609115 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1304/2621] 10.222.0.58 () {58 vars in 1223 bytes} [Tue Oct 12 17:26:14 2021] DELETE /identity/v3/users/eef8b40c77764838ad0b1b7ab7989b54 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 17:26:14.613724 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d5cf83-918c-423d-8490-d3e8e7b58883 None None] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:26:14.614170 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d5cf83-918c-423d-8490-d3e8e7b58883 None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:26:14.614557 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d5cf83-918c-423d-8490-d3e8e7b58883 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:26:14.643888 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.auth.core [None req-71d5cf83-918c-423d-8490-d3e8e7b58883 None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 17:26:14.646724 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-71d5cf83-918c-423d-8490-d3e8e7b58883 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:26:14.725516 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1318/2622] 10.222.0.58 () {58 vars in 957 bytes} [Tue Oct 12 17:26:14 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 17:26:14.738517 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05246ee4-b9a4-4a42-a2ab-91492f84e1b3 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:26:14.745206 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-05246ee4-b9a4-4a42-a2ab-91492f84e1b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:26:14.815316 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05246ee4-b9a4-4a42-a2ab-91492f84e1b3 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:26:14.819854 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638de2ca-5d45-43f3-9c51-f64fa38a3293 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e65f6d0598e4c539134292b86fb43d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:26:14.821025 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638de2ca-5d45-43f3-9c51-f64fa38a3293 service neutron] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:26:14.821341 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638de2ca-5d45-43f3-9c51-f64fa38a3293 service neutron] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:26:14.821616 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638de2ca-5d45-43f3-9c51-f64fa38a3293 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:26:14.833448 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638de2ca-5d45-43f3-9c51-f64fa38a3293 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:26:14.835895 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638de2ca-5d45-43f3-9c51-f64fa38a3293 service neutron] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:26:14.846956 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1305/2623] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Oct 12 17:26:14 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 17:26:15.139628 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d5cf83-918c-423d-8490-d3e8e7b58883 None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:26:15.141189 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-71d5cf83-918c-423d-8490-d3e8e7b58883 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:26:15.154493 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d5cf83-918c-423d-8490-d3e8e7b58883 None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:26:15.159526 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5829333-824f-4dbf-8dbc-ed304241261f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:26:15.160517 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5829333-824f-4dbf-8dbc-ed304241261f admin admin] REQUEST_METHOD: `DELETE` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:26:15.160899 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5829333-824f-4dbf-8dbc-ed304241261f admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:26:15.161272 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5829333-824f-4dbf-8dbc-ed304241261f admin admin] PATH_INFO: `/v3/projects/bd8c030e24be495b9af421c282a4eb43` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:26:15.162663 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5829333-824f-4dbf-8dbc-ed304241261f admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd8c030e24be495b9af421c282a4eb43)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:26:15.164734 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5829333-824f-4dbf-8dbc-ed304241261f admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:26:15.217885 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-d5829333-824f-4dbf-8dbc-ed304241261f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd8c030e24be495b9af421c282a4eb43', 'request_id': 'req-d5829333-824f-4dbf-8dbc-ed304241261f'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:26:15.224336 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-d5829333-824f-4dbf-8dbc-ed304241261f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd8c030e24be495b9af421c282a4eb43', 'request_id': 'req-d5829333-824f-4dbf-8dbc-ed304241261f'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:26:15.232349 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-d5829333-824f-4dbf-8dbc-ed304241261f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd8c030e24be495b9af421c282a4eb43', 'request_id': 'req-d5829333-824f-4dbf-8dbc-ed304241261f'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:26:15.250728 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-d5829333-824f-4dbf-8dbc-ed304241261f admin admin] The token cache is being invalidate because project bd8c030e24be495b9af421c282a4eb43 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=85204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 17:26:15.250728 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-d5829333-824f-4dbf-8dbc-ed304241261f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:26:15.252958 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-d5829333-824f-4dbf-8dbc-ed304241261f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:26:15.258233 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1319/2624] 10.222.0.58 () {58 vars in 1232 bytes} [Tue Oct 12 17:26:15 2021] DELETE /identity/v3/projects/bd8c030e24be495b9af421c282a4eb43 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 17:26:15.260818 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638de2ca-5d45-43f3-9c51-f64fa38a3293 service neutron] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:26:15.275280 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638de2ca-5d45-43f3-9c51-f64fa38a3293 service neutron] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:26:15.342586 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f672a9-a80a-4bfa-9d6b-b29a97750bd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:26:15.343608 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f672a9-a80a-4bfa-9d6b-b29a97750bd6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:26:15.343991 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f672a9-a80a-4bfa-9d6b-b29a97750bd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:26:15.344899 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f672a9-a80a-4bfa-9d6b-b29a97750bd6 admin admin] PATH_INFO: `/v3/users/7f561e7edde6467c91cdcf4656dd1225` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:26:15.346938 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f672a9-a80a-4bfa-9d6b-b29a97750bd6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f561e7edde6467c91cdcf4656dd1225)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:26:15.349108 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f672a9-a80a-4bfa-9d6b-b29a97750bd6 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:26:15.408440 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-03f672a9-a80a-4bfa-9d6b-b29a97750bd6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f561e7edde6467c91cdcf4656dd1225'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:26:15.421114 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-03f672a9-a80a-4bfa-9d6b-b29a97750bd6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f561e7edde6467c91cdcf4656dd1225'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:26:15.434065 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-03f672a9-a80a-4bfa-9d6b-b29a97750bd6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f561e7edde6467c91cdcf4656dd1225'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:26:15.443480 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-03f672a9-a80a-4bfa-9d6b-b29a97750bd6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f561e7edde6467c91cdcf4656dd1225'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:26:15.444097 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-03f672a9-a80a-4bfa-9d6b-b29a97750bd6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f561e7edde6467c91cdcf4656dd1225'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:26:15.456480 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1306/2625] 10.222.0.58 () {58 vars in 1223 bytes} [Tue Oct 12 17:26:15 2021] DELETE /identity/v3/users/7f561e7edde6467c91cdcf4656dd1225 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 17:26:15.946251 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5829333-824f-4dbf-8dbc-ed304241261f admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:26:15.957592 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-d5829333-824f-4dbf-8dbc-ed304241261f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:26:15.980254 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5829333-824f-4dbf-8dbc-ed304241261f admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:26:16.084181 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ee67a0-85f9-4b7c-8ac8-4b9102d78934 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:26:16.086640 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ee67a0-85f9-4b7c-8ac8-4b9102d78934 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:26:16.098165 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ee67a0-85f9-4b7c-8ac8-4b9102d78934 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:26:16.098835 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ee67a0-85f9-4b7c-8ac8-4b9102d78934 admin admin] PATH_INFO: `/v3/projects/760a5e6bf2c446d3b468fbdc4b9a2c57` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:26:16.102378 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ee67a0-85f9-4b7c-8ac8-4b9102d78934 admin admin] RBAC: Authorizing `identity:delete_project(project_id=760a5e6bf2c446d3b468fbdc4b9a2c57)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:26:16.104678 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ee67a0-85f9-4b7c-8ac8-4b9102d78934 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:26:16.213610 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-73ee67a0-85f9-4b7c-8ac8-4b9102d78934 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '760a5e6bf2c446d3b468fbdc4b9a2c57', 'request_id': 'req-73ee67a0-85f9-4b7c-8ac8-4b9102d78934'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:26:16.222538 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-73ee67a0-85f9-4b7c-8ac8-4b9102d78934 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '760a5e6bf2c446d3b468fbdc4b9a2c57', 'request_id': 'req-73ee67a0-85f9-4b7c-8ac8-4b9102d78934'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:26:16.229894 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-73ee67a0-85f9-4b7c-8ac8-4b9102d78934 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '760a5e6bf2c446d3b468fbdc4b9a2c57', 'request_id': 'req-73ee67a0-85f9-4b7c-8ac8-4b9102d78934'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:26:16.252732 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-73ee67a0-85f9-4b7c-8ac8-4b9102d78934 admin admin] The token cache is being invalidate because project 760a5e6bf2c446d3b468fbdc4b9a2c57 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=85204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 17:26:16.254356 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-73ee67a0-85f9-4b7c-8ac8-4b9102d78934 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:26:16.256250 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-73ee67a0-85f9-4b7c-8ac8-4b9102d78934 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:26:16.259467 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1320/2626] 10.222.0.58 () {58 vars in 1232 bytes} [Tue Oct 12 17:26:15 2021] DELETE /identity/v3/projects/760a5e6bf2c446d3b468fbdc4b9a2c57 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 17:26:16.265850 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b296ab5a-9bc2-4b54-91d9-4307ca8807c4 None None] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:26:16.266360 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b296ab5a-9bc2-4b54-91d9-4307ca8807c4 None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:26:16.266360 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b296ab5a-9bc2-4b54-91d9-4307ca8807c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:26:16.286857 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.auth.core [None req-b296ab5a-9bc2-4b54-91d9-4307ca8807c4 None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 17:26:16.288165 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-b296ab5a-9bc2-4b54-91d9-4307ca8807c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:26:16.390552 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1307/2627] 10.222.0.58 () {58 vars in 957 bytes} [Tue Oct 12 17:26:16 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 17:26:16.392323 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2ddd2a-61d4-460c-b121-fe93ad674518 None None] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:26:16.392493 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2ddd2a-61d4-460c-b121-fe93ad674518 None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:26:16.392690 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2ddd2a-61d4-460c-b121-fe93ad674518 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:26:16.414965 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.auth.core [None req-bb2ddd2a-61d4-460c-b121-fe93ad674518 None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 17:26:16.416452 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-bb2ddd2a-61d4-460c-b121-fe93ad674518 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:26:16.431201 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b296ab5a-9bc2-4b54-91d9-4307ca8807c4 None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:26:16.441559 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b296ab5a-9bc2-4b54-91d9-4307ca8807c4 None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:26:16.442080 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1321/2628] 10.222.0.58 () {58 vars in 957 bytes} [Tue Oct 12 17:26:16 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 17:26:16.447516 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38dc8ff0-833e-4c30-abd8-0fe6f91caa26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:26:16.448407 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dc8ff0-833e-4c30-abd8-0fe6f91caa26 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:26:16.448852 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dc8ff0-833e-4c30-abd8-0fe6f91caa26 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:26:16.449278 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dc8ff0-833e-4c30-abd8-0fe6f91caa26 admin admin] PATH_INFO: `/v3/domains` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:26:16.450206 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38dc8ff0-833e-4c30-abd8-0fe6f91caa26 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 17:26:16.450682 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38dc8ff0-833e-4c30-abd8-0fe6f91caa26 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:26:16.452439 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38dc8ff0-833e-4c30-abd8-0fe6f91caa26 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:26:16.482161 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2ddd2a-61d4-460c-b121-fe93ad674518 None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:26:16.486709 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1308/2629] 10.222.0.58 () {58 vars in 1152 bytes} [Tue Oct 12 17:26:16 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 17:26:16.491805 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2ddd2a-61d4-460c-b121-fe93ad674518 None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:26:16.496770 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376e3272-f54a-4ebf-9d65-c1a06a9fe8fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:26:16.497425 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376e3272-f54a-4ebf-9d65-c1a06a9fe8fc admin admin] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:26:16.497707 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376e3272-f54a-4ebf-9d65-c1a06a9fe8fc admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:26:16.498018 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376e3272-f54a-4ebf-9d65-c1a06a9fe8fc admin admin] PATH_INFO: `/v3/projects` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:26:16.498731 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376e3272-f54a-4ebf-9d65-c1a06a9fe8fc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:26:16.500606 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376e3272-f54a-4ebf-9d65-c1a06a9fe8fc admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:26:16.537528 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38dc8ff0-833e-4c30-abd8-0fe6f91caa26 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:26:16.538272 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1322/2630] 10.222.0.58 () {60 vars in 1152 bytes} [Tue Oct 12 17:26:16 2021] POST /identity/v3/projects => generated 393 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 17:26:16.550713 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38dc8ff0-833e-4c30-abd8-0fe6f91caa26 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:26:16.628404 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015f20e5-ee81-481d-8649-b1720ddfbe75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:26:16.629529 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015f20e5-ee81-481d-8649-b1720ddfbe75 admin admin] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:26:16.630140 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015f20e5-ee81-481d-8649-b1720ddfbe75 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:26:16.630623 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015f20e5-ee81-481d-8649-b1720ddfbe75 admin admin] PATH_INFO: `/v3/users` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:26:16.631601 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015f20e5-ee81-481d-8649-b1720ddfbe75 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:26:16.634041 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015f20e5-ee81-481d-8649-b1720ddfbe75 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:26:16.661653 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1309/2631] 10.222.0.58 () {60 vars in 1143 bytes} [Tue Oct 12 17:26:16 2021] POST /identity/v3/users => generated 297 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 17:26:16.666825 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376e3272-f54a-4ebf-9d65-c1a06a9fe8fc admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:26:16.682225 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376e3272-f54a-4ebf-9d65-c1a06a9fe8fc admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:26:16.696806 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ab0cfa-a112-48cb-bc25-b57811c6a25a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:26:16.697599 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ab0cfa-a112-48cb-bc25-b57811c6a25a admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:26:16.698086 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ab0cfa-a112-48cb-bc25-b57811c6a25a admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:26:16.698444 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ab0cfa-a112-48cb-bc25-b57811c6a25a admin admin] PATH_INFO: `/v3/roles` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:26:16.699325 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ab0cfa-a112-48cb-bc25-b57811c6a25a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:26:16.701567 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ab0cfa-a112-48cb-bc25-b57811c6a25a admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:26:16.762244 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015f20e5-ee81-481d-8649-b1720ddfbe75 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:26:16.763775 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1323/2632] 10.222.0.58 () {58 vars in 1121 bytes} [Tue Oct 12 17:26:16 2021] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 17:26:16.781128 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015f20e5-ee81-481d-8649-b1720ddfbe75 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:26:16.786714 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd139a68-802e-4e60-a733-d57e74cc5024 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:26:16.787511 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd139a68-802e-4e60-a733-d57e74cc5024 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:26:16.787868 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd139a68-802e-4e60-a733-d57e74cc5024 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:26:16.788278 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd139a68-802e-4e60-a733-d57e74cc5024 admin admin] PATH_INFO: `/v3/roles` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:26:16.789729 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd139a68-802e-4e60-a733-d57e74cc5024 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:26:16.791494 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd139a68-802e-4e60-a733-d57e74cc5024 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:26:16.822162 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1310/2633] 10.222.0.58 () {58 vars in 1121 bytes} [Tue Oct 12 17:26:16 2021] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 17:26:16.826391 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ab0cfa-a112-48cb-bc25-b57811c6a25a admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:26:16.837638 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ab0cfa-a112-48cb-bc25-b57811c6a25a admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:26:16.842939 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441f7b72-ca84-4661-8c80-dfbe4a868ca2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:26:16.843993 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441f7b72-ca84-4661-8c80-dfbe4a868ca2 admin admin] REQUEST_METHOD: `PUT` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:26:16.844377 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441f7b72-ca84-4661-8c80-dfbe4a868ca2 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:26:16.845231 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441f7b72-ca84-4661-8c80-dfbe4a868ca2 admin admin] PATH_INFO: `/v3/projects/09e8d123531b4e84ba4c8e57a86ee0e5/users/76bfd7bb14c24323893aad4be9a36bdd/roles/55ba49fe29884e64b57c3ad13188d554` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:26:16.862682 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441f7b72-ca84-4661-8c80-dfbe4a868ca2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=09e8d123531b4e84ba4c8e57a86ee0e5, user_id=76bfd7bb14c24323893aad4be9a36bdd, role_id=55ba49fe29884e64b57c3ad13188d554)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:26:16.865797 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441f7b72-ca84-4661-8c80-dfbe4a868ca2 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:26:16.900927 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1324/2634] 10.222.0.58 () {60 vars in 1482 bytes} [Tue Oct 12 17:26:16 2021] PUT /identity/v3/projects/09e8d123531b4e84ba4c8e57a86ee0e5/users/76bfd7bb14c24323893aad4be9a36bdd/roles/55ba49fe29884e64b57c3ad13188d554 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 17:26:16.905467 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e48f99-5c72-4a11-96f0-22f870db7e49 None None] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:26:16.907713 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e48f99-5c72-4a11-96f0-22f870db7e49 None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:26:16.908165 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e48f99-5c72-4a11-96f0-22f870db7e49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:26:16.942646 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.auth.core [None req-c4e48f99-5c72-4a11-96f0-22f870db7e49 None None] MFA Rules not processed for user `76bfd7bb14c24323893aad4be9a36bdd`. Rule list: `[]` (Enabled: `True`). {{(pid=85205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 17:26:16.944963 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-c4e48f99-5c72-4a11-96f0-22f870db7e49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:26:17.073442 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1311/2635] 10.222.0.58 () {58 vars in 957 bytes} [Tue Oct 12 17:26:16 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 17:26:17.078368 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441f7b72-ca84-4661-8c80-dfbe4a868ca2 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:26:17.180910 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441f7b72-ca84-4661-8c80-dfbe4a868ca2 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:26:17.187213 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3338beef-2095-4223-9ee9-230773f2e8a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:26:17.188266 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3338beef-2095-4223-9ee9-230773f2e8a3 admin admin] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:26:17.188552 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3338beef-2095-4223-9ee9-230773f2e8a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:26:17.188825 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3338beef-2095-4223-9ee9-230773f2e8a3 admin admin] PATH_INFO: `/v3/projects` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:26:17.189538 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3338beef-2095-4223-9ee9-230773f2e8a3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:26:17.192290 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3338beef-2095-4223-9ee9-230773f2e8a3 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:26:17.251877 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1325/2636] 10.222.0.58 () {60 vars in 1152 bytes} [Tue Oct 12 17:26:17 2021] POST /identity/v3/projects => generated 393 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 17:26:17.253117 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e48f99-5c72-4a11-96f0-22f870db7e49 None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:26:17.280512 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e48f99-5c72-4a11-96f0-22f870db7e49 None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:26:17.368998 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4795d7-8981-41ce-b148-a75855f913e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:26:17.369908 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4795d7-8981-41ce-b148-a75855f913e6 admin admin] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:26:17.370440 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4795d7-8981-41ce-b148-a75855f913e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:26:17.370440 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4795d7-8981-41ce-b148-a75855f913e6 admin admin] PATH_INFO: `/v3/users` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:26:17.371718 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4795d7-8981-41ce-b148-a75855f913e6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:26:17.374904 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4795d7-8981-41ce-b148-a75855f913e6 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:26:17.417954 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1312/2637] 10.222.0.58 () {60 vars in 1143 bytes} [Tue Oct 12 17:26:17 2021] POST /identity/v3/users => generated 303 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 17:26:17.420056 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3338beef-2095-4223-9ee9-230773f2e8a3 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:26:17.436111 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3338beef-2095-4223-9ee9-230773f2e8a3 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:26:17.442102 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5cceb8-068e-4f33-9562-0bf808c65726 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:26:17.443088 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5cceb8-068e-4f33-9562-0bf808c65726 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:26:17.443571 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5cceb8-068e-4f33-9562-0bf808c65726 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:26:17.444041 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5cceb8-068e-4f33-9562-0bf808c65726 admin admin] PATH_INFO: `/v3/roles` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:26:17.446155 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5cceb8-068e-4f33-9562-0bf808c65726 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:26:17.451078 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5cceb8-068e-4f33-9562-0bf808c65726 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:26:17.493522 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1326/2638] 10.222.0.58 () {58 vars in 1121 bytes} [Tue Oct 12 17:26:17 2021] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 17:26:17.494558 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4795d7-8981-41ce-b148-a75855f913e6 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:26:17.511074 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4795d7-8981-41ce-b148-a75855f913e6 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:26:17.527062 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d000610-3234-48a0-84b3-254f363e2662 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:26:17.528009 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d000610-3234-48a0-84b3-254f363e2662 admin admin] REQUEST_METHOD: `PUT` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:26:17.528302 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d000610-3234-48a0-84b3-254f363e2662 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:26:17.528843 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d000610-3234-48a0-84b3-254f363e2662 admin admin] PATH_INFO: `/v3/projects/9aadbcd655ef42e1b07a51b1be0dbe21/users/e0080c1e57d840d294f56b753d7731a8/roles/610824e4f50f4fb8954610e98c1de784` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:26:17.566644 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d000610-3234-48a0-84b3-254f363e2662 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9aadbcd655ef42e1b07a51b1be0dbe21, user_id=e0080c1e57d840d294f56b753d7731a8, role_id=610824e4f50f4fb8954610e98c1de784)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:26:17.574014 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d000610-3234-48a0-84b3-254f363e2662 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:26:17.605674 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5cceb8-068e-4f33-9562-0bf808c65726 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:26:17.606418 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1313/2639] 10.222.0.58 () {60 vars in 1482 bytes} [Tue Oct 12 17:26:17 2021] PUT /identity/v3/projects/9aadbcd655ef42e1b07a51b1be0dbe21/users/e0080c1e57d840d294f56b753d7731a8/roles/610824e4f50f4fb8954610e98c1de784 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 17:26:17.620764 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5cceb8-068e-4f33-9562-0bf808c65726 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:26:17.750630 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43106906-f8e6-4e12-a695-2bb7942200c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:26:17.751333 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43106906-f8e6-4e12-a695-2bb7942200c3 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:26:17.751613 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43106906-f8e6-4e12-a695-2bb7942200c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:26:17.751887 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43106906-f8e6-4e12-a695-2bb7942200c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:26:17.752642 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43106906-f8e6-4e12-a695-2bb7942200c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:26:17.754442 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43106906-f8e6-4e12-a695-2bb7942200c3 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:26:17.777031 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1327/2640] 10.222.0.58 () {58 vars in 1121 bytes} [Tue Oct 12 17:26:17 2021] GET /identity/v3/roles => generated 1420 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 17:26:17.782692 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d000610-3234-48a0-84b3-254f363e2662 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:26:17.819135 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d000610-3234-48a0-84b3-254f363e2662 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:26:17.837839 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8596058b-2b95-46ac-ae0d-1f3af8d23c3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:26:17.842190 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8596058b-2b95-46ac-ae0d-1f3af8d23c3b admin admin] REQUEST_METHOD: `PUT` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:26:17.842523 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8596058b-2b95-46ac-ae0d-1f3af8d23c3b admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:26:17.842805 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8596058b-2b95-46ac-ae0d-1f3af8d23c3b admin admin] PATH_INFO: `/v3/projects/9aadbcd655ef42e1b07a51b1be0dbe21/users/e0080c1e57d840d294f56b753d7731a8/roles/610824e4f50f4fb8954610e98c1de784` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:26:17.851708 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8596058b-2b95-46ac-ae0d-1f3af8d23c3b admin admin] RBAC: Authorizing `identity:create_grant(project_id=9aadbcd655ef42e1b07a51b1be0dbe21, user_id=e0080c1e57d840d294f56b753d7731a8, role_id=610824e4f50f4fb8954610e98c1de784)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:26:17.861291 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8596058b-2b95-46ac-ae0d-1f3af8d23c3b admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:26:17.888544 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1314/2641] 10.222.0.58 () {60 vars in 1482 bytes} [Tue Oct 12 17:26:17 2021] PUT /identity/v3/projects/9aadbcd655ef42e1b07a51b1be0dbe21/users/e0080c1e57d840d294f56b753d7731a8/roles/610824e4f50f4fb8954610e98c1de784 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 17:26:17.899615 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a794cfa4-e05d-4233-a591-096c73f1a90c None None] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:26:17.899939 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a794cfa4-e05d-4233-a591-096c73f1a90c None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:26:17.900216 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a794cfa4-e05d-4233-a591-096c73f1a90c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:26:17.986483 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.auth.core [None req-a794cfa4-e05d-4233-a591-096c73f1a90c None None] MFA Rules not processed for user `e0080c1e57d840d294f56b753d7731a8`. Rule list: `[]` (Enabled: `True`). {{(pid=85204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 17:26:17.987721 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-a794cfa4-e05d-4233-a591-096c73f1a90c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:26:18.111494 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1328/2642] 10.222.0.58 () {58 vars in 957 bytes} [Tue Oct 12 17:26:17 2021] POST /identity/v3/auth/tokens => generated 3480 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 17:26:18.124169 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8596058b-2b95-46ac-ae0d-1f3af8d23c3b admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:26:18.126389 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-8596058b-2b95-46ac-ae0d-1f3af8d23c3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:26:18.254462 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8596058b-2b95-46ac-ae0d-1f3af8d23c3b admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:26:18.259881 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a50fe4a-fcd4-4faf-9758-697e12178d20 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04704222b3d64a33a6c092fc641ccbb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:26:18.270002 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a50fe4a-fcd4-4faf-9758-697e12178d20 service cinder] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:26:18.270002 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a50fe4a-fcd4-4faf-9758-697e12178d20 service cinder] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:26:18.270002 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a50fe4a-fcd4-4faf-9758-697e12178d20 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:26:18.283756 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a50fe4a-fcd4-4faf-9758-697e12178d20 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:26:18.285215 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a50fe4a-fcd4-4faf-9758-697e12178d20 service cinder] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:26:18.299466 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1315/2643] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Oct 12 17:26:18 2021] GET /identity/v3/auth/tokens => generated 3480 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 17:26:18.387242 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a794cfa4-e05d-4233-a591-096c73f1a90c None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:26:18.390565 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-a794cfa4-e05d-4233-a591-096c73f1a90c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:26:18.414966 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a794cfa4-e05d-4233-a591-096c73f1a90c None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:26:18.419378 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea84d1bd-8ec9-4da9-9cbc-470fb9b266e5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04704222b3d64a33a6c092fc641ccbb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:26:18.420052 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea84d1bd-8ec9-4da9-9cbc-470fb9b266e5 service cinder] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:26:18.420343 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea84d1bd-8ec9-4da9-9cbc-470fb9b266e5 service cinder] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:26:18.422628 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea84d1bd-8ec9-4da9-9cbc-470fb9b266e5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:26:18.523741 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea84d1bd-8ec9-4da9-9cbc-470fb9b266e5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:26:18.525208 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea84d1bd-8ec9-4da9-9cbc-470fb9b266e5 service cinder] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:26:18.535223 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5014c6c2-98d2-4098-8fe1-dcf6a8d87f65 None None] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:26:18.535579 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5014c6c2-98d2-4098-8fe1-dcf6a8d87f65 None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:26:18.535936 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5014c6c2-98d2-4098-8fe1-dcf6a8d87f65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:26:18.545592 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1329/2644] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Oct 12 17:26:18 2021] GET /identity/v3/auth/tokens => generated 3413 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 17:26:18.572564 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.auth.core [None req-5014c6c2-98d2-4098-8fe1-dcf6a8d87f65 None None] MFA Rules not processed for user `bc72d7500ddb4854ac7ddc9b8965dfa3`. Rule list: `[]` (Enabled: `True`). {{(pid=85205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 17:26:18.573778 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-5014c6c2-98d2-4098-8fe1-dcf6a8d87f65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:26:18.662308 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1316/2645] 10.222.0.58 () {58 vars in 957 bytes} [Tue Oct 12 17:26:18 2021] POST /identity/v3/auth/tokens => generated 3470 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 17:26:18.675605 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea84d1bd-8ec9-4da9-9cbc-470fb9b266e5 service cinder] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:26:18.677367 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-ea84d1bd-8ec9-4da9-9cbc-470fb9b266e5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:26:18.746997 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea84d1bd-8ec9-4da9-9cbc-470fb9b266e5 service cinder] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:26:18.751366 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41acb05e-c176-46fa-b1eb-6bbefde413c6 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ff84015069041f2bf33e3fd55b92e44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:26:18.752029 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41acb05e-c176-46fa-b1eb-6bbefde413c6 service glance] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:26:18.752313 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41acb05e-c176-46fa-b1eb-6bbefde413c6 service glance] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:26:18.752592 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41acb05e-c176-46fa-b1eb-6bbefde413c6 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:26:18.754626 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-41acb05e-c176-46fa-b1eb-6bbefde413c6 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:26:18.828075 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41acb05e-c176-46fa-b1eb-6bbefde413c6 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:26:18.829691 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41acb05e-c176-46fa-b1eb-6bbefde413c6 service glance] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:26:18.839989 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1330/2646] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Oct 12 17:26:18 2021] GET /identity/v3/auth/tokens => generated 3405 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 17:26:18.965783 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4777abd-e970-48e0-9ac0-c49a74dea670 None None] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:26:18.966146 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4777abd-e970-48e0-9ac0-c49a74dea670 None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:26:18.966426 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4777abd-e970-48e0-9ac0-c49a74dea670 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:26:19.029675 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.auth.core [None req-d4777abd-e970-48e0-9ac0-c49a74dea670 None None] MFA Rules not processed for user `387a65d2bfb142499c9b3b0ac946f48b`. Rule list: `[]` (Enabled: `True`). {{(pid=85205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 17:26:19.030941 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-d4777abd-e970-48e0-9ac0-c49a74dea670 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:26:19.096094 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1317/2647] 10.222.0.58 () {58 vars in 1009 bytes} [Tue Oct 12 17:26:18 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 17:26:19.143287 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41acb05e-c176-46fa-b1eb-6bbefde413c6 service glance] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:26:19.144699 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-41acb05e-c176-46fa-b1eb-6bbefde413c6 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:26:19.235272 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41acb05e-c176-46fa-b1eb-6bbefde413c6 service glance] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:26:19.240501 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657d1f71-5509-413e-a10e-ee22f110a104 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdeb0a451344c9987b4134b957ffa22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:26:19.241149 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657d1f71-5509-413e-a10e-ee22f110a104 service swift] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:26:19.241437 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657d1f71-5509-413e-a10e-ee22f110a104 service swift] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:26:19.241735 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657d1f71-5509-413e-a10e-ee22f110a104 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:26:19.250198 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657d1f71-5509-413e-a10e-ee22f110a104 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:26:19.251765 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657d1f71-5509-413e-a10e-ee22f110a104 service swift] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:26:19.259845 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1331/2648] 10.222.0.58 () {60 vars in 1384 bytes} [Tue Oct 12 17:26:19 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 12 17:26:22.142911 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4777abd-e970-48e0-9ac0-c49a74dea670 None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:26:22.260765 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4777abd-e970-48e0-9ac0-c49a74dea670 None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:26:22.268631 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb35d307-eddb-475c-aa41-828ec6101d5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:26:22.269647 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb35d307-eddb-475c-aa41-828ec6101d5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:26:22.270037 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb35d307-eddb-475c-aa41-828ec6101d5b admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:26:22.270383 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb35d307-eddb-475c-aa41-828ec6101d5b admin admin] PATH_INFO: `/v3/users/76bfd7bb14c24323893aad4be9a36bdd` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:26:22.271716 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb35d307-eddb-475c-aa41-828ec6101d5b admin admin] RBAC: Authorizing `identity:delete_user(user_id=76bfd7bb14c24323893aad4be9a36bdd)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:26:22.273807 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb35d307-eddb-475c-aa41-828ec6101d5b admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:26:22.352392 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-fb35d307-eddb-475c-aa41-828ec6101d5b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '76bfd7bb14c24323893aad4be9a36bdd'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:26:22.366303 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-fb35d307-eddb-475c-aa41-828ec6101d5b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '76bfd7bb14c24323893aad4be9a36bdd'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:26:22.377248 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-fb35d307-eddb-475c-aa41-828ec6101d5b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '76bfd7bb14c24323893aad4be9a36bdd'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:26:22.387633 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-fb35d307-eddb-475c-aa41-828ec6101d5b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '76bfd7bb14c24323893aad4be9a36bdd'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:26:22.388550 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-fb35d307-eddb-475c-aa41-828ec6101d5b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '76bfd7bb14c24323893aad4be9a36bdd'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:26:22.401155 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99ed7d8-02df-4196-bed7-a638de7133ad None None] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:26:22.401688 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99ed7d8-02df-4196-bed7-a638de7133ad None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:26:22.402104 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99ed7d8-02df-4196-bed7-a638de7133ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:26:22.403916 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1318/2649] 10.222.0.58 () {58 vars in 1223 bytes} [Tue Oct 12 17:26:22 2021] DELETE /identity/v3/users/76bfd7bb14c24323893aad4be9a36bdd => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 17:26:22.425035 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.auth.core [None req-a99ed7d8-02df-4196-bed7-a638de7133ad None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 17:26:22.426431 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-a99ed7d8-02df-4196-bed7-a638de7133ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:26:22.516845 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1332/2650] 10.222.0.58 () {58 vars in 957 bytes} [Tue Oct 12 17:26:22 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 17:26:22.527600 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb35d307-eddb-475c-aa41-828ec6101d5b admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:26:22.529127 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-fb35d307-eddb-475c-aa41-828ec6101d5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:26:22.601431 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb35d307-eddb-475c-aa41-828ec6101d5b admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:26:22.610230 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011ea0e0-9178-4ee5-9a43-bb9071a6d99a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e65f6d0598e4c539134292b86fb43d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:26:22.613459 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011ea0e0-9178-4ee5-9a43-bb9071a6d99a service neutron] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:26:22.613765 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011ea0e0-9178-4ee5-9a43-bb9071a6d99a service neutron] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:26:22.614076 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011ea0e0-9178-4ee5-9a43-bb9071a6d99a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:26:22.625417 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011ea0e0-9178-4ee5-9a43-bb9071a6d99a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:26:22.627192 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011ea0e0-9178-4ee5-9a43-bb9071a6d99a service neutron] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:26:22.638557 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1319/2651] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Oct 12 17:26:22 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 17:26:22.972474 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99ed7d8-02df-4196-bed7-a638de7133ad None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:26:22.977279 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-a99ed7d8-02df-4196-bed7-a638de7133ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:26:22.992993 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99ed7d8-02df-4196-bed7-a638de7133ad None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:26:22.998172 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339bee63-0380-4867-9645-ed1dcce905a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:26:22.999175 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339bee63-0380-4867-9645-ed1dcce905a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:26:22.999460 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339bee63-0380-4867-9645-ed1dcce905a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:26:22.999737 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339bee63-0380-4867-9645-ed1dcce905a5 admin admin] PATH_INFO: `/v3/projects/09e8d123531b4e84ba4c8e57a86ee0e5` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:26:23.000946 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339bee63-0380-4867-9645-ed1dcce905a5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=09e8d123531b4e84ba4c8e57a86ee0e5)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:26:23.002936 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339bee63-0380-4867-9645-ed1dcce905a5 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:26:23.058099 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-339bee63-0380-4867-9645-ed1dcce905a5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '09e8d123531b4e84ba4c8e57a86ee0e5', 'request_id': 'req-339bee63-0380-4867-9645-ed1dcce905a5'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:26:23.064176 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-339bee63-0380-4867-9645-ed1dcce905a5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '09e8d123531b4e84ba4c8e57a86ee0e5', 'request_id': 'req-339bee63-0380-4867-9645-ed1dcce905a5'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:26:23.070734 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-339bee63-0380-4867-9645-ed1dcce905a5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '09e8d123531b4e84ba4c8e57a86ee0e5', 'request_id': 'req-339bee63-0380-4867-9645-ed1dcce905a5'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:26:23.084648 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-339bee63-0380-4867-9645-ed1dcce905a5 admin admin] The token cache is being invalidate because project 09e8d123531b4e84ba4c8e57a86ee0e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=85204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 17:26:23.084952 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-339bee63-0380-4867-9645-ed1dcce905a5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:26:23.087326 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-339bee63-0380-4867-9645-ed1dcce905a5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:26:23.088582 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1333/2652] 10.222.0.58 () {58 vars in 1232 bytes} [Tue Oct 12 17:26:22 2021] DELETE /identity/v3/projects/09e8d123531b4e84ba4c8e57a86ee0e5 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 17:26:23.092603 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011ea0e0-9178-4ee5-9a43-bb9071a6d99a service neutron] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:26:23.103518 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011ea0e0-9178-4ee5-9a43-bb9071a6d99a service neutron] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:26:23.174807 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e778c81-977e-4ad9-a11d-dc4b66ee39a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:26:23.175458 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e778c81-977e-4ad9-a11d-dc4b66ee39a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:26:23.175458 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e778c81-977e-4ad9-a11d-dc4b66ee39a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:26:23.175811 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e778c81-977e-4ad9-a11d-dc4b66ee39a0 admin admin] PATH_INFO: `/v3/users/e0080c1e57d840d294f56b753d7731a8` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:26:23.177015 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e778c81-977e-4ad9-a11d-dc4b66ee39a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e0080c1e57d840d294f56b753d7731a8)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:26:23.178972 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e778c81-977e-4ad9-a11d-dc4b66ee39a0 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:26:23.241199 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-0e778c81-977e-4ad9-a11d-dc4b66ee39a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e0080c1e57d840d294f56b753d7731a8'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:26:23.292822 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-0e778c81-977e-4ad9-a11d-dc4b66ee39a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e0080c1e57d840d294f56b753d7731a8'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:26:23.297741 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-0e778c81-977e-4ad9-a11d-dc4b66ee39a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e0080c1e57d840d294f56b753d7731a8'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:26:23.306660 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-0e778c81-977e-4ad9-a11d-dc4b66ee39a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e0080c1e57d840d294f56b753d7731a8'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:26:23.307381 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-0e778c81-977e-4ad9-a11d-dc4b66ee39a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e0080c1e57d840d294f56b753d7731a8'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:26:23.317508 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1320/2653] 10.222.0.58 () {58 vars in 1223 bytes} [Tue Oct 12 17:26:23 2021] DELETE /identity/v3/users/e0080c1e57d840d294f56b753d7731a8 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 17:26:23.637898 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339bee63-0380-4867-9645-ed1dcce905a5 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:26:23.639755 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-339bee63-0380-4867-9645-ed1dcce905a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:26:23.680343 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339bee63-0380-4867-9645-ed1dcce905a5 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:26:23.769792 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fe1114-c95e-4d12-81d3-60f78c424a8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:26:23.770933 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fe1114-c95e-4d12-81d3-60f78c424a8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:26:23.774340 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fe1114-c95e-4d12-81d3-60f78c424a8c admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:26:23.774724 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fe1114-c95e-4d12-81d3-60f78c424a8c admin admin] PATH_INFO: `/v3/projects/9aadbcd655ef42e1b07a51b1be0dbe21` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:26:23.776191 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fe1114-c95e-4d12-81d3-60f78c424a8c admin admin] RBAC: Authorizing `identity:delete_project(project_id=9aadbcd655ef42e1b07a51b1be0dbe21)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:26:23.786040 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fe1114-c95e-4d12-81d3-60f78c424a8c admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:26:23.849919 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-34fe1114-c95e-4d12-81d3-60f78c424a8c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9aadbcd655ef42e1b07a51b1be0dbe21', 'request_id': 'req-34fe1114-c95e-4d12-81d3-60f78c424a8c'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:26:23.866298 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-34fe1114-c95e-4d12-81d3-60f78c424a8c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9aadbcd655ef42e1b07a51b1be0dbe21', 'request_id': 'req-34fe1114-c95e-4d12-81d3-60f78c424a8c'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:26:23.878631 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-34fe1114-c95e-4d12-81d3-60f78c424a8c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9aadbcd655ef42e1b07a51b1be0dbe21', 'request_id': 'req-34fe1114-c95e-4d12-81d3-60f78c424a8c'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:26:23.904467 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-34fe1114-c95e-4d12-81d3-60f78c424a8c admin admin] The token cache is being invalidate because project 9aadbcd655ef42e1b07a51b1be0dbe21 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=85204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 17:26:23.904762 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-34fe1114-c95e-4d12-81d3-60f78c424a8c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:26:23.905451 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-34fe1114-c95e-4d12-81d3-60f78c424a8c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:26:23.907423 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1334/2654] 10.222.0.58 () {58 vars in 1232 bytes} [Tue Oct 12 17:26:23 2021] DELETE /identity/v3/projects/9aadbcd655ef42e1b07a51b1be0dbe21 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 17:26:23.913234 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaf9d90-5222-402c-81e2-c84d1a574a79 None None] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:26:23.913615 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaf9d90-5222-402c-81e2-c84d1a574a79 None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:26:23.914796 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaf9d90-5222-402c-81e2-c84d1a574a79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:26:23.937217 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.auth.core [None req-3eaf9d90-5222-402c-81e2-c84d1a574a79 None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 17:26:23.939192 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-3eaf9d90-5222-402c-81e2-c84d1a574a79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:26:24.020543 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1321/2655] 10.222.0.58 () {58 vars in 957 bytes} [Tue Oct 12 17:26:23 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 17:26:24.028655 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe26fb8e-5f0d-4689-9e26-e81875f646e4 None None] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:26:24.029437 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe26fb8e-5f0d-4689-9e26-e81875f646e4 None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:26:24.029852 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe26fb8e-5f0d-4689-9e26-e81875f646e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:26:24.060637 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.auth.core [None req-fe26fb8e-5f0d-4689-9e26-e81875f646e4 None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 17:26:24.062587 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-fe26fb8e-5f0d-4689-9e26-e81875f646e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:26:24.073252 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1335/2656] 10.222.0.58 () {58 vars in 957 bytes} [Tue Oct 12 17:26:24 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 17:26:24.077132 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eaf9d90-5222-402c-81e2-c84d1a574a79 None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:26:24.093343 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eaf9d90-5222-402c-81e2-c84d1a574a79 None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:26:24.098504 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786e4407-03d9-4ad8-bc64-29d8ee54f5e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:26:24.099231 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786e4407-03d9-4ad8-bc64-29d8ee54f5e4 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:26:24.099576 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786e4407-03d9-4ad8-bc64-29d8ee54f5e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:26:24.099924 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786e4407-03d9-4ad8-bc64-29d8ee54f5e4 admin admin] PATH_INFO: `/v3/domains` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:26:24.100733 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786e4407-03d9-4ad8-bc64-29d8ee54f5e4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 17:26:24.101150 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786e4407-03d9-4ad8-bc64-29d8ee54f5e4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:26:24.102961 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786e4407-03d9-4ad8-bc64-29d8ee54f5e4 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:26:24.121400 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1322/2657] 10.222.0.58 () {58 vars in 1152 bytes} [Tue Oct 12 17:26:24 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 17:26:24.124643 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe26fb8e-5f0d-4689-9e26-e81875f646e4 None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:26:24.140175 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe26fb8e-5f0d-4689-9e26-e81875f646e4 None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:26:24.149727 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee0dfbd-8cf9-4ba0-9b85-f807d923c622 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:26:24.150771 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee0dfbd-8cf9-4ba0-9b85-f807d923c622 admin admin] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:26:24.151292 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee0dfbd-8cf9-4ba0-9b85-f807d923c622 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:26:24.151806 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee0dfbd-8cf9-4ba0-9b85-f807d923c622 admin admin] PATH_INFO: `/v3/projects` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:26:24.152605 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee0dfbd-8cf9-4ba0-9b85-f807d923c622 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:26:24.154659 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee0dfbd-8cf9-4ba0-9b85-f807d923c622 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:26:24.186218 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1336/2658] 10.222.0.58 () {60 vars in 1152 bytes} [Tue Oct 12 17:26:24 2021] POST /identity/v3/projects => generated 397 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 17:26:24.187884 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786e4407-03d9-4ad8-bc64-29d8ee54f5e4 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:26:24.198414 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786e4407-03d9-4ad8-bc64-29d8ee54f5e4 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:26:24.261598 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45017ab6-2eca-4f5d-988d-862de8cb35b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:26:24.262364 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45017ab6-2eca-4f5d-988d-862de8cb35b0 admin admin] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:26:24.262653 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45017ab6-2eca-4f5d-988d-862de8cb35b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:26:24.265325 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45017ab6-2eca-4f5d-988d-862de8cb35b0 admin admin] PATH_INFO: `/v3/users` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:26:24.265889 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45017ab6-2eca-4f5d-988d-862de8cb35b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:26:24.267841 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45017ab6-2eca-4f5d-988d-862de8cb35b0 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:26:24.294731 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1323/2659] 10.222.0.58 () {60 vars in 1143 bytes} [Tue Oct 12 17:26:24 2021] POST /identity/v3/users => generated 299 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 17:26:24.297740 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee0dfbd-8cf9-4ba0-9b85-f807d923c622 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:26:24.322909 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee0dfbd-8cf9-4ba0-9b85-f807d923c622 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:26:24.334535 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d795a1f7-66de-46bb-b599-24245447c2d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:26:24.335401 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d795a1f7-66de-46bb-b599-24245447c2d6 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:26:24.336282 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d795a1f7-66de-46bb-b599-24245447c2d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:26:24.336559 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d795a1f7-66de-46bb-b599-24245447c2d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:26:24.337415 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d795a1f7-66de-46bb-b599-24245447c2d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:26:24.339052 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d795a1f7-66de-46bb-b599-24245447c2d6 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:26:24.355287 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1337/2660] 10.222.0.58 () {58 vars in 1121 bytes} [Tue Oct 12 17:26:24 2021] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 17:26:24.356863 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45017ab6-2eca-4f5d-988d-862de8cb35b0 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:26:24.367458 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45017ab6-2eca-4f5d-988d-862de8cb35b0 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:26:24.374447 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf1f716-0315-4b15-87d9-40a3cc47431b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:26:24.375212 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf1f716-0315-4b15-87d9-40a3cc47431b admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:26:24.375570 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf1f716-0315-4b15-87d9-40a3cc47431b admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:26:24.375938 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf1f716-0315-4b15-87d9-40a3cc47431b admin admin] PATH_INFO: `/v3/roles` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:26:24.376745 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf1f716-0315-4b15-87d9-40a3cc47431b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:26:24.378388 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf1f716-0315-4b15-87d9-40a3cc47431b admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:26:24.400209 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1324/2661] 10.222.0.58 () {58 vars in 1121 bytes} [Tue Oct 12 17:26:24 2021] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 17:26:24.404050 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d795a1f7-66de-46bb-b599-24245447c2d6 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:26:24.414545 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d795a1f7-66de-46bb-b599-24245447c2d6 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:26:24.419484 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cf5d7c-de04-495a-9940-a28ea4088def admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:26:24.420477 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cf5d7c-de04-495a-9940-a28ea4088def admin admin] REQUEST_METHOD: `PUT` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:26:24.420765 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cf5d7c-de04-495a-9940-a28ea4088def admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:26:24.421038 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cf5d7c-de04-495a-9940-a28ea4088def admin admin] PATH_INFO: `/v3/projects/18f5a3a4ce4245eaaf051588fc221d48/users/b97aefebb65948738bbe88853a06d086/roles/55ba49fe29884e64b57c3ad13188d554` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:26:24.438565 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cf5d7c-de04-495a-9940-a28ea4088def admin admin] RBAC: Authorizing `identity:create_grant(project_id=18f5a3a4ce4245eaaf051588fc221d48, user_id=b97aefebb65948738bbe88853a06d086, role_id=55ba49fe29884e64b57c3ad13188d554)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:26:24.441520 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cf5d7c-de04-495a-9940-a28ea4088def admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:26:24.462051 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1338/2662] 10.222.0.58 () {60 vars in 1482 bytes} [Tue Oct 12 17:26:24 2021] PUT /identity/v3/projects/18f5a3a4ce4245eaaf051588fc221d48/users/b97aefebb65948738bbe88853a06d086/roles/55ba49fe29884e64b57c3ad13188d554 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 17:26:24.472894 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d9d269-6c0b-4164-b39c-0726df82ca67 None None] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:26:24.473192 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d9d269-6c0b-4164-b39c-0726df82ca67 None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:26:24.473474 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d9d269-6c0b-4164-b39c-0726df82ca67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:26:24.503736 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.auth.core [None req-33d9d269-6c0b-4164-b39c-0726df82ca67 None None] MFA Rules not processed for user `b97aefebb65948738bbe88853a06d086`. Rule list: `[]` (Enabled: `True`). {{(pid=85205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 17:26:24.505038 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-33d9d269-6c0b-4164-b39c-0726df82ca67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:26:24.578209 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1325/2663] 10.222.0.58 () {58 vars in 957 bytes} [Tue Oct 12 17:26:24 2021] POST /identity/v3/auth/tokens => generated 3417 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 17:26:24.582584 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cf5d7c-de04-495a-9940-a28ea4088def admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:26:24.655712 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cf5d7c-de04-495a-9940-a28ea4088def admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:26:24.661326 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419faa7a-ec83-4912-a9d3-eed00bd51a8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:26:24.662031 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419faa7a-ec83-4912-a9d3-eed00bd51a8d admin admin] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:26:24.662334 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419faa7a-ec83-4912-a9d3-eed00bd51a8d admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:26:24.662915 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419faa7a-ec83-4912-a9d3-eed00bd51a8d admin admin] PATH_INFO: `/v3/projects` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:26:24.663650 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419faa7a-ec83-4912-a9d3-eed00bd51a8d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:26:24.665908 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419faa7a-ec83-4912-a9d3-eed00bd51a8d admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:26:24.698517 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1339/2664] 10.222.0.58 () {60 vars in 1152 bytes} [Tue Oct 12 17:26:24 2021] POST /identity/v3/projects => generated 401 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 17:26:24.699975 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d9d269-6c0b-4164-b39c-0726df82ca67 None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:26:24.713487 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d9d269-6c0b-4164-b39c-0726df82ca67 None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:26:24.777135 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791c6896-ceec-4ba4-875b-bf6ca01d1bd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:26:24.777920 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791c6896-ceec-4ba4-875b-bf6ca01d1bd0 admin admin] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:26:24.778214 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791c6896-ceec-4ba4-875b-bf6ca01d1bd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:26:24.778486 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791c6896-ceec-4ba4-875b-bf6ca01d1bd0 admin admin] PATH_INFO: `/v3/users` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:26:24.779309 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791c6896-ceec-4ba4-875b-bf6ca01d1bd0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:26:24.781223 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791c6896-ceec-4ba4-875b-bf6ca01d1bd0 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:26:24.805664 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1326/2665] 10.222.0.58 () {60 vars in 1143 bytes} [Tue Oct 12 17:26:24 2021] POST /identity/v3/users => generated 307 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 17:26:24.810619 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419faa7a-ec83-4912-a9d3-eed00bd51a8d admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:26:24.824713 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419faa7a-ec83-4912-a9d3-eed00bd51a8d admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:26:24.829393 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e4fc43-a46f-4481-b0ed-435c1c73cac2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:26:24.830085 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e4fc43-a46f-4481-b0ed-435c1c73cac2 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:26:24.830369 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e4fc43-a46f-4481-b0ed-435c1c73cac2 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:26:24.830643 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e4fc43-a46f-4481-b0ed-435c1c73cac2 admin admin] PATH_INFO: `/v3/roles` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:26:24.831378 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e4fc43-a46f-4481-b0ed-435c1c73cac2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:26:24.832960 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e4fc43-a46f-4481-b0ed-435c1c73cac2 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:26:24.848628 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1340/2666] 10.222.0.58 () {58 vars in 1121 bytes} [Tue Oct 12 17:26:24 2021] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 17:26:24.849909 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791c6896-ceec-4ba4-875b-bf6ca01d1bd0 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:26:24.862569 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791c6896-ceec-4ba4-875b-bf6ca01d1bd0 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:26:24.868138 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3376520-ce0a-4f44-996a-6a670f934870 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:26:24.869039 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3376520-ce0a-4f44-996a-6a670f934870 admin admin] REQUEST_METHOD: `PUT` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:26:24.869313 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3376520-ce0a-4f44-996a-6a670f934870 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:26:24.869615 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3376520-ce0a-4f44-996a-6a670f934870 admin admin] PATH_INFO: `/v3/projects/de409b4f36b249d59cc549ec4415d36e/users/c9b616b39f49447e8e6377e426b67d2a/roles/610824e4f50f4fb8954610e98c1de784` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:26:24.886736 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3376520-ce0a-4f44-996a-6a670f934870 admin admin] RBAC: Authorizing `identity:create_grant(project_id=de409b4f36b249d59cc549ec4415d36e, user_id=c9b616b39f49447e8e6377e426b67d2a, role_id=610824e4f50f4fb8954610e98c1de784)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:26:24.889811 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3376520-ce0a-4f44-996a-6a670f934870 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:26:24.908544 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1327/2667] 10.222.0.58 () {60 vars in 1482 bytes} [Tue Oct 12 17:26:24 2021] PUT /identity/v3/projects/de409b4f36b249d59cc549ec4415d36e/users/c9b616b39f49447e8e6377e426b67d2a/roles/610824e4f50f4fb8954610e98c1de784 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 17:26:24.912692 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e4fc43-a46f-4481-b0ed-435c1c73cac2 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:26:24.926377 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e4fc43-a46f-4481-b0ed-435c1c73cac2 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:26:24.990312 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a3f4af-911b-4751-aa58-15c841fb34c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:26:24.991428 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a3f4af-911b-4751-aa58-15c841fb34c2 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:26:24.991782 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a3f4af-911b-4751-aa58-15c841fb34c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:26:24.992199 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a3f4af-911b-4751-aa58-15c841fb34c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:26:24.992949 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a3f4af-911b-4751-aa58-15c841fb34c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:26:24.994679 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a3f4af-911b-4751-aa58-15c841fb34c2 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:26:25.006922 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1341/2668] 10.222.0.58 () {58 vars in 1121 bytes} [Tue Oct 12 17:26:24 2021] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 17:26:25.011979 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3376520-ce0a-4f44-996a-6a670f934870 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:26:25.024637 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3376520-ce0a-4f44-996a-6a670f934870 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:26:25.030091 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5e218c-f0b2-40ba-a739-e45157bef39d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:26:25.030976 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5e218c-f0b2-40ba-a739-e45157bef39d admin admin] REQUEST_METHOD: `PUT` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:26:25.031259 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5e218c-f0b2-40ba-a739-e45157bef39d admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:26:25.031533 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5e218c-f0b2-40ba-a739-e45157bef39d admin admin] PATH_INFO: `/v3/projects/de409b4f36b249d59cc549ec4415d36e/users/c9b616b39f49447e8e6377e426b67d2a/roles/610824e4f50f4fb8954610e98c1de784` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:26:25.033499 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5e218c-f0b2-40ba-a739-e45157bef39d admin admin] RBAC: Authorizing `identity:create_grant(project_id=de409b4f36b249d59cc549ec4415d36e, user_id=c9b616b39f49447e8e6377e426b67d2a, role_id=610824e4f50f4fb8954610e98c1de784)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:26:25.036111 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5e218c-f0b2-40ba-a739-e45157bef39d admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:26:25.053915 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1328/2669] 10.222.0.58 () {60 vars in 1482 bytes} [Tue Oct 12 17:26:25 2021] PUT /identity/v3/projects/de409b4f36b249d59cc549ec4415d36e/users/c9b616b39f49447e8e6377e426b67d2a/roles/610824e4f50f4fb8954610e98c1de784 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 17:26:25.061454 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1c7a4b-05db-46ad-9088-67ba88fde3a4 None None] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:26:25.061787 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1c7a4b-05db-46ad-9088-67ba88fde3a4 None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:26:25.062070 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1c7a4b-05db-46ad-9088-67ba88fde3a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:26:25.095233 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.auth.core [None req-3a1c7a4b-05db-46ad-9088-67ba88fde3a4 None None] MFA Rules not processed for user `c9b616b39f49447e8e6377e426b67d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=85204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 17:26:25.096413 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-3a1c7a4b-05db-46ad-9088-67ba88fde3a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:26:25.175910 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1342/2670] 10.222.0.58 () {58 vars in 957 bytes} [Tue Oct 12 17:26:25 2021] POST /identity/v3/auth/tokens => generated 3488 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 17:26:25.188442 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5e218c-f0b2-40ba-a739-e45157bef39d admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:26:25.190349 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-3f5e218c-f0b2-40ba-a739-e45157bef39d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:26:25.252651 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5e218c-f0b2-40ba-a739-e45157bef39d admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:26:25.256653 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c566d5a-b5ea-4b3f-a15a-5cc069a5efb9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04704222b3d64a33a6c092fc641ccbb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:26:25.257417 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c566d5a-b5ea-4b3f-a15a-5cc069a5efb9 service cinder] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:26:25.259942 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c566d5a-b5ea-4b3f-a15a-5cc069a5efb9 service cinder] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:26:25.259942 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c566d5a-b5ea-4b3f-a15a-5cc069a5efb9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:26:25.278156 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c566d5a-b5ea-4b3f-a15a-5cc069a5efb9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:26:25.279727 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c566d5a-b5ea-4b3f-a15a-5cc069a5efb9 service cinder] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:26:25.291444 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1329/2671] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Oct 12 17:26:25 2021] GET /identity/v3/auth/tokens => generated 3488 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 17:26:25.395292 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1c7a4b-05db-46ad-9088-67ba88fde3a4 None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:26:25.403195 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-3a1c7a4b-05db-46ad-9088-67ba88fde3a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:26:25.421075 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1c7a4b-05db-46ad-9088-67ba88fde3a4 None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:26:25.424734 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1842dcb-ad0f-4a9e-a31a-d6ec9b9099a8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04704222b3d64a33a6c092fc641ccbb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:26:25.425377 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1842dcb-ad0f-4a9e-a31a-d6ec9b9099a8 service cinder] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:26:25.425687 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1842dcb-ad0f-4a9e-a31a-d6ec9b9099a8 service cinder] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:26:25.426002 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1842dcb-ad0f-4a9e-a31a-d6ec9b9099a8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:26:25.496579 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1842dcb-ad0f-4a9e-a31a-d6ec9b9099a8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:26:25.498071 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1842dcb-ad0f-4a9e-a31a-d6ec9b9099a8 service cinder] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:26:25.506934 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1343/2672] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Oct 12 17:26:25 2021] GET /identity/v3/auth/tokens => generated 3417 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 17:26:29.114104 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8093e403-affa-4229-bb45-ae2940e3d41f None None] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:26:29.114621 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8093e403-affa-4229-bb45-ae2940e3d41f None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:26:29.114713 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8093e403-affa-4229-bb45-ae2940e3d41f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:26:29.136659 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.auth.core [None req-8093e403-affa-4229-bb45-ae2940e3d41f None None] MFA Rules not processed for user `6df5de308125437a91acabc3d7b4b387`. Rule list: `[]` (Enabled: `True`). {{(pid=85205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 17:26:29.137868 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-8093e403-affa-4229-bb45-ae2940e3d41f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:26:29.190893 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1330/2673] 10.222.0.58 () {58 vars in 957 bytes} [Tue Oct 12 17:26:29 2021] POST /identity/v3/auth/tokens => generated 3405 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 17:26:29.439125 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1842dcb-ad0f-4a9e-a31a-d6ec9b9099a8 service cinder] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:26:29.440518 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-e1842dcb-ad0f-4a9e-a31a-d6ec9b9099a8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:26:29.495715 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1842dcb-ad0f-4a9e-a31a-d6ec9b9099a8 service cinder] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:26:29.499304 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc67b2f2-1928-4289-9f3d-ef138beaa42a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e65f6d0598e4c539134292b86fb43d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:26:29.499939 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc67b2f2-1928-4289-9f3d-ef138beaa42a service neutron] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:26:29.500218 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc67b2f2-1928-4289-9f3d-ef138beaa42a service neutron] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:26:29.500490 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc67b2f2-1928-4289-9f3d-ef138beaa42a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:26:29.502410 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-dc67b2f2-1928-4289-9f3d-ef138beaa42a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:26:29.512766 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc67b2f2-1928-4289-9f3d-ef138beaa42a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:26:29.514532 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc67b2f2-1928-4289-9f3d-ef138beaa42a service neutron] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:26:29.526039 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1344/2674] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Oct 12 17:26:29 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 17:26:29.605341 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8093e403-affa-4229-bb45-ae2940e3d41f None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:26:29.668055 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8093e403-affa-4229-bb45-ae2940e3d41f None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:26:29.672614 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3064f055-b8be-4a9a-98a7-718b611b1ce5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:26:29.673478 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3064f055-b8be-4a9a-98a7-718b611b1ce5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:26:29.673765 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3064f055-b8be-4a9a-98a7-718b611b1ce5 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:26:29.674079 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3064f055-b8be-4a9a-98a7-718b611b1ce5 admin admin] PATH_INFO: `/v3/users/b97aefebb65948738bbe88853a06d086` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:26:29.675427 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3064f055-b8be-4a9a-98a7-718b611b1ce5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b97aefebb65948738bbe88853a06d086)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:26:29.677321 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3064f055-b8be-4a9a-98a7-718b611b1ce5 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:26:29.722388 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-3064f055-b8be-4a9a-98a7-718b611b1ce5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b97aefebb65948738bbe88853a06d086'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:26:29.734187 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-3064f055-b8be-4a9a-98a7-718b611b1ce5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b97aefebb65948738bbe88853a06d086'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:26:29.741295 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-3064f055-b8be-4a9a-98a7-718b611b1ce5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b97aefebb65948738bbe88853a06d086'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:26:29.749178 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-3064f055-b8be-4a9a-98a7-718b611b1ce5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b97aefebb65948738bbe88853a06d086'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:26:29.750020 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-3064f055-b8be-4a9a-98a7-718b611b1ce5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b97aefebb65948738bbe88853a06d086'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:26:29.756106 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1331/2675] 10.222.0.58 () {58 vars in 1223 bytes} [Tue Oct 12 17:26:29 2021] DELETE /identity/v3/users/b97aefebb65948738bbe88853a06d086 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 17:26:29.763235 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91486c5-09e3-4c2d-a70a-6a8e199a6ffe None None] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:26:29.763552 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91486c5-09e3-4c2d-a70a-6a8e199a6ffe None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:26:29.764634 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91486c5-09e3-4c2d-a70a-6a8e199a6ffe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:26:29.782573 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.auth.core [None req-d91486c5-09e3-4c2d-a70a-6a8e199a6ffe None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 17:26:29.784025 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-d91486c5-09e3-4c2d-a70a-6a8e199a6ffe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:26:29.848873 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1345/2676] 10.222.0.58 () {58 vars in 957 bytes} [Tue Oct 12 17:26:29 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 17:26:29.858826 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3064f055-b8be-4a9a-98a7-718b611b1ce5 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:26:29.861982 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-3064f055-b8be-4a9a-98a7-718b611b1ce5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:26:29.926385 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3064f055-b8be-4a9a-98a7-718b611b1ce5 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:26:29.930984 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58936067-e0e1-40ed-b954-8ef125c42c7a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e65f6d0598e4c539134292b86fb43d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:26:29.931826 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58936067-e0e1-40ed-b954-8ef125c42c7a service neutron] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:26:29.932235 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58936067-e0e1-40ed-b954-8ef125c42c7a service neutron] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:26:29.932634 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58936067-e0e1-40ed-b954-8ef125c42c7a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:26:29.942761 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58936067-e0e1-40ed-b954-8ef125c42c7a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:26:29.944267 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58936067-e0e1-40ed-b954-8ef125c42c7a service neutron] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:26:29.954848 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1332/2677] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Oct 12 17:26:29 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 17:26:30.232288 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91486c5-09e3-4c2d-a70a-6a8e199a6ffe None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:26:30.233833 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-d91486c5-09e3-4c2d-a70a-6a8e199a6ffe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:26:30.247656 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91486c5-09e3-4c2d-a70a-6a8e199a6ffe None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:26:30.253142 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdd61e6-2405-4d26-a5c4-03360a717ca0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:26:30.253835 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdd61e6-2405-4d26-a5c4-03360a717ca0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:26:30.254272 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdd61e6-2405-4d26-a5c4-03360a717ca0 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:26:30.254622 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdd61e6-2405-4d26-a5c4-03360a717ca0 admin admin] PATH_INFO: `/v3/projects/18f5a3a4ce4245eaaf051588fc221d48` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:26:30.255935 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdd61e6-2405-4d26-a5c4-03360a717ca0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=18f5a3a4ce4245eaaf051588fc221d48)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:26:30.258560 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdd61e6-2405-4d26-a5c4-03360a717ca0 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:26:30.312495 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-bbdd61e6-2405-4d26-a5c4-03360a717ca0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '18f5a3a4ce4245eaaf051588fc221d48', 'request_id': 'req-bbdd61e6-2405-4d26-a5c4-03360a717ca0'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:26:30.318160 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-bbdd61e6-2405-4d26-a5c4-03360a717ca0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '18f5a3a4ce4245eaaf051588fc221d48', 'request_id': 'req-bbdd61e6-2405-4d26-a5c4-03360a717ca0'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:26:30.324432 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-bbdd61e6-2405-4d26-a5c4-03360a717ca0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '18f5a3a4ce4245eaaf051588fc221d48', 'request_id': 'req-bbdd61e6-2405-4d26-a5c4-03360a717ca0'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:26:30.337649 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-bbdd61e6-2405-4d26-a5c4-03360a717ca0 admin admin] The token cache is being invalidate because project 18f5a3a4ce4245eaaf051588fc221d48 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=85204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 17:26:30.338035 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-bbdd61e6-2405-4d26-a5c4-03360a717ca0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:26:30.338717 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-bbdd61e6-2405-4d26-a5c4-03360a717ca0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:26:30.340317 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1346/2678] 10.222.0.58 () {58 vars in 1232 bytes} [Tue Oct 12 17:26:30 2021] DELETE /identity/v3/projects/18f5a3a4ce4245eaaf051588fc221d48 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 17:26:30.344360 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58936067-e0e1-40ed-b954-8ef125c42c7a service neutron] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:26:30.354327 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58936067-e0e1-40ed-b954-8ef125c42c7a service neutron] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:26:30.410395 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c3731a-37cb-482b-b16d-60c8d2d1ea78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:26:30.411187 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c3731a-37cb-482b-b16d-60c8d2d1ea78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:26:30.411467 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c3731a-37cb-482b-b16d-60c8d2d1ea78 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:26:30.411735 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c3731a-37cb-482b-b16d-60c8d2d1ea78 admin admin] PATH_INFO: `/v3/users/c9b616b39f49447e8e6377e426b67d2a` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:26:30.413216 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c3731a-37cb-482b-b16d-60c8d2d1ea78 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c9b616b39f49447e8e6377e426b67d2a)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:26:30.416021 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c3731a-37cb-482b-b16d-60c8d2d1ea78 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:26:30.461041 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-14c3731a-37cb-482b-b16d-60c8d2d1ea78 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c9b616b39f49447e8e6377e426b67d2a'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:26:30.472128 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-14c3731a-37cb-482b-b16d-60c8d2d1ea78 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c9b616b39f49447e8e6377e426b67d2a'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:26:30.479298 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-14c3731a-37cb-482b-b16d-60c8d2d1ea78 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c9b616b39f49447e8e6377e426b67d2a'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:26:30.485868 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-14c3731a-37cb-482b-b16d-60c8d2d1ea78 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c9b616b39f49447e8e6377e426b67d2a'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:26:30.486517 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-14c3731a-37cb-482b-b16d-60c8d2d1ea78 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c9b616b39f49447e8e6377e426b67d2a'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:26:30.492616 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1333/2679] 10.222.0.58 () {58 vars in 1223 bytes} [Tue Oct 12 17:26:30 2021] DELETE /identity/v3/users/c9b616b39f49447e8e6377e426b67d2a => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 17:26:30.757484 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdd61e6-2405-4d26-a5c4-03360a717ca0 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:26:30.759766 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-bbdd61e6-2405-4d26-a5c4-03360a717ca0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:26:30.772718 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdd61e6-2405-4d26-a5c4-03360a717ca0 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:26:30.834877 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bc3150-51a1-43cd-8409-f1d5666caf5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:26:30.836363 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bc3150-51a1-43cd-8409-f1d5666caf5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:26:30.836673 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bc3150-51a1-43cd-8409-f1d5666caf5c admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:26:30.836996 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bc3150-51a1-43cd-8409-f1d5666caf5c admin admin] PATH_INFO: `/v3/projects/de409b4f36b249d59cc549ec4415d36e` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:26:30.838985 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bc3150-51a1-43cd-8409-f1d5666caf5c admin admin] RBAC: Authorizing `identity:delete_project(project_id=de409b4f36b249d59cc549ec4415d36e)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:26:30.840955 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bc3150-51a1-43cd-8409-f1d5666caf5c admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:26:30.892670 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-66bc3150-51a1-43cd-8409-f1d5666caf5c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de409b4f36b249d59cc549ec4415d36e', 'request_id': 'req-66bc3150-51a1-43cd-8409-f1d5666caf5c'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:26:30.898735 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-66bc3150-51a1-43cd-8409-f1d5666caf5c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de409b4f36b249d59cc549ec4415d36e', 'request_id': 'req-66bc3150-51a1-43cd-8409-f1d5666caf5c'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:26:30.905128 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-66bc3150-51a1-43cd-8409-f1d5666caf5c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de409b4f36b249d59cc549ec4415d36e', 'request_id': 'req-66bc3150-51a1-43cd-8409-f1d5666caf5c'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:26:30.922378 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-66bc3150-51a1-43cd-8409-f1d5666caf5c admin admin] The token cache is being invalidate because project de409b4f36b249d59cc549ec4415d36e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=85204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 17:26:30.922745 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-66bc3150-51a1-43cd-8409-f1d5666caf5c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:26:30.923395 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-66bc3150-51a1-43cd-8409-f1d5666caf5c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:26:30.925951 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1347/2680] 10.222.0.58 () {58 vars in 1232 bytes} [Tue Oct 12 17:26:30 2021] DELETE /identity/v3/projects/de409b4f36b249d59cc549ec4415d36e => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 17:26:30.931488 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce351243-dc8b-45ef-a954-0e8802c7f40f None None] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:26:30.931779 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce351243-dc8b-45ef-a954-0e8802c7f40f None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:26:30.932058 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce351243-dc8b-45ef-a954-0e8802c7f40f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:26:30.955930 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.auth.core [None req-ce351243-dc8b-45ef-a954-0e8802c7f40f None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 17:26:30.957309 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-ce351243-dc8b-45ef-a954-0e8802c7f40f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:26:31.020946 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1334/2681] 10.222.0.58 () {58 vars in 957 bytes} [Tue Oct 12 17:26:30 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 17:26:31.029892 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f04391-186b-4f64-9805-292b5575b3f6 None None] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:26:31.030198 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f04391-186b-4f64-9805-292b5575b3f6 None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:26:31.030497 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f04391-186b-4f64-9805-292b5575b3f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:26:31.050331 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.auth.core [None req-a1f04391-186b-4f64-9805-292b5575b3f6 None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 17:26:31.051552 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-a1f04391-186b-4f64-9805-292b5575b3f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:26:31.060422 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1348/2682] 10.222.0.58 () {58 vars in 957 bytes} [Tue Oct 12 17:26:31 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 17:26:31.064412 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce351243-dc8b-45ef-a954-0e8802c7f40f None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:26:31.075489 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce351243-dc8b-45ef-a954-0e8802c7f40f None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:26:31.080320 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0f7bb0-9930-4b15-9fbf-dc45b37006a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:26:31.081607 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0f7bb0-9930-4b15-9fbf-dc45b37006a7 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:26:31.081607 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0f7bb0-9930-4b15-9fbf-dc45b37006a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:26:31.081607 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0f7bb0-9930-4b15-9fbf-dc45b37006a7 admin admin] PATH_INFO: `/v3/domains` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:26:31.082313 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0f7bb0-9930-4b15-9fbf-dc45b37006a7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 17:26:31.082628 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0f7bb0-9930-4b15-9fbf-dc45b37006a7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:26:31.084205 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0f7bb0-9930-4b15-9fbf-dc45b37006a7 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:26:31.102009 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1335/2683] 10.222.0.58 () {58 vars in 1152 bytes} [Tue Oct 12 17:26:31 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 17:26:31.102553 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f04391-186b-4f64-9805-292b5575b3f6 None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:26:31.105021 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3764cde9-26e5-49ad-ae81-693d860d6886 None None] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:26:31.105369 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3764cde9-26e5-49ad-ae81-693d860d6886 None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:26:31.105649 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3764cde9-26e5-49ad-ae81-693d860d6886 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:26:31.111887 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f04391-186b-4f64-9805-292b5575b3f6 None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:26:31.117376 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30374402-110f-4d05-985a-e092f8cce549 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:26:31.118080 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30374402-110f-4d05-985a-e092f8cce549 admin admin] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:26:31.118366 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30374402-110f-4d05-985a-e092f8cce549 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:26:31.118642 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30374402-110f-4d05-985a-e092f8cce549 admin admin] PATH_INFO: `/v3/projects` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:26:31.119352 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30374402-110f-4d05-985a-e092f8cce549 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:26:31.121239 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30374402-110f-4d05-985a-e092f8cce549 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:26:31.124628 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.auth.core [None req-3764cde9-26e5-49ad-ae81-693d860d6886 None None] MFA Rules not processed for user `387a65d2bfb142499c9b3b0ac946f48b`. Rule list: `[]` (Enabled: `True`). {{(pid=85205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 17:26:31.125843 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-3764cde9-26e5-49ad-ae81-693d860d6886 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:26:31.148454 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1349/2684] 10.222.0.58 () {60 vars in 1152 bytes} [Tue Oct 12 17:26:31 2021] POST /identity/v3/projects => generated 373 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 17:26:31.152410 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30374402-110f-4d05-985a-e092f8cce549 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:26:31.187119 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1336/2685] 10.222.0.58 () {58 vars in 1009 bytes} [Tue Oct 12 17:26:31 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 17:26:31.201685 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3764cde9-26e5-49ad-ae81-693d860d6886 None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:26:31.203794 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-3764cde9-26e5-49ad-ae81-693d860d6886 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:26:31.219144 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30374402-110f-4d05-985a-e092f8cce549 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:26:31.225562 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f447e9-9dcf-4146-ae03-f79376b70e42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:26:31.226286 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f447e9-9dcf-4146-ae03-f79376b70e42 admin admin] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:26:31.226572 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f447e9-9dcf-4146-ae03-f79376b70e42 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:26:31.226846 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f447e9-9dcf-4146-ae03-f79376b70e42 admin admin] PATH_INFO: `/v3/users` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:26:31.227547 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f447e9-9dcf-4146-ae03-f79376b70e42 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:26:31.229442 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f447e9-9dcf-4146-ae03-f79376b70e42 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:26:31.253161 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1350/2686] 10.222.0.58 () {60 vars in 1143 bytes} [Tue Oct 12 17:26:31 2021] POST /identity/v3/users => generated 287 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 17:26:31.254318 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f447e9-9dcf-4146-ae03-f79376b70e42 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:26:31.265539 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f447e9-9dcf-4146-ae03-f79376b70e42 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:26:31.270292 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa86fbe-9bc8-4dda-84a4-fb74687954d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:26:31.270944 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa86fbe-9bc8-4dda-84a4-fb74687954d6 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:26:31.271227 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa86fbe-9bc8-4dda-84a4-fb74687954d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:26:31.271502 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa86fbe-9bc8-4dda-84a4-fb74687954d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:26:31.272231 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa86fbe-9bc8-4dda-84a4-fb74687954d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:26:31.273906 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa86fbe-9bc8-4dda-84a4-fb74687954d6 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:26:31.276159 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3764cde9-26e5-49ad-ae81-693d860d6886 None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:26:31.283988 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1351/2687] 10.222.0.58 () {58 vars in 1121 bytes} [Tue Oct 12 17:26:31 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 17:26:31.287925 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa86fbe-9bc8-4dda-84a4-fb74687954d6 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:26:31.297554 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa86fbe-9bc8-4dda-84a4-fb74687954d6 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:26:31.303101 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221e65ab-d93e-4716-a9f5-0d7803c50b12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:26:31.303777 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221e65ab-d93e-4716-a9f5-0d7803c50b12 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:26:31.304575 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221e65ab-d93e-4716-a9f5-0d7803c50b12 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:26:31.304858 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221e65ab-d93e-4716-a9f5-0d7803c50b12 admin admin] PATH_INFO: `/v3/roles` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:26:31.305587 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221e65ab-d93e-4716-a9f5-0d7803c50b12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:26:31.307194 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221e65ab-d93e-4716-a9f5-0d7803c50b12 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:26:31.321434 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1352/2688] 10.222.0.58 () {58 vars in 1121 bytes} [Tue Oct 12 17:26:31 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 17:26:31.322505 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221e65ab-d93e-4716-a9f5-0d7803c50b12 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:26:31.332610 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221e65ab-d93e-4716-a9f5-0d7803c50b12 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:26:31.336577 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d549103-891d-4e8d-aa6a-1c853e829aa4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdeb0a451344c9987b4134b957ffa22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:26:31.337358 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d549103-891d-4e8d-aa6a-1c853e829aa4 service swift] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:26:31.337468 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1d4823-6f77-46c5-8154-3d2188bcc442 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:26:31.337647 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d549103-891d-4e8d-aa6a-1c853e829aa4 service swift] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:26:31.337948 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d549103-891d-4e8d-aa6a-1c853e829aa4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:26:31.338513 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1d4823-6f77-46c5-8154-3d2188bcc442 admin admin] REQUEST_METHOD: `PUT` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:26:31.338806 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1d4823-6f77-46c5-8154-3d2188bcc442 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:26:31.339067 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1d4823-6f77-46c5-8154-3d2188bcc442 admin admin] PATH_INFO: `/v3/projects/8d3f1f74337a4f5eae8afaff8ad75e13/users/337467c642584fec9820968fef0b21fa/roles/55ba49fe29884e64b57c3ad13188d554` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:26:31.353802 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1d4823-6f77-46c5-8154-3d2188bcc442 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d3f1f74337a4f5eae8afaff8ad75e13, user_id=337467c642584fec9820968fef0b21fa, role_id=55ba49fe29884e64b57c3ad13188d554)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:26:31.356459 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1d4823-6f77-46c5-8154-3d2188bcc442 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:26:31.369942 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1353/2689] 10.222.0.58 () {60 vars in 1482 bytes} [Tue Oct 12 17:26:31 2021] PUT /identity/v3/projects/8d3f1f74337a4f5eae8afaff8ad75e13/users/337467c642584fec9820968fef0b21fa/roles/55ba49fe29884e64b57c3ad13188d554 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 17:26:31.380099 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a647b295-cbea-46ef-bd24-7e99184a8886 None None] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:26:31.380396 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a647b295-cbea-46ef-bd24-7e99184a8886 None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:26:31.380669 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a647b295-cbea-46ef-bd24-7e99184a8886 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:26:31.400814 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d549103-891d-4e8d-aa6a-1c853e829aa4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:26:31.401889 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d549103-891d-4e8d-aa6a-1c853e829aa4 service swift] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:26:31.409105 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.auth.core [None req-a647b295-cbea-46ef-bd24-7e99184a8886 None None] MFA Rules not processed for user `337467c642584fec9820968fef0b21fa`. Rule list: `[]` (Enabled: `True`). {{(pid=85204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 17:26:31.410161 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1337/2690] 10.222.0.58 () {60 vars in 1384 bytes} [Tue Oct 12 17:26:31 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 12 17:26:31.410453 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-a647b295-cbea-46ef-bd24-7e99184a8886 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:26:31.487767 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1354/2691] 10.222.0.58 () {58 vars in 957 bytes} [Tue Oct 12 17:26:31 2021] POST /identity/v3/auth/tokens => generated 3393 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 17:26:31.495319 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d549103-891d-4e8d-aa6a-1c853e829aa4 service swift] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:26:31.496875 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-7d549103-891d-4e8d-aa6a-1c853e829aa4 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:26:31.593094 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d549103-891d-4e8d-aa6a-1c853e829aa4 service swift] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:26:31.651144 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15786401-0591-4fc2-9582-728546a3d3e5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04704222b3d64a33a6c092fc641ccbb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:26:31.652019 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15786401-0591-4fc2-9582-728546a3d3e5 service cinder] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:26:31.652408 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15786401-0591-4fc2-9582-728546a3d3e5 service cinder] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:26:31.653006 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15786401-0591-4fc2-9582-728546a3d3e5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:26:31.669187 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15786401-0591-4fc2-9582-728546a3d3e5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:26:31.670894 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15786401-0591-4fc2-9582-728546a3d3e5 service cinder] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:26:31.682085 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1338/2692] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Oct 12 17:26:31 2021] GET /identity/v3/auth/tokens => generated 3393 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 17:26:34.881097 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a647b295-cbea-46ef-bd24-7e99184a8886 None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:26:34.944748 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a647b295-cbea-46ef-bd24-7e99184a8886 None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:26:34.949848 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffe4158-2c76-41b6-b947-8642a0d220b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:26:34.950903 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffe4158-2c76-41b6-b947-8642a0d220b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:26:34.951149 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffe4158-2c76-41b6-b947-8642a0d220b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:26:34.951421 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffe4158-2c76-41b6-b947-8642a0d220b4 admin admin] PATH_INFO: `/v3/users/337467c642584fec9820968fef0b21fa` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:26:34.952644 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffe4158-2c76-41b6-b947-8642a0d220b4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=337467c642584fec9820968fef0b21fa)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:26:34.954606 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffe4158-2c76-41b6-b947-8642a0d220b4 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:26:35.075192 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-bffe4158-2c76-41b6-b947-8642a0d220b4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '337467c642584fec9820968fef0b21fa'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:26:35.090407 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-bffe4158-2c76-41b6-b947-8642a0d220b4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '337467c642584fec9820968fef0b21fa'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:26:35.100102 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-bffe4158-2c76-41b6-b947-8642a0d220b4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '337467c642584fec9820968fef0b21fa'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:26:35.108193 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-bffe4158-2c76-41b6-b947-8642a0d220b4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '337467c642584fec9820968fef0b21fa'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:26:35.108927 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-bffe4158-2c76-41b6-b947-8642a0d220b4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '337467c642584fec9820968fef0b21fa'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:26:35.115510 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1355/2693] 10.222.0.58 () {58 vars in 1223 bytes} [Tue Oct 12 17:26:34 2021] DELETE /identity/v3/users/337467c642584fec9820968fef0b21fa => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 17:26:35.120550 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306159b7-7cb9-4e8a-b9fa-704a475497b5 None None] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:26:35.121120 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306159b7-7cb9-4e8a-b9fa-704a475497b5 None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:26:35.121120 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306159b7-7cb9-4e8a-b9fa-704a475497b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:26:35.139222 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.auth.core [None req-306159b7-7cb9-4e8a-b9fa-704a475497b5 None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 17:26:35.140472 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-306159b7-7cb9-4e8a-b9fa-704a475497b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:26:35.198784 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1339/2694] 10.222.0.58 () {58 vars in 957 bytes} [Tue Oct 12 17:26:35 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 17:26:35.210046 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffe4158-2c76-41b6-b947-8642a0d220b4 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:26:35.211720 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-bffe4158-2c76-41b6-b947-8642a0d220b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:26:35.277495 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffe4158-2c76-41b6-b947-8642a0d220b4 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:26:35.285167 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aadb7b1-cb52-469e-b960-b6b83ca2cbd7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e65f6d0598e4c539134292b86fb43d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:26:35.286165 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aadb7b1-cb52-469e-b960-b6b83ca2cbd7 service neutron] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:26:35.286452 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aadb7b1-cb52-469e-b960-b6b83ca2cbd7 service neutron] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:26:35.286731 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aadb7b1-cb52-469e-b960-b6b83ca2cbd7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:26:35.297336 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aadb7b1-cb52-469e-b960-b6b83ca2cbd7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:26:35.298799 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aadb7b1-cb52-469e-b960-b6b83ca2cbd7 service neutron] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:26:35.309759 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1356/2695] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Oct 12 17:26:35 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 17:26:35.599517 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306159b7-7cb9-4e8a-b9fa-704a475497b5 None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:26:35.604883 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-306159b7-7cb9-4e8a-b9fa-704a475497b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:26:35.638381 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306159b7-7cb9-4e8a-b9fa-704a475497b5 None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:26:35.643528 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e06e7a0-8ab7-41fe-9864-ec8c2f728c09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:26:35.644482 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e06e7a0-8ab7-41fe-9864-ec8c2f728c09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:26:35.644865 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e06e7a0-8ab7-41fe-9864-ec8c2f728c09 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:26:35.645220 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e06e7a0-8ab7-41fe-9864-ec8c2f728c09 admin admin] PATH_INFO: `/v3/projects/8d3f1f74337a4f5eae8afaff8ad75e13` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:26:35.646624 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e06e7a0-8ab7-41fe-9864-ec8c2f728c09 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8d3f1f74337a4f5eae8afaff8ad75e13)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:26:35.649182 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e06e7a0-8ab7-41fe-9864-ec8c2f728c09 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:26:35.704641 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-7e06e7a0-8ab7-41fe-9864-ec8c2f728c09 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8d3f1f74337a4f5eae8afaff8ad75e13', 'request_id': 'req-7e06e7a0-8ab7-41fe-9864-ec8c2f728c09'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:26:35.710087 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-7e06e7a0-8ab7-41fe-9864-ec8c2f728c09 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8d3f1f74337a4f5eae8afaff8ad75e13', 'request_id': 'req-7e06e7a0-8ab7-41fe-9864-ec8c2f728c09'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:26:35.717180 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-7e06e7a0-8ab7-41fe-9864-ec8c2f728c09 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8d3f1f74337a4f5eae8afaff8ad75e13', 'request_id': 'req-7e06e7a0-8ab7-41fe-9864-ec8c2f728c09'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:26:35.732691 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-7e06e7a0-8ab7-41fe-9864-ec8c2f728c09 admin admin] The token cache is being invalidate because project 8d3f1f74337a4f5eae8afaff8ad75e13 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=85205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 17:26:35.732987 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-7e06e7a0-8ab7-41fe-9864-ec8c2f728c09 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:26:35.733637 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-7e06e7a0-8ab7-41fe-9864-ec8c2f728c09 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:26:35.735228 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1340/2696] 10.222.0.58 () {58 vars in 1232 bytes} [Tue Oct 12 17:26:35 2021] DELETE /identity/v3/projects/8d3f1f74337a4f5eae8afaff8ad75e13 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 17:26:35.744609 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f991d4-3419-451f-86df-cdf50db3a059 None None] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:26:35.744609 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f991d4-3419-451f-86df-cdf50db3a059 None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:26:35.744609 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f991d4-3419-451f-86df-cdf50db3a059 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:26:35.761258 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.auth.core [None req-d3f991d4-3419-451f-86df-cdf50db3a059 None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 17:26:35.762557 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-d3f991d4-3419-451f-86df-cdf50db3a059 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:26:35.841300 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1357/2697] 10.222.0.58 () {58 vars in 957 bytes} [Tue Oct 12 17:26:35 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 17:26:35.849379 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b2246e-6f22-4a1a-85f0-81c10dec7f5c None None] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:26:35.849764 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b2246e-6f22-4a1a-85f0-81c10dec7f5c None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:26:35.850147 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b2246e-6f22-4a1a-85f0-81c10dec7f5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:26:35.869764 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.auth.core [None req-47b2246e-6f22-4a1a-85f0-81c10dec7f5c None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 17:26:35.871116 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-47b2246e-6f22-4a1a-85f0-81c10dec7f5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:26:35.879385 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1341/2698] 10.222.0.58 () {58 vars in 957 bytes} [Tue Oct 12 17:26:35 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 17:26:35.884156 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f991d4-3419-451f-86df-cdf50db3a059 None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:26:35.894015 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f991d4-3419-451f-86df-cdf50db3a059 None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:26:35.899144 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f307bfa0-0464-42c3-b84e-06a53dd14fca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:26:35.899796 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f307bfa0-0464-42c3-b84e-06a53dd14fca admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:26:35.900080 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f307bfa0-0464-42c3-b84e-06a53dd14fca admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:26:35.900359 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f307bfa0-0464-42c3-b84e-06a53dd14fca admin admin] PATH_INFO: `/v3/domains` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:26:35.901086 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f307bfa0-0464-42c3-b84e-06a53dd14fca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 17:26:35.901394 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f307bfa0-0464-42c3-b84e-06a53dd14fca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:26:35.902996 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f307bfa0-0464-42c3-b84e-06a53dd14fca admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:26:35.914603 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1358/2699] 10.222.0.58 () {58 vars in 1152 bytes} [Tue Oct 12 17:26:35 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 17:26:35.918915 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b2246e-6f22-4a1a-85f0-81c10dec7f5c None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:26:35.929089 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b2246e-6f22-4a1a-85f0-81c10dec7f5c None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:26:35.936772 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a7a095-4185-425c-8710-0847fa1d38b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:26:35.937455 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a7a095-4185-425c-8710-0847fa1d38b2 admin admin] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:26:35.937742 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a7a095-4185-425c-8710-0847fa1d38b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:26:35.938078 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a7a095-4185-425c-8710-0847fa1d38b2 admin admin] PATH_INFO: `/v3/projects` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:26:35.938868 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a7a095-4185-425c-8710-0847fa1d38b2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:26:35.940751 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a7a095-4185-425c-8710-0847fa1d38b2 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:26:35.970412 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1342/2700] 10.222.0.58 () {60 vars in 1152 bytes} [Tue Oct 12 17:26:35 2021] POST /identity/v3/projects => generated 383 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 17:26:35.974517 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f307bfa0-0464-42c3-b84e-06a53dd14fca admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:26:35.985069 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f307bfa0-0464-42c3-b84e-06a53dd14fca admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:26:36.041692 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8131c9a4-ce13-46ca-952d-3778b19a329d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:26:36.042490 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8131c9a4-ce13-46ca-952d-3778b19a329d admin admin] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:26:36.042875 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8131c9a4-ce13-46ca-952d-3778b19a329d admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:26:36.043177 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8131c9a4-ce13-46ca-952d-3778b19a329d admin admin] PATH_INFO: `/v3/users` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:26:36.043945 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8131c9a4-ce13-46ca-952d-3778b19a329d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:26:36.045944 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8131c9a4-ce13-46ca-952d-3778b19a329d admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:26:36.065313 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1359/2701] 10.222.0.58 () {60 vars in 1143 bytes} [Tue Oct 12 17:26:35 2021] POST /identity/v3/users => generated 292 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 17:26:36.069563 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a7a095-4185-425c-8710-0847fa1d38b2 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:26:36.080589 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a7a095-4185-425c-8710-0847fa1d38b2 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:26:36.085400 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc41e5fb-a90a-455e-ba75-7d8015c4b692 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:26:36.086605 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc41e5fb-a90a-455e-ba75-7d8015c4b692 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:26:36.086892 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc41e5fb-a90a-455e-ba75-7d8015c4b692 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:26:36.087171 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc41e5fb-a90a-455e-ba75-7d8015c4b692 admin admin] PATH_INFO: `/v3/roles` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:26:36.087916 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc41e5fb-a90a-455e-ba75-7d8015c4b692 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:26:36.089513 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc41e5fb-a90a-455e-ba75-7d8015c4b692 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:26:36.102097 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1343/2702] 10.222.0.58 () {58 vars in 1121 bytes} [Tue Oct 12 17:26:36 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 17:26:36.105579 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8131c9a4-ce13-46ca-952d-3778b19a329d admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:26:36.116202 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8131c9a4-ce13-46ca-952d-3778b19a329d admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:26:36.121526 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c14f4ca-0cbc-4dfe-8d30-6886169d923a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:26:36.122224 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c14f4ca-0cbc-4dfe-8d30-6886169d923a admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:26:36.122513 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c14f4ca-0cbc-4dfe-8d30-6886169d923a admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:26:36.122790 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c14f4ca-0cbc-4dfe-8d30-6886169d923a admin admin] PATH_INFO: `/v3/roles` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:26:36.123536 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c14f4ca-0cbc-4dfe-8d30-6886169d923a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:26:36.125120 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c14f4ca-0cbc-4dfe-8d30-6886169d923a admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:26:36.135486 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1360/2703] 10.222.0.58 () {58 vars in 1121 bytes} [Tue Oct 12 17:26:36 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 17:26:36.139600 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc41e5fb-a90a-455e-ba75-7d8015c4b692 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:26:36.149348 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc41e5fb-a90a-455e-ba75-7d8015c4b692 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:26:36.154547 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0032144-e5d9-4463-8468-569c44230b40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:26:36.155440 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0032144-e5d9-4463-8468-569c44230b40 admin admin] REQUEST_METHOD: `PUT` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:26:36.155725 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0032144-e5d9-4463-8468-569c44230b40 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:26:36.156002 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0032144-e5d9-4463-8468-569c44230b40 admin admin] PATH_INFO: `/v3/projects/b5f82f1264e944878580ececa2da0d68/users/a9edb938f4d14643af633a824336d1bb/roles/55ba49fe29884e64b57c3ad13188d554` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:26:36.171387 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0032144-e5d9-4463-8468-569c44230b40 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5f82f1264e944878580ececa2da0d68, user_id=a9edb938f4d14643af633a824336d1bb, role_id=55ba49fe29884e64b57c3ad13188d554)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:26:36.174055 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0032144-e5d9-4463-8468-569c44230b40 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:26:36.203325 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1344/2704] 10.222.0.58 () {60 vars in 1482 bytes} [Tue Oct 12 17:26:36 2021] PUT /identity/v3/projects/b5f82f1264e944878580ececa2da0d68/users/a9edb938f4d14643af633a824336d1bb/roles/55ba49fe29884e64b57c3ad13188d554 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 17:26:36.261050 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adf6888-4849-4968-9d91-216ed9dfcc8f None None] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:26:36.261374 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adf6888-4849-4968-9d91-216ed9dfcc8f None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:26:36.261612 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adf6888-4849-4968-9d91-216ed9dfcc8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:26:36.290561 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.auth.core [None req-3adf6888-4849-4968-9d91-216ed9dfcc8f None None] MFA Rules not processed for user `a9edb938f4d14643af633a824336d1bb`. Rule list: `[]` (Enabled: `True`). {{(pid=85204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 17:26:36.291788 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-3adf6888-4849-4968-9d91-216ed9dfcc8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:26:36.355101 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1361/2705] 10.222.0.58 () {58 vars in 957 bytes} [Tue Oct 12 17:26:36 2021] POST /identity/v3/auth/tokens => generated 3403 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 17:26:36.359475 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0032144-e5d9-4463-8468-569c44230b40 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:26:36.423083 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0032144-e5d9-4463-8468-569c44230b40 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:26:36.427765 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beaf5e93-538b-4c12-8606-56335b6d1b80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:26:36.428501 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaf5e93-538b-4c12-8606-56335b6d1b80 admin admin] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:26:36.428817 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaf5e93-538b-4c12-8606-56335b6d1b80 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:26:36.429637 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaf5e93-538b-4c12-8606-56335b6d1b80 admin admin] PATH_INFO: `/v3/projects` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:26:36.430391 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beaf5e93-538b-4c12-8606-56335b6d1b80 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:26:36.432259 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beaf5e93-538b-4c12-8606-56335b6d1b80 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:26:36.457087 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1345/2706] 10.222.0.58 () {60 vars in 1152 bytes} [Tue Oct 12 17:26:36 2021] POST /identity/v3/projects => generated 383 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 17:26:36.461405 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adf6888-4849-4968-9d91-216ed9dfcc8f None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:26:36.473001 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adf6888-4849-4968-9d91-216ed9dfcc8f None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:26:36.533597 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46274ffa-4601-4834-86b8-bd39e94ef163 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:26:36.534309 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46274ffa-4601-4834-86b8-bd39e94ef163 admin admin] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:26:36.534598 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46274ffa-4601-4834-86b8-bd39e94ef163 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:26:36.534878 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46274ffa-4601-4834-86b8-bd39e94ef163 admin admin] PATH_INFO: `/v3/users` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:26:36.535628 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46274ffa-4601-4834-86b8-bd39e94ef163 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:26:36.537561 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46274ffa-4601-4834-86b8-bd39e94ef163 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:26:36.562074 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1362/2707] 10.222.0.58 () {60 vars in 1143 bytes} [Tue Oct 12 17:26:36 2021] POST /identity/v3/users => generated 292 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 17:26:36.572864 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beaf5e93-538b-4c12-8606-56335b6d1b80 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:26:36.584071 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beaf5e93-538b-4c12-8606-56335b6d1b80 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:26:36.588835 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da329a1-3d9c-4484-8e4d-6b85507a307c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:26:36.589496 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da329a1-3d9c-4484-8e4d-6b85507a307c admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:26:36.589798 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da329a1-3d9c-4484-8e4d-6b85507a307c admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:26:36.590091 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da329a1-3d9c-4484-8e4d-6b85507a307c admin admin] PATH_INFO: `/v3/roles` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:26:36.590830 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da329a1-3d9c-4484-8e4d-6b85507a307c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:26:36.592407 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da329a1-3d9c-4484-8e4d-6b85507a307c admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:26:36.602668 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1346/2708] 10.222.0.58 () {58 vars in 1121 bytes} [Tue Oct 12 17:26:36 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 17:26:36.606798 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46274ffa-4601-4834-86b8-bd39e94ef163 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:26:36.617583 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46274ffa-4601-4834-86b8-bd39e94ef163 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:26:36.623234 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23afb30a-b293-4d98-a1f2-b66785bcfa5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:26:36.623926 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23afb30a-b293-4d98-a1f2-b66785bcfa5e admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:26:36.624256 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23afb30a-b293-4d98-a1f2-b66785bcfa5e admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:26:36.624600 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23afb30a-b293-4d98-a1f2-b66785bcfa5e admin admin] PATH_INFO: `/v3/roles` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:26:36.625389 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23afb30a-b293-4d98-a1f2-b66785bcfa5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:26:36.627034 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23afb30a-b293-4d98-a1f2-b66785bcfa5e admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:26:36.641779 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1363/2709] 10.222.0.58 () {58 vars in 1121 bytes} [Tue Oct 12 17:26:36 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 17:26:36.643045 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da329a1-3d9c-4484-8e4d-6b85507a307c admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:26:36.653781 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da329a1-3d9c-4484-8e4d-6b85507a307c admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:26:36.659154 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95f0615-a50f-4fb2-8a73-a6b0970fad2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:26:36.660239 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95f0615-a50f-4fb2-8a73-a6b0970fad2d admin admin] REQUEST_METHOD: `PUT` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:26:36.660681 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95f0615-a50f-4fb2-8a73-a6b0970fad2d admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:26:36.661109 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95f0615-a50f-4fb2-8a73-a6b0970fad2d admin admin] PATH_INFO: `/v3/projects/52e16f39f437408fbd4419eed9ed6bbd/users/043cc17744e146a4982de7eb80008fe6/roles/55ba49fe29884e64b57c3ad13188d554` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:26:36.676516 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95f0615-a50f-4fb2-8a73-a6b0970fad2d admin admin] RBAC: Authorizing `identity:create_grant(project_id=52e16f39f437408fbd4419eed9ed6bbd, user_id=043cc17744e146a4982de7eb80008fe6, role_id=55ba49fe29884e64b57c3ad13188d554)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:26:36.679754 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95f0615-a50f-4fb2-8a73-a6b0970fad2d admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:26:36.692341 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1347/2710] 10.222.0.58 () {60 vars in 1482 bytes} [Tue Oct 12 17:26:36 2021] PUT /identity/v3/projects/52e16f39f437408fbd4419eed9ed6bbd/users/043cc17744e146a4982de7eb80008fe6/roles/55ba49fe29884e64b57c3ad13188d554 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 17:26:36.702927 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9eda6b-bb60-40a1-87d3-a002f74625c1 None None] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:26:36.703222 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9eda6b-bb60-40a1-87d3-a002f74625c1 None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:26:36.703507 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9eda6b-bb60-40a1-87d3-a002f74625c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:26:36.731496 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.auth.core [None req-3f9eda6b-bb60-40a1-87d3-a002f74625c1 None None] MFA Rules not processed for user `043cc17744e146a4982de7eb80008fe6`. Rule list: `[]` (Enabled: `True`). {{(pid=85204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 17:26:36.732772 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-3f9eda6b-bb60-40a1-87d3-a002f74625c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:26:36.796735 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1364/2711] 10.222.0.58 () {58 vars in 957 bytes} [Tue Oct 12 17:26:36 2021] POST /identity/v3/auth/tokens => generated 3403 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 17:26:36.801195 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95f0615-a50f-4fb2-8a73-a6b0970fad2d admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:26:36.896780 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95f0615-a50f-4fb2-8a73-a6b0970fad2d admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:26:36.901907 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fcc6a2-c188-44ab-89b9-900e198b8aad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:26:36.902632 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fcc6a2-c188-44ab-89b9-900e198b8aad admin admin] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:26:36.903092 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fcc6a2-c188-44ab-89b9-900e198b8aad admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:26:36.903375 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fcc6a2-c188-44ab-89b9-900e198b8aad admin admin] PATH_INFO: `/v3/projects` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:26:36.904121 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fcc6a2-c188-44ab-89b9-900e198b8aad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:26:36.906113 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fcc6a2-c188-44ab-89b9-900e198b8aad admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:26:36.934978 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1348/2712] 10.222.0.58 () {60 vars in 1152 bytes} [Tue Oct 12 17:26:36 2021] POST /identity/v3/projects => generated 385 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 17:26:36.936209 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9eda6b-bb60-40a1-87d3-a002f74625c1 None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:26:36.950357 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9eda6b-bb60-40a1-87d3-a002f74625c1 None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:26:37.015919 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d862a2-ceef-4751-92c0-ad58e1b506ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:26:37.016689 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d862a2-ceef-4751-92c0-ad58e1b506ac admin admin] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:26:37.017091 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d862a2-ceef-4751-92c0-ad58e1b506ac admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:26:37.017432 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d862a2-ceef-4751-92c0-ad58e1b506ac admin admin] PATH_INFO: `/v3/users` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:26:37.018242 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d862a2-ceef-4751-92c0-ad58e1b506ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:26:37.020221 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d862a2-ceef-4751-92c0-ad58e1b506ac admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:26:37.048010 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1365/2713] 10.222.0.58 () {60 vars in 1143 bytes} [Tue Oct 12 17:26:36 2021] POST /identity/v3/users => generated 299 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 17:26:37.052176 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fcc6a2-c188-44ab-89b9-900e198b8aad admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:26:37.069011 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fcc6a2-c188-44ab-89b9-900e198b8aad admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:26:37.074674 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7124ef15-035e-49e6-8927-bbf0bbe81f8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:26:37.075425 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7124ef15-035e-49e6-8927-bbf0bbe81f8d admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:26:37.075810 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7124ef15-035e-49e6-8927-bbf0bbe81f8d admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:26:37.076095 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7124ef15-035e-49e6-8927-bbf0bbe81f8d admin admin] PATH_INFO: `/v3/roles` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:26:37.077274 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7124ef15-035e-49e6-8927-bbf0bbe81f8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:26:37.078919 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7124ef15-035e-49e6-8927-bbf0bbe81f8d admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:26:37.090601 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1349/2714] 10.222.0.58 () {58 vars in 1121 bytes} [Tue Oct 12 17:26:37 2021] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 17:26:37.095042 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d862a2-ceef-4751-92c0-ad58e1b506ac admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:26:37.106057 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d862a2-ceef-4751-92c0-ad58e1b506ac admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:26:37.110800 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e82cfa-1ea0-4cd3-aff8-9a5dff509387 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:26:37.111690 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e82cfa-1ea0-4cd3-aff8-9a5dff509387 admin admin] REQUEST_METHOD: `PUT` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:26:37.111974 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e82cfa-1ea0-4cd3-aff8-9a5dff509387 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:26:37.112248 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e82cfa-1ea0-4cd3-aff8-9a5dff509387 admin admin] PATH_INFO: `/v3/projects/118fb4f732194ad8a3555c98e67cf1ab/users/b06d7a51b2a74c58a31f4a84102cbc0c/roles/610824e4f50f4fb8954610e98c1de784` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:26:37.128938 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e82cfa-1ea0-4cd3-aff8-9a5dff509387 admin admin] RBAC: Authorizing `identity:create_grant(project_id=118fb4f732194ad8a3555c98e67cf1ab, user_id=b06d7a51b2a74c58a31f4a84102cbc0c, role_id=610824e4f50f4fb8954610e98c1de784)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:26:37.132846 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e82cfa-1ea0-4cd3-aff8-9a5dff509387 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:26:37.147605 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1366/2715] 10.222.0.58 () {60 vars in 1482 bytes} [Tue Oct 12 17:26:37 2021] PUT /identity/v3/projects/118fb4f732194ad8a3555c98e67cf1ab/users/b06d7a51b2a74c58a31f4a84102cbc0c/roles/610824e4f50f4fb8954610e98c1de784 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 17:26:37.151467 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7124ef15-035e-49e6-8927-bbf0bbe81f8d admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:26:37.161161 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7124ef15-035e-49e6-8927-bbf0bbe81f8d admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:26:37.217608 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c4505c-550c-4c9e-9df5-09a6ef2f4c6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:26:37.218305 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c4505c-550c-4c9e-9df5-09a6ef2f4c6c admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:26:37.218588 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c4505c-550c-4c9e-9df5-09a6ef2f4c6c admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:26:37.218868 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c4505c-550c-4c9e-9df5-09a6ef2f4c6c admin admin] PATH_INFO: `/v3/roles` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:26:37.219602 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c4505c-550c-4c9e-9df5-09a6ef2f4c6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:26:37.221178 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c4505c-550c-4c9e-9df5-09a6ef2f4c6c admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:26:37.231130 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1350/2716] 10.222.0.58 () {58 vars in 1121 bytes} [Tue Oct 12 17:26:37 2021] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 17:26:37.235337 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e82cfa-1ea0-4cd3-aff8-9a5dff509387 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:26:37.246027 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e82cfa-1ea0-4cd3-aff8-9a5dff509387 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:26:37.250749 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a394d71f-2329-4320-bfe6-dbc01c96bf83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:26:37.251626 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a394d71f-2329-4320-bfe6-dbc01c96bf83 admin admin] REQUEST_METHOD: `PUT` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:26:37.251908 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a394d71f-2329-4320-bfe6-dbc01c96bf83 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:26:37.252181 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a394d71f-2329-4320-bfe6-dbc01c96bf83 admin admin] PATH_INFO: `/v3/projects/118fb4f732194ad8a3555c98e67cf1ab/users/b06d7a51b2a74c58a31f4a84102cbc0c/roles/610824e4f50f4fb8954610e98c1de784` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:26:37.254169 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a394d71f-2329-4320-bfe6-dbc01c96bf83 admin admin] RBAC: Authorizing `identity:create_grant(project_id=118fb4f732194ad8a3555c98e67cf1ab, user_id=b06d7a51b2a74c58a31f4a84102cbc0c, role_id=610824e4f50f4fb8954610e98c1de784)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:26:37.256771 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a394d71f-2329-4320-bfe6-dbc01c96bf83 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:26:37.267572 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1367/2717] 10.222.0.58 () {60 vars in 1482 bytes} [Tue Oct 12 17:26:37 2021] PUT /identity/v3/projects/118fb4f732194ad8a3555c98e67cf1ab/users/b06d7a51b2a74c58a31f4a84102cbc0c/roles/610824e4f50f4fb8954610e98c1de784 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 17:26:37.278361 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04b4e00-d24d-4374-96c3-555611815071 None None] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:26:37.278660 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04b4e00-d24d-4374-96c3-555611815071 None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:26:37.278940 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04b4e00-d24d-4374-96c3-555611815071 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:26:37.309251 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.auth.core [None req-f04b4e00-d24d-4374-96c3-555611815071 None None] MFA Rules not processed for user `b06d7a51b2a74c58a31f4a84102cbc0c`. Rule list: `[]` (Enabled: `True`). {{(pid=85205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 17:26:37.310528 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-f04b4e00-d24d-4374-96c3-555611815071 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:26:37.388857 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1351/2718] 10.222.0.58 () {58 vars in 957 bytes} [Tue Oct 12 17:26:37 2021] POST /identity/v3/auth/tokens => generated 3472 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 17:26:37.399840 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a394d71f-2329-4320-bfe6-dbc01c96bf83 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:26:37.401445 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-a394d71f-2329-4320-bfe6-dbc01c96bf83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:26:37.459933 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a394d71f-2329-4320-bfe6-dbc01c96bf83 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:26:37.464414 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70543cdf-a6c5-430b-a499-cbd539bd4743 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04704222b3d64a33a6c092fc641ccbb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:26:37.465213 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70543cdf-a6c5-430b-a499-cbd539bd4743 service cinder] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:26:37.465506 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70543cdf-a6c5-430b-a499-cbd539bd4743 service cinder] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:26:37.465843 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70543cdf-a6c5-430b-a499-cbd539bd4743 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:26:37.535799 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70543cdf-a6c5-430b-a499-cbd539bd4743 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:26:37.537240 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70543cdf-a6c5-430b-a499-cbd539bd4743 service cinder] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:26:37.546840 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1368/2719] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Oct 12 17:26:37 2021] GET /identity/v3/auth/tokens => generated 3403 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 17:26:39.054610 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04b4e00-d24d-4374-96c3-555611815071 None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:26:39.065544 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04b4e00-d24d-4374-96c3-555611815071 None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:26:39.070391 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b9cb28-a102-4950-846d-431b0a52a5e0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04704222b3d64a33a6c092fc641ccbb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:26:39.071339 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b9cb28-a102-4950-846d-431b0a52a5e0 service cinder] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:26:39.071682 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b9cb28-a102-4950-846d-431b0a52a5e0 service cinder] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:26:39.071909 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b9cb28-a102-4950-846d-431b0a52a5e0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:26:39.132720 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b9cb28-a102-4950-846d-431b0a52a5e0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:26:39.134516 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b9cb28-a102-4950-846d-431b0a52a5e0 service cinder] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:26:39.144940 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1352/2720] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Oct 12 17:26:39 2021] GET /identity/v3/auth/tokens => generated 3403 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 17:26:39.724992 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70543cdf-a6c5-430b-a499-cbd539bd4743 service cinder] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:26:39.735077 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70543cdf-a6c5-430b-a499-cbd539bd4743 service cinder] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:26:39.747259 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fed2ed-fea6-4006-a6d4-3104c3491f48 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04704222b3d64a33a6c092fc641ccbb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:26:39.748048 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fed2ed-fea6-4006-a6d4-3104c3491f48 service cinder] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:26:39.748398 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fed2ed-fea6-4006-a6d4-3104c3491f48 service cinder] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:26:39.748765 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fed2ed-fea6-4006-a6d4-3104c3491f48 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:26:39.763032 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fed2ed-fea6-4006-a6d4-3104c3491f48 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:26:39.764482 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fed2ed-fea6-4006-a6d4-3104c3491f48 service cinder] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:26:39.774629 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1369/2721] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Oct 12 17:26:39 2021] GET /identity/v3/auth/tokens => generated 3472 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 17:26:43.581932 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b9cb28-a102-4950-846d-431b0a52a5e0 service cinder] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:26:43.642260 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b9cb28-a102-4950-846d-431b0a52a5e0 service cinder] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:26:43.647128 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4485aefb-5077-49d0-b0b2-f49d5a9f493a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:26:43.648022 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4485aefb-5077-49d0-b0b2-f49d5a9f493a admin admin] REQUEST_METHOD: `DELETE` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:26:43.648306 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4485aefb-5077-49d0-b0b2-f49d5a9f493a admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:26:43.648586 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4485aefb-5077-49d0-b0b2-f49d5a9f493a admin admin] PATH_INFO: `/v3/users/a9edb938f4d14643af633a824336d1bb` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:26:43.649824 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4485aefb-5077-49d0-b0b2-f49d5a9f493a admin admin] RBAC: Authorizing `identity:delete_user(user_id=a9edb938f4d14643af633a824336d1bb)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:26:43.651751 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4485aefb-5077-49d0-b0b2-f49d5a9f493a admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:26:43.696960 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-4485aefb-5077-49d0-b0b2-f49d5a9f493a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a9edb938f4d14643af633a824336d1bb'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:26:43.708313 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-4485aefb-5077-49d0-b0b2-f49d5a9f493a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a9edb938f4d14643af633a824336d1bb'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:26:43.716775 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-4485aefb-5077-49d0-b0b2-f49d5a9f493a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a9edb938f4d14643af633a824336d1bb'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:26:43.724992 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-4485aefb-5077-49d0-b0b2-f49d5a9f493a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a9edb938f4d14643af633a824336d1bb'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:26:43.725719 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-4485aefb-5077-49d0-b0b2-f49d5a9f493a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a9edb938f4d14643af633a824336d1bb'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:26:43.732341 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1353/2722] 10.222.0.58 () {58 vars in 1223 bytes} [Tue Oct 12 17:26:43 2021] DELETE /identity/v3/users/a9edb938f4d14643af633a824336d1bb => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 17:26:43.736916 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe30d43-ed8a-4513-8320-b67dd71de312 None None] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:26:43.737458 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe30d43-ed8a-4513-8320-b67dd71de312 None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:26:43.737711 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe30d43-ed8a-4513-8320-b67dd71de312 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:26:43.755425 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.auth.core [None req-bfe30d43-ed8a-4513-8320-b67dd71de312 None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 17:26:43.756657 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-bfe30d43-ed8a-4513-8320-b67dd71de312 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:26:43.839350 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1370/2723] 10.222.0.58 () {58 vars in 957 bytes} [Tue Oct 12 17:26:43 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 17:26:43.851730 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4485aefb-5077-49d0-b0b2-f49d5a9f493a admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:26:43.853696 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-4485aefb-5077-49d0-b0b2-f49d5a9f493a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:26:43.932359 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4485aefb-5077-49d0-b0b2-f49d5a9f493a admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:26:43.936187 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81860353-94c8-4d2c-bc72-d9d25e78ac6d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e65f6d0598e4c539134292b86fb43d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:26:43.936844 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81860353-94c8-4d2c-bc72-d9d25e78ac6d service neutron] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:26:43.937136 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81860353-94c8-4d2c-bc72-d9d25e78ac6d service neutron] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:26:43.937416 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81860353-94c8-4d2c-bc72-d9d25e78ac6d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:26:43.947973 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81860353-94c8-4d2c-bc72-d9d25e78ac6d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:26:43.949493 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81860353-94c8-4d2c-bc72-d9d25e78ac6d service neutron] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:26:43.960864 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1354/2724] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Oct 12 17:26:43 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 17:26:44.280289 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe30d43-ed8a-4513-8320-b67dd71de312 None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:26:44.282125 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-bfe30d43-ed8a-4513-8320-b67dd71de312 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:26:44.297275 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe30d43-ed8a-4513-8320-b67dd71de312 None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:26:44.304586 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed775e9-e8d9-4640-a9fb-b7f7c04bb72f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:26:44.305704 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed775e9-e8d9-4640-a9fb-b7f7c04bb72f admin admin] REQUEST_METHOD: `DELETE` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:26:44.306086 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed775e9-e8d9-4640-a9fb-b7f7c04bb72f admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:26:44.306430 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed775e9-e8d9-4640-a9fb-b7f7c04bb72f admin admin] PATH_INFO: `/v3/projects/b5f82f1264e944878580ececa2da0d68` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:26:44.307710 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed775e9-e8d9-4640-a9fb-b7f7c04bb72f admin admin] RBAC: Authorizing `identity:delete_project(project_id=b5f82f1264e944878580ececa2da0d68)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:26:44.309658 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed775e9-e8d9-4640-a9fb-b7f7c04bb72f admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:26:44.369183 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-2ed775e9-e8d9-4640-a9fb-b7f7c04bb72f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b5f82f1264e944878580ececa2da0d68', 'request_id': 'req-2ed775e9-e8d9-4640-a9fb-b7f7c04bb72f'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:26:44.374588 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-2ed775e9-e8d9-4640-a9fb-b7f7c04bb72f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b5f82f1264e944878580ececa2da0d68', 'request_id': 'req-2ed775e9-e8d9-4640-a9fb-b7f7c04bb72f'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:26:44.380598 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-2ed775e9-e8d9-4640-a9fb-b7f7c04bb72f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b5f82f1264e944878580ececa2da0d68', 'request_id': 'req-2ed775e9-e8d9-4640-a9fb-b7f7c04bb72f'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:26:44.393734 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-2ed775e9-e8d9-4640-a9fb-b7f7c04bb72f admin admin] The token cache is being invalidate because project b5f82f1264e944878580ececa2da0d68 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=85204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 17:26:44.394812 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-2ed775e9-e8d9-4640-a9fb-b7f7c04bb72f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:26:44.395468 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-2ed775e9-e8d9-4640-a9fb-b7f7c04bb72f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:26:44.397037 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1371/2725] 10.222.0.58 () {58 vars in 1232 bytes} [Tue Oct 12 17:26:44 2021] DELETE /identity/v3/projects/b5f82f1264e944878580ececa2da0d68 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 17:26:44.401585 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81860353-94c8-4d2c-bc72-d9d25e78ac6d service neutron] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:26:44.411136 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81860353-94c8-4d2c-bc72-d9d25e78ac6d service neutron] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:26:44.465079 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c41b362-5c7a-4d6d-90db-05b5b88d7b2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:26:44.465992 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c41b362-5c7a-4d6d-90db-05b5b88d7b2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:26:44.466281 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c41b362-5c7a-4d6d-90db-05b5b88d7b2f admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:26:44.466561 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c41b362-5c7a-4d6d-90db-05b5b88d7b2f admin admin] PATH_INFO: `/v3/users/043cc17744e146a4982de7eb80008fe6` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:26:44.467768 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c41b362-5c7a-4d6d-90db-05b5b88d7b2f admin admin] RBAC: Authorizing `identity:delete_user(user_id=043cc17744e146a4982de7eb80008fe6)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:26:44.469675 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c41b362-5c7a-4d6d-90db-05b5b88d7b2f admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:26:44.514558 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-6c41b362-5c7a-4d6d-90db-05b5b88d7b2f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '043cc17744e146a4982de7eb80008fe6'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:26:44.526683 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-6c41b362-5c7a-4d6d-90db-05b5b88d7b2f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '043cc17744e146a4982de7eb80008fe6'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:26:44.533230 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-6c41b362-5c7a-4d6d-90db-05b5b88d7b2f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '043cc17744e146a4982de7eb80008fe6'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:26:44.539693 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-6c41b362-5c7a-4d6d-90db-05b5b88d7b2f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '043cc17744e146a4982de7eb80008fe6'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:26:44.540354 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-6c41b362-5c7a-4d6d-90db-05b5b88d7b2f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '043cc17744e146a4982de7eb80008fe6'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:26:44.546634 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1355/2726] 10.222.0.58 () {58 vars in 1223 bytes} [Tue Oct 12 17:26:44 2021] DELETE /identity/v3/users/043cc17744e146a4982de7eb80008fe6 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 17:26:44.932091 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed775e9-e8d9-4640-a9fb-b7f7c04bb72f admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:26:44.933601 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-2ed775e9-e8d9-4640-a9fb-b7f7c04bb72f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:26:44.946616 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed775e9-e8d9-4640-a9fb-b7f7c04bb72f admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:26:45.004556 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d1f1d3-a60b-421b-9694-f8bc10c48d8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:26:45.005445 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d1f1d3-a60b-421b-9694-f8bc10c48d8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:26:45.005730 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d1f1d3-a60b-421b-9694-f8bc10c48d8b admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:26:45.006041 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d1f1d3-a60b-421b-9694-f8bc10c48d8b admin admin] PATH_INFO: `/v3/projects/52e16f39f437408fbd4419eed9ed6bbd` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:26:45.007273 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d1f1d3-a60b-421b-9694-f8bc10c48d8b admin admin] RBAC: Authorizing `identity:delete_project(project_id=52e16f39f437408fbd4419eed9ed6bbd)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:26:45.009421 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d1f1d3-a60b-421b-9694-f8bc10c48d8b admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:26:45.057227 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-c0d1f1d3-a60b-421b-9694-f8bc10c48d8b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '52e16f39f437408fbd4419eed9ed6bbd', 'request_id': 'req-c0d1f1d3-a60b-421b-9694-f8bc10c48d8b'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:26:45.063366 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-c0d1f1d3-a60b-421b-9694-f8bc10c48d8b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '52e16f39f437408fbd4419eed9ed6bbd', 'request_id': 'req-c0d1f1d3-a60b-421b-9694-f8bc10c48d8b'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:26:45.072270 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-c0d1f1d3-a60b-421b-9694-f8bc10c48d8b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '52e16f39f437408fbd4419eed9ed6bbd', 'request_id': 'req-c0d1f1d3-a60b-421b-9694-f8bc10c48d8b'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:26:45.087650 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-c0d1f1d3-a60b-421b-9694-f8bc10c48d8b admin admin] The token cache is being invalidate because project 52e16f39f437408fbd4419eed9ed6bbd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=85204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 17:26:45.088118 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-c0d1f1d3-a60b-421b-9694-f8bc10c48d8b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:26:45.088774 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-c0d1f1d3-a60b-421b-9694-f8bc10c48d8b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:26:45.090362 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1372/2727] 10.222.0.58 () {58 vars in 1232 bytes} [Tue Oct 12 17:26:44 2021] DELETE /identity/v3/projects/52e16f39f437408fbd4419eed9ed6bbd => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 17:26:45.094311 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c41b362-5c7a-4d6d-90db-05b5b88d7b2f admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:26:45.095850 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-6c41b362-5c7a-4d6d-90db-05b5b88d7b2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:26:45.109629 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c41b362-5c7a-4d6d-90db-05b5b88d7b2f admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:26:45.166849 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45548bc0-5e99-4073-adbe-a4cf7d8f7830 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:26:45.167851 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45548bc0-5e99-4073-adbe-a4cf7d8f7830 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:26:45.168136 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45548bc0-5e99-4073-adbe-a4cf7d8f7830 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:26:45.168410 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45548bc0-5e99-4073-adbe-a4cf7d8f7830 admin admin] PATH_INFO: `/v3/users/b06d7a51b2a74c58a31f4a84102cbc0c` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:26:45.169629 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45548bc0-5e99-4073-adbe-a4cf7d8f7830 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b06d7a51b2a74c58a31f4a84102cbc0c)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:26:45.171538 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45548bc0-5e99-4073-adbe-a4cf7d8f7830 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:26:45.214816 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-45548bc0-5e99-4073-adbe-a4cf7d8f7830 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b06d7a51b2a74c58a31f4a84102cbc0c'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:26:45.225603 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-45548bc0-5e99-4073-adbe-a4cf7d8f7830 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b06d7a51b2a74c58a31f4a84102cbc0c'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:26:45.232213 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-45548bc0-5e99-4073-adbe-a4cf7d8f7830 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b06d7a51b2a74c58a31f4a84102cbc0c'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:26:45.238647 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-45548bc0-5e99-4073-adbe-a4cf7d8f7830 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b06d7a51b2a74c58a31f4a84102cbc0c'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:26:45.239264 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-45548bc0-5e99-4073-adbe-a4cf7d8f7830 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b06d7a51b2a74c58a31f4a84102cbc0c'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:26:45.244859 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1356/2728] 10.222.0.58 () {58 vars in 1223 bytes} [Tue Oct 12 17:26:45 2021] DELETE /identity/v3/users/b06d7a51b2a74c58a31f4a84102cbc0c => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 17:26:45.507249 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d1f1d3-a60b-421b-9694-f8bc10c48d8b admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:26:45.509563 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-c0d1f1d3-a60b-421b-9694-f8bc10c48d8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:26:45.522148 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d1f1d3-a60b-421b-9694-f8bc10c48d8b admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:26:45.575321 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8b8316-96f9-4f19-813e-e28761173752 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:26:45.576155 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8b8316-96f9-4f19-813e-e28761173752 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:26:45.576430 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8b8316-96f9-4f19-813e-e28761173752 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:26:45.576699 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8b8316-96f9-4f19-813e-e28761173752 admin admin] PATH_INFO: `/v3/projects/118fb4f732194ad8a3555c98e67cf1ab` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:26:45.577867 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8b8316-96f9-4f19-813e-e28761173752 admin admin] RBAC: Authorizing `identity:delete_project(project_id=118fb4f732194ad8a3555c98e67cf1ab)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:26:45.579773 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8b8316-96f9-4f19-813e-e28761173752 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:26:45.623601 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-3d8b8316-96f9-4f19-813e-e28761173752 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '118fb4f732194ad8a3555c98e67cf1ab', 'request_id': 'req-3d8b8316-96f9-4f19-813e-e28761173752'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:26:45.628708 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-3d8b8316-96f9-4f19-813e-e28761173752 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '118fb4f732194ad8a3555c98e67cf1ab', 'request_id': 'req-3d8b8316-96f9-4f19-813e-e28761173752'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:26:45.635327 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-3d8b8316-96f9-4f19-813e-e28761173752 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '118fb4f732194ad8a3555c98e67cf1ab', 'request_id': 'req-3d8b8316-96f9-4f19-813e-e28761173752'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:26:45.646871 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-3d8b8316-96f9-4f19-813e-e28761173752 admin admin] The token cache is being invalidate because project 118fb4f732194ad8a3555c98e67cf1ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=85204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 17:26:45.647159 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-3d8b8316-96f9-4f19-813e-e28761173752 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:26:45.647802 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-3d8b8316-96f9-4f19-813e-e28761173752 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:26:45.649286 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1373/2729] 10.222.0.58 () {58 vars in 1232 bytes} [Tue Oct 12 17:26:45 2021] DELETE /identity/v3/projects/118fb4f732194ad8a3555c98e67cf1ab => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 17:26:46.527707 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45548bc0-5e99-4073-adbe-a4cf7d8f7830 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:26:46.529135 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-45548bc0-5e99-4073-adbe-a4cf7d8f7830 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:26:46.583113 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45548bc0-5e99-4073-adbe-a4cf7d8f7830 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:26:46.628681 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e567e624-43ba-42ee-9a60-5f388a2629e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e65f6d0598e4c539134292b86fb43d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:26:46.629326 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e567e624-43ba-42ee-9a60-5f388a2629e2 service neutron] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:26:46.629612 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e567e624-43ba-42ee-9a60-5f388a2629e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:26:46.629911 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e567e624-43ba-42ee-9a60-5f388a2629e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:26:46.631648 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-e567e624-43ba-42ee-9a60-5f388a2629e2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:26:46.689584 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e567e624-43ba-42ee-9a60-5f388a2629e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:26:46.691023 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e567e624-43ba-42ee-9a60-5f388a2629e2 service neutron] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:26:46.700434 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1357/2730] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Oct 12 17:26:46 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 17:26:49.998489 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8b8316-96f9-4f19-813e-e28761173752 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:26:49.999921 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-3d8b8316-96f9-4f19-813e-e28761173752 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:26:50.015138 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8b8316-96f9-4f19-813e-e28761173752 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:26:50.019945 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9305f503-fefe-434f-8ef4-82ebef715908 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:26:50.020817 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9305f503-fefe-434f-8ef4-82ebef715908 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:26:50.021114 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9305f503-fefe-434f-8ef4-82ebef715908 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:26:50.021382 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9305f503-fefe-434f-8ef4-82ebef715908 admin admin] PATH_INFO: `/v3/users/69c3a35689e540b09d83fd072d5011b7` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:26:50.035610 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9305f503-fefe-434f-8ef4-82ebef715908 admin admin] RBAC: Authorizing `identity:delete_user(user_id=69c3a35689e540b09d83fd072d5011b7)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:26:50.037458 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9305f503-fefe-434f-8ef4-82ebef715908 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:26:50.086691 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-9305f503-fefe-434f-8ef4-82ebef715908 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '69c3a35689e540b09d83fd072d5011b7'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:26:50.098318 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-9305f503-fefe-434f-8ef4-82ebef715908 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '69c3a35689e540b09d83fd072d5011b7'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:26:50.105415 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-9305f503-fefe-434f-8ef4-82ebef715908 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '69c3a35689e540b09d83fd072d5011b7'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:26:50.113358 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-9305f503-fefe-434f-8ef4-82ebef715908 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '69c3a35689e540b09d83fd072d5011b7'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:26:50.114023 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-9305f503-fefe-434f-8ef4-82ebef715908 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '69c3a35689e540b09d83fd072d5011b7'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:26:50.119824 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1374/2731] 10.222.0.58 () {58 vars in 1223 bytes} [Tue Oct 12 17:26:49 2021] DELETE /identity/v3/users/69c3a35689e540b09d83fd072d5011b7 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 17:26:50.281994 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e567e624-43ba-42ee-9a60-5f388a2629e2 service neutron] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:26:50.292473 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e567e624-43ba-42ee-9a60-5f388a2629e2 service neutron] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:26:50.347092 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd472e88-af22-48b1-a973-80aba2e8f4a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:26:50.348253 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd472e88-af22-48b1-a973-80aba2e8f4a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:26:50.348534 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd472e88-af22-48b1-a973-80aba2e8f4a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:26:50.348806 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd472e88-af22-48b1-a973-80aba2e8f4a7 admin admin] PATH_INFO: `/v3/projects/5f15f4248cdd4fc39f8061dc5ebe854d` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:26:50.350010 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd472e88-af22-48b1-a973-80aba2e8f4a7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5f15f4248cdd4fc39f8061dc5ebe854d)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:26:50.352359 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd472e88-af22-48b1-a973-80aba2e8f4a7 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:26:50.401538 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-dd472e88-af22-48b1-a973-80aba2e8f4a7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5f15f4248cdd4fc39f8061dc5ebe854d', 'request_id': 'req-dd472e88-af22-48b1-a973-80aba2e8f4a7'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:26:50.407295 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-dd472e88-af22-48b1-a973-80aba2e8f4a7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5f15f4248cdd4fc39f8061dc5ebe854d', 'request_id': 'req-dd472e88-af22-48b1-a973-80aba2e8f4a7'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:26:50.414009 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-dd472e88-af22-48b1-a973-80aba2e8f4a7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5f15f4248cdd4fc39f8061dc5ebe854d', 'request_id': 'req-dd472e88-af22-48b1-a973-80aba2e8f4a7'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:26:50.427655 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-dd472e88-af22-48b1-a973-80aba2e8f4a7 admin admin] The token cache is being invalidate because project 5f15f4248cdd4fc39f8061dc5ebe854d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=85205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 17:26:50.427950 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-dd472e88-af22-48b1-a973-80aba2e8f4a7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:26:50.428594 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-dd472e88-af22-48b1-a973-80aba2e8f4a7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:26:50.435773 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1358/2732] 10.222.0.58 () {58 vars in 1232 bytes} [Tue Oct 12 17:26:50 2021] DELETE /identity/v3/projects/5f15f4248cdd4fc39f8061dc5ebe854d => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 17:26:50.437485 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c440d26-2748-474e-a0be-3f8fec18c2ba None None] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:26:50.437782 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c440d26-2748-474e-a0be-3f8fec18c2ba None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:26:50.438118 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c440d26-2748-474e-a0be-3f8fec18c2ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:26:50.456876 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.auth.core [None req-9c440d26-2748-474e-a0be-3f8fec18c2ba None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 17:26:50.458127 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-9c440d26-2748-474e-a0be-3f8fec18c2ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:26:50.521891 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1375/2733] 10.222.0.58 () {58 vars in 957 bytes} [Tue Oct 12 17:26:50 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 17:26:50.530023 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44917b1-759a-4863-a405-ccab5efaac87 None None] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:26:50.530363 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44917b1-759a-4863-a405-ccab5efaac87 None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:26:50.530649 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44917b1-759a-4863-a405-ccab5efaac87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:26:50.549716 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.auth.core [None req-e44917b1-759a-4863-a405-ccab5efaac87 None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 17:26:50.550997 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-e44917b1-759a-4863-a405-ccab5efaac87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:26:50.559003 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1359/2734] 10.222.0.58 () {58 vars in 957 bytes} [Tue Oct 12 17:26:50 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 17:26:50.563224 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c440d26-2748-474e-a0be-3f8fec18c2ba None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:26:50.573387 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c440d26-2748-474e-a0be-3f8fec18c2ba None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:26:50.577994 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01110489-aff5-4eae-a232-ac6fc02b8041 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:26:50.578653 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01110489-aff5-4eae-a232-ac6fc02b8041 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:26:50.578936 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01110489-aff5-4eae-a232-ac6fc02b8041 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:26:50.579211 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01110489-aff5-4eae-a232-ac6fc02b8041 admin admin] PATH_INFO: `/v3/domains` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:26:50.579950 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01110489-aff5-4eae-a232-ac6fc02b8041 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 17:26:50.580260 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01110489-aff5-4eae-a232-ac6fc02b8041 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:26:50.581846 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01110489-aff5-4eae-a232-ac6fc02b8041 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:26:50.593676 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1376/2735] 10.222.0.58 () {58 vars in 1152 bytes} [Tue Oct 12 17:26:50 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 17:26:50.597994 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44917b1-759a-4863-a405-ccab5efaac87 None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:26:50.607090 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44917b1-759a-4863-a405-ccab5efaac87 None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:26:50.611728 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2678bf-ecc9-4c45-abd6-065c927be5ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:26:50.612366 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2678bf-ecc9-4c45-abd6-065c927be5ee admin admin] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:26:50.612646 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2678bf-ecc9-4c45-abd6-065c927be5ee admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:26:50.612917 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2678bf-ecc9-4c45-abd6-065c927be5ee admin admin] PATH_INFO: `/v3/projects` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:26:50.613608 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2678bf-ecc9-4c45-abd6-065c927be5ee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:26:50.615492 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2678bf-ecc9-4c45-abd6-065c927be5ee admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:26:50.640533 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1360/2736] 10.222.0.58 () {60 vars in 1152 bytes} [Tue Oct 12 17:26:50 2021] POST /identity/v3/projects => generated 371 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 17:26:50.644716 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01110489-aff5-4eae-a232-ac6fc02b8041 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:26:50.654644 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01110489-aff5-4eae-a232-ac6fc02b8041 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:26:50.707256 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7d0640-05ed-4917-9603-545bfa80995d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:26:50.707916 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7d0640-05ed-4917-9603-545bfa80995d admin admin] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:26:50.708196 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7d0640-05ed-4917-9603-545bfa80995d admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:26:50.708473 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7d0640-05ed-4917-9603-545bfa80995d admin admin] PATH_INFO: `/v3/users` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:26:50.709175 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7d0640-05ed-4917-9603-545bfa80995d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:26:50.711115 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7d0640-05ed-4917-9603-545bfa80995d admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:26:50.731540 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1377/2737] 10.222.0.58 () {60 vars in 1143 bytes} [Tue Oct 12 17:26:50 2021] POST /identity/v3/users => generated 286 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 17:26:50.734202 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2678bf-ecc9-4c45-abd6-065c927be5ee admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:26:50.745693 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2678bf-ecc9-4c45-abd6-065c927be5ee admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:26:50.750339 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841b5c0b-058d-4c98-bbe6-8045bf5758be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:26:50.750990 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841b5c0b-058d-4c98-bbe6-8045bf5758be admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:26:50.751269 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841b5c0b-058d-4c98-bbe6-8045bf5758be admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:26:50.751539 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841b5c0b-058d-4c98-bbe6-8045bf5758be admin admin] PATH_INFO: `/v3/roles` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:26:50.752294 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841b5c0b-058d-4c98-bbe6-8045bf5758be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:26:50.753853 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841b5c0b-058d-4c98-bbe6-8045bf5758be admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:26:50.764882 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1361/2738] 10.222.0.58 () {58 vars in 1121 bytes} [Tue Oct 12 17:26:50 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 17:26:50.768846 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7d0640-05ed-4917-9603-545bfa80995d admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:26:50.778606 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7d0640-05ed-4917-9603-545bfa80995d admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:26:50.783202 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3065326c-a4cc-429d-9374-447dc7f45396 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:26:50.783856 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3065326c-a4cc-429d-9374-447dc7f45396 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:26:50.784139 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3065326c-a4cc-429d-9374-447dc7f45396 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:26:50.784418 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3065326c-a4cc-429d-9374-447dc7f45396 admin admin] PATH_INFO: `/v3/roles` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:26:50.785152 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3065326c-a4cc-429d-9374-447dc7f45396 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:26:50.786750 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3065326c-a4cc-429d-9374-447dc7f45396 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:26:50.796312 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1378/2739] 10.222.0.58 () {58 vars in 1121 bytes} [Tue Oct 12 17:26:50 2021] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 17:26:50.800195 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841b5c0b-058d-4c98-bbe6-8045bf5758be admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:26:50.810152 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841b5c0b-058d-4c98-bbe6-8045bf5758be admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:26:50.814774 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f069cb65-587e-4eb0-9682-23d73381b346 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:26:50.815635 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f069cb65-587e-4eb0-9682-23d73381b346 admin admin] REQUEST_METHOD: `PUT` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:26:50.815909 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f069cb65-587e-4eb0-9682-23d73381b346 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:26:50.816176 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f069cb65-587e-4eb0-9682-23d73381b346 admin admin] PATH_INFO: `/v3/projects/564e8b328c22453b8b81e2e81a6c0e30/users/16437a466899406aaea7b3014985f1b0/roles/55ba49fe29884e64b57c3ad13188d554` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:26:50.830061 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f069cb65-587e-4eb0-9682-23d73381b346 admin admin] RBAC: Authorizing `identity:create_grant(project_id=564e8b328c22453b8b81e2e81a6c0e30, user_id=16437a466899406aaea7b3014985f1b0, role_id=55ba49fe29884e64b57c3ad13188d554)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:26:50.832625 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f069cb65-587e-4eb0-9682-23d73381b346 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:26:50.845522 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1362/2740] 10.222.0.58 () {60 vars in 1482 bytes} [Tue Oct 12 17:26:50 2021] PUT /identity/v3/projects/564e8b328c22453b8b81e2e81a6c0e30/users/16437a466899406aaea7b3014985f1b0/roles/55ba49fe29884e64b57c3ad13188d554 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 17:26:50.856680 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98688218-47c4-470b-81ec-985dd78a1bd3 None None] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:26:50.856967 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98688218-47c4-470b-81ec-985dd78a1bd3 None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:26:50.857243 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98688218-47c4-470b-81ec-985dd78a1bd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:26:50.883007 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.auth.core [None req-98688218-47c4-470b-81ec-985dd78a1bd3 None None] MFA Rules not processed for user `16437a466899406aaea7b3014985f1b0`. Rule list: `[]` (Enabled: `True`). {{(pid=85204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 17:26:50.884737 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-98688218-47c4-470b-81ec-985dd78a1bd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:26:50.946469 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1379/2741] 10.222.0.58 () {58 vars in 957 bytes} [Tue Oct 12 17:26:50 2021] POST /identity/v3/auth/tokens => generated 3391 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 17:26:50.950846 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f069cb65-587e-4eb0-9682-23d73381b346 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:26:51.013317 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f069cb65-587e-4eb0-9682-23d73381b346 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:26:51.018118 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db949201-1bc0-4842-bfd6-429472928341 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:26:51.018789 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db949201-1bc0-4842-bfd6-429472928341 admin admin] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:26:51.019074 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db949201-1bc0-4842-bfd6-429472928341 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:26:51.019360 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db949201-1bc0-4842-bfd6-429472928341 admin admin] PATH_INFO: `/v3/projects` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:26:51.020073 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db949201-1bc0-4842-bfd6-429472928341 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:26:51.021986 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db949201-1bc0-4842-bfd6-429472928341 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:26:51.047900 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1363/2742] 10.222.0.58 () {60 vars in 1152 bytes} [Tue Oct 12 17:26:50 2021] POST /identity/v3/projects => generated 373 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 17:26:51.051986 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98688218-47c4-470b-81ec-985dd78a1bd3 None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:26:51.063208 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98688218-47c4-470b-81ec-985dd78a1bd3 None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:26:51.119723 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af5ec0a-b59c-4850-97ef-dfbbd53a2374 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:26:51.120395 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af5ec0a-b59c-4850-97ef-dfbbd53a2374 admin admin] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:26:51.120681 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af5ec0a-b59c-4850-97ef-dfbbd53a2374 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:26:51.120955 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af5ec0a-b59c-4850-97ef-dfbbd53a2374 admin admin] PATH_INFO: `/v3/users` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:26:51.121668 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af5ec0a-b59c-4850-97ef-dfbbd53a2374 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:26:51.123609 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af5ec0a-b59c-4850-97ef-dfbbd53a2374 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:26:51.143459 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1380/2743] 10.222.0.58 () {60 vars in 1143 bytes} [Tue Oct 12 17:26:51 2021] POST /identity/v3/users => generated 293 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 17:26:51.147185 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db949201-1bc0-4842-bfd6-429472928341 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:26:51.157339 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db949201-1bc0-4842-bfd6-429472928341 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:26:51.162028 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be0de5a-e5f9-428f-bffc-96e2dcf4a992 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:26:51.162685 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be0de5a-e5f9-428f-bffc-96e2dcf4a992 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:26:51.162970 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be0de5a-e5f9-428f-bffc-96e2dcf4a992 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:26:51.163246 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be0de5a-e5f9-428f-bffc-96e2dcf4a992 admin admin] PATH_INFO: `/v3/roles` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:26:51.164583 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be0de5a-e5f9-428f-bffc-96e2dcf4a992 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:26:51.166192 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be0de5a-e5f9-428f-bffc-96e2dcf4a992 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:26:51.176640 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1364/2744] 10.222.0.58 () {58 vars in 1121 bytes} [Tue Oct 12 17:26:51 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 17:26:51.181036 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af5ec0a-b59c-4850-97ef-dfbbd53a2374 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:26:51.190753 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af5ec0a-b59c-4850-97ef-dfbbd53a2374 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:26:51.198001 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962cd06d-2c31-46e5-8ba0-5bdcf989a821 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:26:51.198001 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962cd06d-2c31-46e5-8ba0-5bdcf989a821 admin admin] REQUEST_METHOD: `PUT` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:26:51.198001 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962cd06d-2c31-46e5-8ba0-5bdcf989a821 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:26:51.198001 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962cd06d-2c31-46e5-8ba0-5bdcf989a821 admin admin] PATH_INFO: `/v3/projects/ec2b5adf20a84241a018e52f814ca246/users/4ed4c88b787141b08163bb1072d8c587/roles/610824e4f50f4fb8954610e98c1de784` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:26:51.212586 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962cd06d-2c31-46e5-8ba0-5bdcf989a821 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec2b5adf20a84241a018e52f814ca246, user_id=4ed4c88b787141b08163bb1072d8c587, role_id=610824e4f50f4fb8954610e98c1de784)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:26:51.215367 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962cd06d-2c31-46e5-8ba0-5bdcf989a821 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:26:51.228941 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1381/2745] 10.222.0.58 () {60 vars in 1482 bytes} [Tue Oct 12 17:26:51 2021] PUT /identity/v3/projects/ec2b5adf20a84241a018e52f814ca246/users/4ed4c88b787141b08163bb1072d8c587/roles/610824e4f50f4fb8954610e98c1de784 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 17:26:51.232699 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be0de5a-e5f9-428f-bffc-96e2dcf4a992 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:26:51.242529 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be0de5a-e5f9-428f-bffc-96e2dcf4a992 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:26:51.296490 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2d53cc-ca69-4910-b804-dd097d16edfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:26:51.297174 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2d53cc-ca69-4910-b804-dd097d16edfe admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:26:51.297427 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2d53cc-ca69-4910-b804-dd097d16edfe admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:26:51.297705 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2d53cc-ca69-4910-b804-dd097d16edfe admin admin] PATH_INFO: `/v3/roles` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:26:51.298478 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2d53cc-ca69-4910-b804-dd097d16edfe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:26:51.300041 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2d53cc-ca69-4910-b804-dd097d16edfe admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:26:51.309659 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1365/2746] 10.222.0.58 () {58 vars in 1121 bytes} [Tue Oct 12 17:26:51 2021] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 17:26:51.314239 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962cd06d-2c31-46e5-8ba0-5bdcf989a821 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:26:51.324585 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962cd06d-2c31-46e5-8ba0-5bdcf989a821 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:26:51.329074 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b4f726-10c3-4443-85f7-0ab1263bd048 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:26:51.329974 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b4f726-10c3-4443-85f7-0ab1263bd048 admin admin] REQUEST_METHOD: `PUT` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:26:51.330262 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b4f726-10c3-4443-85f7-0ab1263bd048 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:26:51.330531 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b4f726-10c3-4443-85f7-0ab1263bd048 admin admin] PATH_INFO: `/v3/projects/ec2b5adf20a84241a018e52f814ca246/users/4ed4c88b787141b08163bb1072d8c587/roles/610824e4f50f4fb8954610e98c1de784` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:26:51.332461 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b4f726-10c3-4443-85f7-0ab1263bd048 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec2b5adf20a84241a018e52f814ca246, user_id=4ed4c88b787141b08163bb1072d8c587, role_id=610824e4f50f4fb8954610e98c1de784)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:26:51.335917 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b4f726-10c3-4443-85f7-0ab1263bd048 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:26:51.346036 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1382/2747] 10.222.0.58 () {60 vars in 1482 bytes} [Tue Oct 12 17:26:51 2021] PUT /identity/v3/projects/ec2b5adf20a84241a018e52f814ca246/users/4ed4c88b787141b08163bb1072d8c587/roles/610824e4f50f4fb8954610e98c1de784 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 17:26:51.356047 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69184413-72a4-4576-8536-789be787c479 None None] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:26:51.356340 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69184413-72a4-4576-8536-789be787c479 None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:26:51.356619 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69184413-72a4-4576-8536-789be787c479 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:26:51.383448 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.auth.core [None req-69184413-72a4-4576-8536-789be787c479 None None] MFA Rules not processed for user `4ed4c88b787141b08163bb1072d8c587`. Rule list: `[]` (Enabled: `True`). {{(pid=85205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 17:26:51.384937 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-69184413-72a4-4576-8536-789be787c479 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:26:51.451060 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1366/2748] 10.222.0.58 () {58 vars in 957 bytes} [Tue Oct 12 17:26:51 2021] POST /identity/v3/auth/tokens => generated 3460 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 17:26:51.461569 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b4f726-10c3-4443-85f7-0ab1263bd048 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:26:51.463361 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-86b4f726-10c3-4443-85f7-0ab1263bd048 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:26:51.519715 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b4f726-10c3-4443-85f7-0ab1263bd048 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:26:51.523404 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b758b4-ee1d-473f-ab13-8b44c73a52ef service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04704222b3d64a33a6c092fc641ccbb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:26:51.524047 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b758b4-ee1d-473f-ab13-8b44c73a52ef service cinder] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:26:51.524327 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b758b4-ee1d-473f-ab13-8b44c73a52ef service cinder] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:26:51.524596 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b758b4-ee1d-473f-ab13-8b44c73a52ef service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:26:51.533423 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b758b4-ee1d-473f-ab13-8b44c73a52ef service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:26:51.534878 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b758b4-ee1d-473f-ab13-8b44c73a52ef service cinder] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:26:51.544565 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1383/2749] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Oct 12 17:26:51 2021] GET /identity/v3/auth/tokens => generated 3460 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 17:26:51.614122 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69184413-72a4-4576-8536-789be787c479 None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:26:51.624212 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69184413-72a4-4576-8536-789be787c479 None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:26:51.627940 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b1883b-879d-4703-9625-9ac515637f24 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04704222b3d64a33a6c092fc641ccbb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:26:51.628649 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b1883b-879d-4703-9625-9ac515637f24 service cinder] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:26:51.629100 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b1883b-879d-4703-9625-9ac515637f24 service cinder] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:26:51.629400 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b1883b-879d-4703-9625-9ac515637f24 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:26:51.684352 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b1883b-879d-4703-9625-9ac515637f24 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:26:51.685794 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b1883b-879d-4703-9625-9ac515637f24 service cinder] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:26:51.694938 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1367/2750] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Oct 12 17:26:51 2021] GET /identity/v3/auth/tokens => generated 3391 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 17:26:51.913985 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b758b4-ee1d-473f-ab13-8b44c73a52ef service cinder] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:26:51.915423 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-b1b758b4-ee1d-473f-ab13-8b44c73a52ef service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:26:51.985962 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b758b4-ee1d-473f-ab13-8b44c73a52ef service cinder] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:26:51.989644 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb18a594-53be-42fc-a0a3-345c2492f2fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e65f6d0598e4c539134292b86fb43d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:26:51.990311 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb18a594-53be-42fc-a0a3-345c2492f2fe service neutron] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:26:51.990596 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb18a594-53be-42fc-a0a3-345c2492f2fe service neutron] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:26:51.990870 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb18a594-53be-42fc-a0a3-345c2492f2fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:26:51.993432 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-cb18a594-53be-42fc-a0a3-345c2492f2fe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:26:52.006922 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb18a594-53be-42fc-a0a3-345c2492f2fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:26:52.008525 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb18a594-53be-42fc-a0a3-345c2492f2fe service neutron] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:26:52.016684 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1384/2751] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Oct 12 17:26:51 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 17:27:00.983143 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b1883b-879d-4703-9625-9ac515637f24 service cinder] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:27:00.984672 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-02b1883b-879d-4703-9625-9ac515637f24 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:27:00.996618 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b1883b-879d-4703-9625-9ac515637f24 service cinder] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:27:01.000302 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcd6cf8-4ef5-4d78-9da2-908d9354bdb4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e65f6d0598e4c539134292b86fb43d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:27:01.000939 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcd6cf8-4ef5-4d78-9da2-908d9354bdb4 service neutron] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:27:01.001225 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcd6cf8-4ef5-4d78-9da2-908d9354bdb4 service neutron] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:27:01.001504 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcd6cf8-4ef5-4d78-9da2-908d9354bdb4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:27:01.003357 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-9bcd6cf8-4ef5-4d78-9da2-908d9354bdb4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:27:01.062709 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcd6cf8-4ef5-4d78-9da2-908d9354bdb4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:27:01.064113 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcd6cf8-4ef5-4d78-9da2-908d9354bdb4 service neutron] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:27:01.073840 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1368/2752] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Oct 12 17:27:00 2021] GET /identity/v3/auth/tokens => generated 3470 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 17:27:07.162403 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb18a594-53be-42fc-a0a3-345c2492f2fe service neutron] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:27:07.170941 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb18a594-53be-42fc-a0a3-345c2492f2fe service neutron] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:27:07.174606 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffeea95-2de8-4454-b24a-cc3d82b413e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e65f6d0598e4c539134292b86fb43d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:27:07.175237 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffeea95-2de8-4454-b24a-cc3d82b413e7 service neutron] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:27:07.175521 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffeea95-2de8-4454-b24a-cc3d82b413e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:27:07.175861 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffeea95-2de8-4454-b24a-cc3d82b413e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:27:07.177911 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-6ffeea95-2de8-4454-b24a-cc3d82b413e7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:27:07.188893 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffeea95-2de8-4454-b24a-cc3d82b413e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:27:07.190589 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffeea95-2de8-4454-b24a-cc3d82b413e7 service neutron] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:27:07.200393 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1385/2753] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Oct 12 17:27:07 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 17:27:32.556030 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcd6cf8-4ef5-4d78-9da2-908d9354bdb4 service neutron] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:27:32.614423 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcd6cf8-4ef5-4d78-9da2-908d9354bdb4 service neutron] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:27:32.619008 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8866d2-5a83-4f0d-b803-7dfe149bffbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:27:32.619858 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8866d2-5a83-4f0d-b803-7dfe149bffbc admin admin] REQUEST_METHOD: `DELETE` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:27:32.620139 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8866d2-5a83-4f0d-b803-7dfe149bffbc admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:27:32.620411 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8866d2-5a83-4f0d-b803-7dfe149bffbc admin admin] PATH_INFO: `/v3/users/16437a466899406aaea7b3014985f1b0` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:27:32.621603 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8866d2-5a83-4f0d-b803-7dfe149bffbc admin admin] RBAC: Authorizing `identity:delete_user(user_id=16437a466899406aaea7b3014985f1b0)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:27:32.623529 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8866d2-5a83-4f0d-b803-7dfe149bffbc admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:27:32.667943 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-2b8866d2-5a83-4f0d-b803-7dfe149bffbc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '16437a466899406aaea7b3014985f1b0'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:27:32.679075 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-2b8866d2-5a83-4f0d-b803-7dfe149bffbc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '16437a466899406aaea7b3014985f1b0'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:27:32.685817 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-2b8866d2-5a83-4f0d-b803-7dfe149bffbc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '16437a466899406aaea7b3014985f1b0'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:27:32.692363 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-2b8866d2-5a83-4f0d-b803-7dfe149bffbc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '16437a466899406aaea7b3014985f1b0'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:27:32.692988 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-2b8866d2-5a83-4f0d-b803-7dfe149bffbc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '16437a466899406aaea7b3014985f1b0'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:27:32.698614 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1369/2754] 10.222.0.58 () {58 vars in 1223 bytes} [Tue Oct 12 17:27:32 2021] DELETE /identity/v3/users/16437a466899406aaea7b3014985f1b0 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 17:27:32.703108 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058050f8-a8fd-4c35-afb6-d84556ccd208 None None] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:27:32.703582 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058050f8-a8fd-4c35-afb6-d84556ccd208 None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:27:32.703686 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058050f8-a8fd-4c35-afb6-d84556ccd208 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:27:32.720633 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.auth.core [None req-058050f8-a8fd-4c35-afb6-d84556ccd208 None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 17:27:32.721840 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-058050f8-a8fd-4c35-afb6-d84556ccd208 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:27:32.777303 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1386/2755] 10.222.0.58 () {58 vars in 957 bytes} [Tue Oct 12 17:27:32 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 17:27:32.787166 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8866d2-5a83-4f0d-b803-7dfe149bffbc admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:27:32.789116 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-2b8866d2-5a83-4f0d-b803-7dfe149bffbc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:27:32.843089 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8866d2-5a83-4f0d-b803-7dfe149bffbc admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:27:32.846737 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768a68b2-6a5c-408e-81fd-f7e1fa39fc3b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e65f6d0598e4c539134292b86fb43d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:27:32.847377 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768a68b2-6a5c-408e-81fd-f7e1fa39fc3b service neutron] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:27:32.847684 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768a68b2-6a5c-408e-81fd-f7e1fa39fc3b service neutron] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:27:32.847956 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768a68b2-6a5c-408e-81fd-f7e1fa39fc3b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:27:32.857317 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768a68b2-6a5c-408e-81fd-f7e1fa39fc3b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:27:32.858795 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768a68b2-6a5c-408e-81fd-f7e1fa39fc3b service neutron] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:27:32.868119 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1370/2756] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Oct 12 17:27:32 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 17:27:33.131852 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058050f8-a8fd-4c35-afb6-d84556ccd208 None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:27:33.133291 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-058050f8-a8fd-4c35-afb6-d84556ccd208 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:27:33.149210 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058050f8-a8fd-4c35-afb6-d84556ccd208 None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:27:33.154734 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe26279c-dc9c-4eb4-ad44-b9156017000f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:27:33.155607 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe26279c-dc9c-4eb4-ad44-b9156017000f admin admin] REQUEST_METHOD: `DELETE` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:27:33.155891 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe26279c-dc9c-4eb4-ad44-b9156017000f admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:27:33.156168 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe26279c-dc9c-4eb4-ad44-b9156017000f admin admin] PATH_INFO: `/v3/projects/564e8b328c22453b8b81e2e81a6c0e30` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:27:33.157380 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe26279c-dc9c-4eb4-ad44-b9156017000f admin admin] RBAC: Authorizing `identity:delete_project(project_id=564e8b328c22453b8b81e2e81a6c0e30)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:27:33.159322 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe26279c-dc9c-4eb4-ad44-b9156017000f admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:27:33.210591 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-fe26279c-dc9c-4eb4-ad44-b9156017000f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '564e8b328c22453b8b81e2e81a6c0e30', 'request_id': 'req-fe26279c-dc9c-4eb4-ad44-b9156017000f'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:27:33.215897 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-fe26279c-dc9c-4eb4-ad44-b9156017000f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '564e8b328c22453b8b81e2e81a6c0e30', 'request_id': 'req-fe26279c-dc9c-4eb4-ad44-b9156017000f'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:27:33.221927 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-fe26279c-dc9c-4eb4-ad44-b9156017000f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '564e8b328c22453b8b81e2e81a6c0e30', 'request_id': 'req-fe26279c-dc9c-4eb4-ad44-b9156017000f'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:27:33.235198 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-fe26279c-dc9c-4eb4-ad44-b9156017000f admin admin] The token cache is being invalidate because project 564e8b328c22453b8b81e2e81a6c0e30 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=85204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 17:27:33.235483 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-fe26279c-dc9c-4eb4-ad44-b9156017000f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:27:33.236114 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-fe26279c-dc9c-4eb4-ad44-b9156017000f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:27:33.237639 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1387/2757] 10.222.0.58 () {58 vars in 1232 bytes} [Tue Oct 12 17:27:33 2021] DELETE /identity/v3/projects/564e8b328c22453b8b81e2e81a6c0e30 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 17:27:33.242247 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768a68b2-6a5c-408e-81fd-f7e1fa39fc3b service neutron] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:27:33.251663 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768a68b2-6a5c-408e-81fd-f7e1fa39fc3b service neutron] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:27:33.307379 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409cd1eb-67d5-4590-afc4-ad447b2af693 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:27:33.308160 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409cd1eb-67d5-4590-afc4-ad447b2af693 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:27:33.308446 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409cd1eb-67d5-4590-afc4-ad447b2af693 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:27:33.308723 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409cd1eb-67d5-4590-afc4-ad447b2af693 admin admin] PATH_INFO: `/v3/users/4ed4c88b787141b08163bb1072d8c587` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:27:33.309965 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409cd1eb-67d5-4590-afc4-ad447b2af693 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ed4c88b787141b08163bb1072d8c587)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:27:33.311889 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409cd1eb-67d5-4590-afc4-ad447b2af693 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:27:33.360624 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-409cd1eb-67d5-4590-afc4-ad447b2af693 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ed4c88b787141b08163bb1072d8c587'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:27:33.372867 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-409cd1eb-67d5-4590-afc4-ad447b2af693 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ed4c88b787141b08163bb1072d8c587'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:27:33.381114 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-409cd1eb-67d5-4590-afc4-ad447b2af693 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ed4c88b787141b08163bb1072d8c587'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:27:33.388266 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-409cd1eb-67d5-4590-afc4-ad447b2af693 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ed4c88b787141b08163bb1072d8c587'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:27:33.388932 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-409cd1eb-67d5-4590-afc4-ad447b2af693 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ed4c88b787141b08163bb1072d8c587'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:27:33.394815 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1371/2758] 10.222.0.58 () {58 vars in 1223 bytes} [Tue Oct 12 17:27:33 2021] DELETE /identity/v3/users/4ed4c88b787141b08163bb1072d8c587 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 17:27:33.671637 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe26279c-dc9c-4eb4-ad44-b9156017000f admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:27:33.673440 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-fe26279c-dc9c-4eb4-ad44-b9156017000f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:27:33.689600 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe26279c-dc9c-4eb4-ad44-b9156017000f admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:27:33.751636 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3762d73-ad4b-4395-8dce-a7d063519f0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:27:33.753084 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3762d73-ad4b-4395-8dce-a7d063519f0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:27:33.753364 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3762d73-ad4b-4395-8dce-a7d063519f0c admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:27:33.753638 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3762d73-ad4b-4395-8dce-a7d063519f0c admin admin] PATH_INFO: `/v3/projects/ec2b5adf20a84241a018e52f814ca246` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:27:33.754883 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3762d73-ad4b-4395-8dce-a7d063519f0c admin admin] RBAC: Authorizing `identity:delete_project(project_id=ec2b5adf20a84241a018e52f814ca246)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:27:33.756760 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3762d73-ad4b-4395-8dce-a7d063519f0c admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:27:33.808189 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-d3762d73-ad4b-4395-8dce-a7d063519f0c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ec2b5adf20a84241a018e52f814ca246', 'request_id': 'req-d3762d73-ad4b-4395-8dce-a7d063519f0c'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:27:33.814899 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-d3762d73-ad4b-4395-8dce-a7d063519f0c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ec2b5adf20a84241a018e52f814ca246', 'request_id': 'req-d3762d73-ad4b-4395-8dce-a7d063519f0c'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:27:33.821241 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-d3762d73-ad4b-4395-8dce-a7d063519f0c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ec2b5adf20a84241a018e52f814ca246', 'request_id': 'req-d3762d73-ad4b-4395-8dce-a7d063519f0c'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:27:33.833546 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-d3762d73-ad4b-4395-8dce-a7d063519f0c admin admin] The token cache is being invalidate because project ec2b5adf20a84241a018e52f814ca246 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=85204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 17:27:33.833832 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-d3762d73-ad4b-4395-8dce-a7d063519f0c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:27:33.834477 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-d3762d73-ad4b-4395-8dce-a7d063519f0c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:27:33.836115 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1388/2759] 10.222.0.58 () {58 vars in 1232 bytes} [Tue Oct 12 17:27:33 2021] DELETE /identity/v3/projects/ec2b5adf20a84241a018e52f814ca246 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 17:27:33.842468 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07c2f5c-5dfc-479b-8ee8-357967904924 None None] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:27:33.842943 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07c2f5c-5dfc-479b-8ee8-357967904924 None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:27:33.842943 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07c2f5c-5dfc-479b-8ee8-357967904924 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:27:33.860670 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.auth.core [None req-f07c2f5c-5dfc-479b-8ee8-357967904924 None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 17:27:33.861918 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-f07c2f5c-5dfc-479b-8ee8-357967904924 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:27:33.918535 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1372/2760] 10.222.0.58 () {58 vars in 957 bytes} [Tue Oct 12 17:27:33 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 17:27:33.926187 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f0af88-6193-4c7d-8efe-1d5bdf078f5d None None] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:27:33.926476 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f0af88-6193-4c7d-8efe-1d5bdf078f5d None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:27:33.926746 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f0af88-6193-4c7d-8efe-1d5bdf078f5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:27:33.944975 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.auth.core [None req-94f0af88-6193-4c7d-8efe-1d5bdf078f5d None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 17:27:33.946198 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-94f0af88-6193-4c7d-8efe-1d5bdf078f5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:27:33.953796 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1389/2761] 10.222.0.58 () {58 vars in 957 bytes} [Tue Oct 12 17:27:33 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 17:27:33.957757 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07c2f5c-5dfc-479b-8ee8-357967904924 None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:27:33.967329 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07c2f5c-5dfc-479b-8ee8-357967904924 None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:27:33.971982 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac473620-3fa4-4b34-ad02-e5073affa8d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:27:33.972628 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac473620-3fa4-4b34-ad02-e5073affa8d7 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:27:33.972913 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac473620-3fa4-4b34-ad02-e5073affa8d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:27:33.973211 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac473620-3fa4-4b34-ad02-e5073affa8d7 admin admin] PATH_INFO: `/v3/domains` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:27:33.973956 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac473620-3fa4-4b34-ad02-e5073affa8d7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 17:27:33.974275 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac473620-3fa4-4b34-ad02-e5073affa8d7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:27:33.976365 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac473620-3fa4-4b34-ad02-e5073affa8d7 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:27:33.987414 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1373/2762] 10.222.0.58 () {58 vars in 1152 bytes} [Tue Oct 12 17:27:33 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 17:27:33.991517 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f0af88-6193-4c7d-8efe-1d5bdf078f5d None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:27:34.000406 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f0af88-6193-4c7d-8efe-1d5bdf078f5d None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:27:34.004970 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0faf7c-e28b-4812-897d-e89ff04addb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:27:34.005601 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0faf7c-e28b-4812-897d-e89ff04addb5 admin admin] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:27:34.005899 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0faf7c-e28b-4812-897d-e89ff04addb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:27:34.006177 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0faf7c-e28b-4812-897d-e89ff04addb5 admin admin] PATH_INFO: `/v3/projects` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:27:34.006876 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0faf7c-e28b-4812-897d-e89ff04addb5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:27:34.009228 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0faf7c-e28b-4812-897d-e89ff04addb5 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:27:34.034510 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1390/2763] 10.222.0.58 () {60 vars in 1152 bytes} [Tue Oct 12 17:27:33 2021] POST /identity/v3/projects => generated 357 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 17:27:34.038677 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac473620-3fa4-4b34-ad02-e5073affa8d7 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:27:34.048382 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac473620-3fa4-4b34-ad02-e5073affa8d7 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:27:34.101812 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b0def8-fd76-40da-a5f5-d70a52d595b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:27:34.102435 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b0def8-fd76-40da-a5f5-d70a52d595b9 admin admin] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:27:34.102723 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b0def8-fd76-40da-a5f5-d70a52d595b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:27:34.103004 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b0def8-fd76-40da-a5f5-d70a52d595b9 admin admin] PATH_INFO: `/v3/users` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:27:34.103709 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b0def8-fd76-40da-a5f5-d70a52d595b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:27:34.105586 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b0def8-fd76-40da-a5f5-d70a52d595b9 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:27:34.126400 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1374/2764] 10.222.0.58 () {60 vars in 1143 bytes} [Tue Oct 12 17:27:34 2021] POST /identity/v3/users => generated 279 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 17:27:34.130284 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0faf7c-e28b-4812-897d-e89ff04addb5 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:27:34.140669 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0faf7c-e28b-4812-897d-e89ff04addb5 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:27:34.145279 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b74c18b-fc6a-4d0e-b9ae-27f35e7da419 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:27:34.145955 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b74c18b-fc6a-4d0e-b9ae-27f35e7da419 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:27:34.146236 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b74c18b-fc6a-4d0e-b9ae-27f35e7da419 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:27:34.146507 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b74c18b-fc6a-4d0e-b9ae-27f35e7da419 admin admin] PATH_INFO: `/v3/roles` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:27:34.147230 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b74c18b-fc6a-4d0e-b9ae-27f35e7da419 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:27:34.149456 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b74c18b-fc6a-4d0e-b9ae-27f35e7da419 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:27:34.159928 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1391/2765] 10.222.0.58 () {58 vars in 1121 bytes} [Tue Oct 12 17:27:34 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 17:27:34.164260 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b0def8-fd76-40da-a5f5-d70a52d595b9 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:27:34.173833 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b0def8-fd76-40da-a5f5-d70a52d595b9 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:27:34.178475 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c0a3b0-46db-4849-a0d2-2b30be3a9493 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:27:34.179609 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c0a3b0-46db-4849-a0d2-2b30be3a9493 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:27:34.179885 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c0a3b0-46db-4849-a0d2-2b30be3a9493 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:27:34.180155 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c0a3b0-46db-4849-a0d2-2b30be3a9493 admin admin] PATH_INFO: `/v3/roles` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:27:34.180879 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c0a3b0-46db-4849-a0d2-2b30be3a9493 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:27:34.182463 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c0a3b0-46db-4849-a0d2-2b30be3a9493 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:27:34.191936 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1375/2766] 10.222.0.58 () {58 vars in 1121 bytes} [Tue Oct 12 17:27:34 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 17:27:34.196337 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b74c18b-fc6a-4d0e-b9ae-27f35e7da419 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:27:34.206012 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b74c18b-fc6a-4d0e-b9ae-27f35e7da419 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:27:34.211448 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7494639d-4368-4a15-81b8-1f17562b5de3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:27:34.212425 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7494639d-4368-4a15-81b8-1f17562b5de3 admin admin] REQUEST_METHOD: `PUT` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:27:34.212768 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7494639d-4368-4a15-81b8-1f17562b5de3 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:27:34.213045 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7494639d-4368-4a15-81b8-1f17562b5de3 admin admin] PATH_INFO: `/v3/projects/177af866d508471f9aeecde6d956e46b/users/0ddcfdf47b824beab196af537f457223/roles/55ba49fe29884e64b57c3ad13188d554` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:27:34.227534 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7494639d-4368-4a15-81b8-1f17562b5de3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=177af866d508471f9aeecde6d956e46b, user_id=0ddcfdf47b824beab196af537f457223, role_id=55ba49fe29884e64b57c3ad13188d554)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:27:34.230350 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7494639d-4368-4a15-81b8-1f17562b5de3 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:27:34.243778 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1392/2767] 10.222.0.58 () {60 vars in 1482 bytes} [Tue Oct 12 17:27:34 2021] PUT /identity/v3/projects/177af866d508471f9aeecde6d956e46b/users/0ddcfdf47b824beab196af537f457223/roles/55ba49fe29884e64b57c3ad13188d554 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 17:27:34.254107 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109dc0bc-309e-427a-a7e5-6bcddc941dba None None] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:27:34.254407 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109dc0bc-309e-427a-a7e5-6bcddc941dba None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:27:34.254693 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109dc0bc-309e-427a-a7e5-6bcddc941dba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:27:34.280827 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.auth.core [None req-109dc0bc-309e-427a-a7e5-6bcddc941dba None None] MFA Rules not processed for user `0ddcfdf47b824beab196af537f457223`. Rule list: `[]` (Enabled: `True`). {{(pid=85205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 17:27:34.282064 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-109dc0bc-309e-427a-a7e5-6bcddc941dba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:27:34.342211 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1376/2768] 10.222.0.58 () {58 vars in 957 bytes} [Tue Oct 12 17:27:34 2021] POST /identity/v3/auth/tokens => generated 3377 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 17:27:34.346717 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7494639d-4368-4a15-81b8-1f17562b5de3 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:27:34.408249 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7494639d-4368-4a15-81b8-1f17562b5de3 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:27:34.412781 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf60cea-f15d-451f-82a7-f282dd92d6d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:27:34.414042 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf60cea-f15d-451f-82a7-f282dd92d6d4 admin admin] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:27:34.414326 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf60cea-f15d-451f-82a7-f282dd92d6d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:27:34.414597 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf60cea-f15d-451f-82a7-f282dd92d6d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:27:34.415300 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf60cea-f15d-451f-82a7-f282dd92d6d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:27:34.417176 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf60cea-f15d-451f-82a7-f282dd92d6d4 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:27:34.441313 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1393/2769] 10.222.0.58 () {60 vars in 1152 bytes} [Tue Oct 12 17:27:34 2021] POST /identity/v3/projects => generated 355 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 17:27:34.446145 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109dc0bc-309e-427a-a7e5-6bcddc941dba None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:27:34.456439 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109dc0bc-309e-427a-a7e5-6bcddc941dba None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:27:34.509075 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198a1cb9-1c27-4f82-b240-666a458a3eae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:27:34.509724 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198a1cb9-1c27-4f82-b240-666a458a3eae admin admin] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:27:34.510302 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198a1cb9-1c27-4f82-b240-666a458a3eae admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:27:34.510577 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198a1cb9-1c27-4f82-b240-666a458a3eae admin admin] PATH_INFO: `/v3/users` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:27:34.511312 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198a1cb9-1c27-4f82-b240-666a458a3eae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:27:34.513326 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198a1cb9-1c27-4f82-b240-666a458a3eae admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:27:34.532575 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1377/2770] 10.222.0.58 () {60 vars in 1143 bytes} [Tue Oct 12 17:27:34 2021] POST /identity/v3/users => generated 284 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 17:27:34.536323 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf60cea-f15d-451f-82a7-f282dd92d6d4 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:27:34.546772 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf60cea-f15d-451f-82a7-f282dd92d6d4 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:27:34.551339 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30de68a-03e5-4bfa-8ab8-6fd2bc3565f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:27:34.551993 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30de68a-03e5-4bfa-8ab8-6fd2bc3565f2 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:27:34.552275 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30de68a-03e5-4bfa-8ab8-6fd2bc3565f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:27:34.552554 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30de68a-03e5-4bfa-8ab8-6fd2bc3565f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:27:34.553288 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30de68a-03e5-4bfa-8ab8-6fd2bc3565f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:27:34.555416 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30de68a-03e5-4bfa-8ab8-6fd2bc3565f2 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:27:34.565432 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1394/2771] 10.222.0.58 () {58 vars in 1121 bytes} [Tue Oct 12 17:27:34 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 17:27:34.569509 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198a1cb9-1c27-4f82-b240-666a458a3eae admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:27:34.579251 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198a1cb9-1c27-4f82-b240-666a458a3eae admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:27:34.583820 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3960332e-5f41-4029-82f1-d11a57e1fd19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:27:34.584683 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3960332e-5f41-4029-82f1-d11a57e1fd19 admin admin] REQUEST_METHOD: `PUT` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:27:34.584964 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3960332e-5f41-4029-82f1-d11a57e1fd19 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:27:34.585238 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3960332e-5f41-4029-82f1-d11a57e1fd19 admin admin] PATH_INFO: `/v3/projects/750a3124020c49cdbbdb9641d7c9759e/users/a6fab9bc35f84eae8f9e4fd4963d4519/roles/610824e4f50f4fb8954610e98c1de784` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:27:34.599268 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3960332e-5f41-4029-82f1-d11a57e1fd19 admin admin] RBAC: Authorizing `identity:create_grant(project_id=750a3124020c49cdbbdb9641d7c9759e, user_id=a6fab9bc35f84eae8f9e4fd4963d4519, role_id=610824e4f50f4fb8954610e98c1de784)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:27:34.602426 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3960332e-5f41-4029-82f1-d11a57e1fd19 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:27:34.614964 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1378/2772] 10.222.0.58 () {60 vars in 1482 bytes} [Tue Oct 12 17:27:34 2021] PUT /identity/v3/projects/750a3124020c49cdbbdb9641d7c9759e/users/a6fab9bc35f84eae8f9e4fd4963d4519/roles/610824e4f50f4fb8954610e98c1de784 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 17:27:34.619313 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30de68a-03e5-4bfa-8ab8-6fd2bc3565f2 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:27:34.628850 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30de68a-03e5-4bfa-8ab8-6fd2bc3565f2 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:27:34.682375 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa97083b-ce65-41ed-bbd1-9bf354a92f74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:27:34.683065 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa97083b-ce65-41ed-bbd1-9bf354a92f74 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:27:34.683371 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa97083b-ce65-41ed-bbd1-9bf354a92f74 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:27:34.683655 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa97083b-ce65-41ed-bbd1-9bf354a92f74 admin admin] PATH_INFO: `/v3/roles` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:27:34.685031 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa97083b-ce65-41ed-bbd1-9bf354a92f74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:27:34.686932 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa97083b-ce65-41ed-bbd1-9bf354a92f74 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:27:34.698474 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1395/2773] 10.222.0.58 () {58 vars in 1121 bytes} [Tue Oct 12 17:27:34 2021] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 17:27:34.704439 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3960332e-5f41-4029-82f1-d11a57e1fd19 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:27:34.714927 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3960332e-5f41-4029-82f1-d11a57e1fd19 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:27:34.719520 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3cffac-9099-46ce-8e1e-d1c340e292fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:27:34.720391 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3cffac-9099-46ce-8e1e-d1c340e292fa admin admin] REQUEST_METHOD: `PUT` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:27:34.720710 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3cffac-9099-46ce-8e1e-d1c340e292fa admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:27:34.720974 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3cffac-9099-46ce-8e1e-d1c340e292fa admin admin] PATH_INFO: `/v3/projects/750a3124020c49cdbbdb9641d7c9759e/users/a6fab9bc35f84eae8f9e4fd4963d4519/roles/610824e4f50f4fb8954610e98c1de784` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:27:34.722960 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3cffac-9099-46ce-8e1e-d1c340e292fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=750a3124020c49cdbbdb9641d7c9759e, user_id=a6fab9bc35f84eae8f9e4fd4963d4519, role_id=610824e4f50f4fb8954610e98c1de784)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:27:34.725551 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3cffac-9099-46ce-8e1e-d1c340e292fa admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:27:34.735999 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1379/2774] 10.222.0.58 () {60 vars in 1482 bytes} [Tue Oct 12 17:27:34 2021] PUT /identity/v3/projects/750a3124020c49cdbbdb9641d7c9759e/users/a6fab9bc35f84eae8f9e4fd4963d4519/roles/610824e4f50f4fb8954610e98c1de784 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 17:27:34.747422 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498d8676-ab89-435a-b588-1bf9ce400f2f None None] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:27:34.747733 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498d8676-ab89-435a-b588-1bf9ce400f2f None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:27:34.747992 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498d8676-ab89-435a-b588-1bf9ce400f2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:27:34.773438 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.auth.core [None req-498d8676-ab89-435a-b588-1bf9ce400f2f None None] MFA Rules not processed for user `a6fab9bc35f84eae8f9e4fd4963d4519`. Rule list: `[]` (Enabled: `True`). {{(pid=85204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 17:27:34.774676 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-498d8676-ab89-435a-b588-1bf9ce400f2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:27:34.842903 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1396/2775] 10.222.0.58 () {58 vars in 957 bytes} [Tue Oct 12 17:27:34 2021] POST /identity/v3/auth/tokens => generated 3442 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 17:27:34.853904 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3cffac-9099-46ce-8e1e-d1c340e292fa admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:27:34.855591 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-0e3cffac-9099-46ce-8e1e-d1c340e292fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:27:34.908703 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3cffac-9099-46ce-8e1e-d1c340e292fa admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:27:34.912508 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8ffea1-cf84-4cc0-97b4-ea2b175aad2c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04704222b3d64a33a6c092fc641ccbb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:27:34.913142 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8ffea1-cf84-4cc0-97b4-ea2b175aad2c service cinder] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:27:34.914003 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8ffea1-cf84-4cc0-97b4-ea2b175aad2c service cinder] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:27:34.914275 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8ffea1-cf84-4cc0-97b4-ea2b175aad2c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:27:34.923106 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8ffea1-cf84-4cc0-97b4-ea2b175aad2c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:27:34.924515 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8ffea1-cf84-4cc0-97b4-ea2b175aad2c service cinder] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:27:34.933724 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1380/2776] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Oct 12 17:27:34 2021] GET /identity/v3/auth/tokens => generated 3442 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 17:27:35.000142 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498d8676-ab89-435a-b588-1bf9ce400f2f None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:27:35.009650 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498d8676-ab89-435a-b588-1bf9ce400f2f None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:27:35.013854 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47e2e2c-5828-4d53-8d63-d25f68d4315c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04704222b3d64a33a6c092fc641ccbb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:27:35.014513 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47e2e2c-5828-4d53-8d63-d25f68d4315c service cinder] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:27:35.014796 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47e2e2c-5828-4d53-8d63-d25f68d4315c service cinder] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:27:35.015071 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47e2e2c-5828-4d53-8d63-d25f68d4315c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:27:35.068130 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47e2e2c-5828-4d53-8d63-d25f68d4315c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:27:35.069566 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47e2e2c-5828-4d53-8d63-d25f68d4315c service cinder] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:27:35.078058 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1397/2777] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Oct 12 17:27:34 2021] GET /identity/v3/auth/tokens => generated 3377 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 17:27:49.484923 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8ffea1-cf84-4cc0-97b4-ea2b175aad2c service cinder] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:27:49.544761 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8ffea1-cf84-4cc0-97b4-ea2b175aad2c service cinder] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:27:49.549497 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6398c763-1c4e-4682-a2e5-2f8acbe184e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:27:49.550409 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6398c763-1c4e-4682-a2e5-2f8acbe184e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:27:49.550691 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6398c763-1c4e-4682-a2e5-2f8acbe184e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:27:49.550969 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6398c763-1c4e-4682-a2e5-2f8acbe184e4 admin admin] PATH_INFO: `/v3/users/0ddcfdf47b824beab196af537f457223` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:27:49.552237 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6398c763-1c4e-4682-a2e5-2f8acbe184e4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ddcfdf47b824beab196af537f457223)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:27:49.554223 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6398c763-1c4e-4682-a2e5-2f8acbe184e4 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:27:49.601375 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-6398c763-1c4e-4682-a2e5-2f8acbe184e4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ddcfdf47b824beab196af537f457223'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:27:49.612397 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-6398c763-1c4e-4682-a2e5-2f8acbe184e4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ddcfdf47b824beab196af537f457223'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:27:49.619495 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-6398c763-1c4e-4682-a2e5-2f8acbe184e4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ddcfdf47b824beab196af537f457223'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:27:49.625968 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-6398c763-1c4e-4682-a2e5-2f8acbe184e4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ddcfdf47b824beab196af537f457223'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:27:49.626656 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-6398c763-1c4e-4682-a2e5-2f8acbe184e4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ddcfdf47b824beab196af537f457223'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:27:49.632852 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1381/2778] 10.222.0.58 () {58 vars in 1223 bytes} [Tue Oct 12 17:27:49 2021] DELETE /identity/v3/users/0ddcfdf47b824beab196af537f457223 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 17:27:49.637625 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b68c35-2a72-4fe2-b1b7-6abf90a96522 None None] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:27:49.638146 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b68c35-2a72-4fe2-b1b7-6abf90a96522 None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:27:49.638250 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b68c35-2a72-4fe2-b1b7-6abf90a96522 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:27:49.655522 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.auth.core [None req-51b68c35-2a72-4fe2-b1b7-6abf90a96522 None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 17:27:49.656684 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-51b68c35-2a72-4fe2-b1b7-6abf90a96522 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:27:49.712428 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1398/2779] 10.222.0.58 () {58 vars in 957 bytes} [Tue Oct 12 17:27:49 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 17:27:49.722049 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6398c763-1c4e-4682-a2e5-2f8acbe184e4 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:27:49.723469 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-6398c763-1c4e-4682-a2e5-2f8acbe184e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:27:49.781323 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6398c763-1c4e-4682-a2e5-2f8acbe184e4 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:27:49.784866 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551c81b2-432a-4b09-92d7-ad8e7fe5b7dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e65f6d0598e4c539134292b86fb43d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:27:49.785503 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551c81b2-432a-4b09-92d7-ad8e7fe5b7dd service neutron] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:27:49.785786 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551c81b2-432a-4b09-92d7-ad8e7fe5b7dd service neutron] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:27:49.786094 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551c81b2-432a-4b09-92d7-ad8e7fe5b7dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:27:49.795629 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551c81b2-432a-4b09-92d7-ad8e7fe5b7dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:27:49.797607 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551c81b2-432a-4b09-92d7-ad8e7fe5b7dd service neutron] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:27:49.807719 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1382/2780] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Oct 12 17:27:49 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 17:27:50.064680 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b68c35-2a72-4fe2-b1b7-6abf90a96522 None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:27:50.066139 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-51b68c35-2a72-4fe2-b1b7-6abf90a96522 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:27:50.094707 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b68c35-2a72-4fe2-b1b7-6abf90a96522 None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:27:50.099562 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e24deab-12ba-4243-ac6d-11462363b933 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:27:50.100447 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e24deab-12ba-4243-ac6d-11462363b933 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:27:50.100767 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e24deab-12ba-4243-ac6d-11462363b933 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:27:50.101549 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e24deab-12ba-4243-ac6d-11462363b933 admin admin] PATH_INFO: `/v3/projects/177af866d508471f9aeecde6d956e46b` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:27:50.102816 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e24deab-12ba-4243-ac6d-11462363b933 admin admin] RBAC: Authorizing `identity:delete_project(project_id=177af866d508471f9aeecde6d956e46b)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:27:50.104738 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e24deab-12ba-4243-ac6d-11462363b933 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:27:50.149112 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-6e24deab-12ba-4243-ac6d-11462363b933 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '177af866d508471f9aeecde6d956e46b', 'request_id': 'req-6e24deab-12ba-4243-ac6d-11462363b933'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:27:50.154322 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-6e24deab-12ba-4243-ac6d-11462363b933 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '177af866d508471f9aeecde6d956e46b', 'request_id': 'req-6e24deab-12ba-4243-ac6d-11462363b933'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:27:50.160123 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-6e24deab-12ba-4243-ac6d-11462363b933 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '177af866d508471f9aeecde6d956e46b', 'request_id': 'req-6e24deab-12ba-4243-ac6d-11462363b933'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:27:50.172046 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-6e24deab-12ba-4243-ac6d-11462363b933 admin admin] The token cache is being invalidate because project 177af866d508471f9aeecde6d956e46b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=85204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 17:27:50.172334 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-6e24deab-12ba-4243-ac6d-11462363b933 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:27:50.172950 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-6e24deab-12ba-4243-ac6d-11462363b933 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:27:50.174475 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1399/2781] 10.222.0.58 () {58 vars in 1232 bytes} [Tue Oct 12 17:27:50 2021] DELETE /identity/v3/projects/177af866d508471f9aeecde6d956e46b => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 17:27:50.178502 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551c81b2-432a-4b09-92d7-ad8e7fe5b7dd service neutron] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:27:50.187905 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551c81b2-432a-4b09-92d7-ad8e7fe5b7dd service neutron] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:27:50.240567 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b611f62d-15a6-468e-9a0b-7bfdff464e49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:27:50.241433 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b611f62d-15a6-468e-9a0b-7bfdff464e49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:27:50.241720 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b611f62d-15a6-468e-9a0b-7bfdff464e49 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:27:50.242037 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b611f62d-15a6-468e-9a0b-7bfdff464e49 admin admin] PATH_INFO: `/v3/users/a6fab9bc35f84eae8f9e4fd4963d4519` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:27:50.243237 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b611f62d-15a6-468e-9a0b-7bfdff464e49 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a6fab9bc35f84eae8f9e4fd4963d4519)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:27:50.245129 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b611f62d-15a6-468e-9a0b-7bfdff464e49 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:27:50.287371 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-b611f62d-15a6-468e-9a0b-7bfdff464e49 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a6fab9bc35f84eae8f9e4fd4963d4519'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:27:50.298481 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-b611f62d-15a6-468e-9a0b-7bfdff464e49 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a6fab9bc35f84eae8f9e4fd4963d4519'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:27:50.305402 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-b611f62d-15a6-468e-9a0b-7bfdff464e49 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a6fab9bc35f84eae8f9e4fd4963d4519'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:27:50.312164 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-b611f62d-15a6-468e-9a0b-7bfdff464e49 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a6fab9bc35f84eae8f9e4fd4963d4519'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:27:50.312756 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-b611f62d-15a6-468e-9a0b-7bfdff464e49 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a6fab9bc35f84eae8f9e4fd4963d4519'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:27:50.318593 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1383/2782] 10.222.0.58 () {58 vars in 1223 bytes} [Tue Oct 12 17:27:50 2021] DELETE /identity/v3/users/a6fab9bc35f84eae8f9e4fd4963d4519 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 17:27:50.584682 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e24deab-12ba-4243-ac6d-11462363b933 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:27:50.586746 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-6e24deab-12ba-4243-ac6d-11462363b933 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:27:50.602508 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e24deab-12ba-4243-ac6d-11462363b933 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:27:50.657227 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809728f2-6a07-42d2-895f-609ac5502958 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:27:50.658104 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809728f2-6a07-42d2-895f-609ac5502958 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:27:50.658386 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809728f2-6a07-42d2-895f-609ac5502958 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:27:50.658656 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809728f2-6a07-42d2-895f-609ac5502958 admin admin] PATH_INFO: `/v3/projects/750a3124020c49cdbbdb9641d7c9759e` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:27:50.659817 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809728f2-6a07-42d2-895f-609ac5502958 admin admin] RBAC: Authorizing `identity:delete_project(project_id=750a3124020c49cdbbdb9641d7c9759e)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:27:50.661674 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809728f2-6a07-42d2-895f-609ac5502958 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:27:50.703773 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-809728f2-6a07-42d2-895f-609ac5502958 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '750a3124020c49cdbbdb9641d7c9759e', 'request_id': 'req-809728f2-6a07-42d2-895f-609ac5502958'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:27:50.708846 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-809728f2-6a07-42d2-895f-609ac5502958 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '750a3124020c49cdbbdb9641d7c9759e', 'request_id': 'req-809728f2-6a07-42d2-895f-609ac5502958'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:27:50.715039 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-809728f2-6a07-42d2-895f-609ac5502958 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '750a3124020c49cdbbdb9641d7c9759e', 'request_id': 'req-809728f2-6a07-42d2-895f-609ac5502958'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:27:50.727000 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-809728f2-6a07-42d2-895f-609ac5502958 admin admin] The token cache is being invalidate because project 750a3124020c49cdbbdb9641d7c9759e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=85204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 17:27:50.727288 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-809728f2-6a07-42d2-895f-609ac5502958 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:27:50.728053 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-809728f2-6a07-42d2-895f-609ac5502958 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:27:50.729530 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1400/2783] 10.222.0.58 () {58 vars in 1232 bytes} [Tue Oct 12 17:27:50 2021] DELETE /identity/v3/projects/750a3124020c49cdbbdb9641d7c9759e => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 17:27:50.735273 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c976db-3ce8-4ed3-930a-102da38775ca None None] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:27:50.735788 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c976db-3ce8-4ed3-930a-102da38775ca None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:27:50.735894 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c976db-3ce8-4ed3-930a-102da38775ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:27:50.753237 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.auth.core [None req-d8c976db-3ce8-4ed3-930a-102da38775ca None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 17:27:50.754497 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-d8c976db-3ce8-4ed3-930a-102da38775ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:27:50.812522 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1384/2784] 10.222.0.58 () {58 vars in 957 bytes} [Tue Oct 12 17:27:50 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 17:27:50.820932 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9e220f-02d1-4f83-b9a2-3650b365593f None None] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:27:50.821220 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9e220f-02d1-4f83-b9a2-3650b365593f None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:27:50.821493 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9e220f-02d1-4f83-b9a2-3650b365593f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:27:50.839138 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.auth.core [None req-0d9e220f-02d1-4f83-b9a2-3650b365593f None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 17:27:50.840247 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-0d9e220f-02d1-4f83-b9a2-3650b365593f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:27:50.847872 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1401/2785] 10.222.0.58 () {58 vars in 957 bytes} [Tue Oct 12 17:27:50 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 17:27:50.851792 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c976db-3ce8-4ed3-930a-102da38775ca None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:27:50.861221 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c976db-3ce8-4ed3-930a-102da38775ca None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:27:50.865784 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cf5ff0-0c0d-419b-8ace-972819374a98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:27:50.866963 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cf5ff0-0c0d-419b-8ace-972819374a98 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:27:50.867250 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cf5ff0-0c0d-419b-8ace-972819374a98 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:27:50.867527 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cf5ff0-0c0d-419b-8ace-972819374a98 admin admin] PATH_INFO: `/v3/domains` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:27:50.868258 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cf5ff0-0c0d-419b-8ace-972819374a98 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 17:27:50.868568 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cf5ff0-0c0d-419b-8ace-972819374a98 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:27:50.870168 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cf5ff0-0c0d-419b-8ace-972819374a98 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:27:50.881133 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1385/2786] 10.222.0.58 () {58 vars in 1152 bytes} [Tue Oct 12 17:27:50 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 17:27:50.886138 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9e220f-02d1-4f83-b9a2-3650b365593f None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:27:50.894903 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9e220f-02d1-4f83-b9a2-3650b365593f None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:27:50.899536 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcfdbd1-8db0-4387-86d1-429888ce7f28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:27:50.900168 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcfdbd1-8db0-4387-86d1-429888ce7f28 admin admin] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:27:50.900451 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcfdbd1-8db0-4387-86d1-429888ce7f28 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:27:50.900724 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcfdbd1-8db0-4387-86d1-429888ce7f28 admin admin] PATH_INFO: `/v3/projects` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:27:50.901423 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcfdbd1-8db0-4387-86d1-429888ce7f28 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:27:50.903307 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcfdbd1-8db0-4387-86d1-429888ce7f28 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:27:50.927150 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1402/2787] 10.222.0.58 () {60 vars in 1152 bytes} [Tue Oct 12 17:27:50 2021] POST /identity/v3/projects => generated 383 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 17:27:50.931699 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cf5ff0-0c0d-419b-8ace-972819374a98 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:27:50.941187 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cf5ff0-0c0d-419b-8ace-972819374a98 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:27:50.994120 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05473a4-6291-40ab-a0fa-579dce1e8ed2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:27:50.994773 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05473a4-6291-40ab-a0fa-579dce1e8ed2 admin admin] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:27:50.995058 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05473a4-6291-40ab-a0fa-579dce1e8ed2 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:27:50.995338 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05473a4-6291-40ab-a0fa-579dce1e8ed2 admin admin] PATH_INFO: `/v3/users` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:27:50.996040 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05473a4-6291-40ab-a0fa-579dce1e8ed2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:27:50.997929 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05473a4-6291-40ab-a0fa-579dce1e8ed2 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:27:51.016725 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1386/2788] 10.222.0.58 () {60 vars in 1143 bytes} [Tue Oct 12 17:27:50 2021] POST /identity/v3/users => generated 292 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 17:27:51.020715 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcfdbd1-8db0-4387-86d1-429888ce7f28 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:27:51.030946 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcfdbd1-8db0-4387-86d1-429888ce7f28 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:27:51.035812 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3c9df1-9f25-4702-9c16-03980a9dfc6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:27:51.036463 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3c9df1-9f25-4702-9c16-03980a9dfc6b admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:27:51.036745 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3c9df1-9f25-4702-9c16-03980a9dfc6b admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:27:51.037047 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3c9df1-9f25-4702-9c16-03980a9dfc6b admin admin] PATH_INFO: `/v3/roles` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:27:51.037784 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3c9df1-9f25-4702-9c16-03980a9dfc6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:27:51.040002 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3c9df1-9f25-4702-9c16-03980a9dfc6b admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:27:51.050089 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1403/2789] 10.222.0.58 () {58 vars in 1121 bytes} [Tue Oct 12 17:27:51 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 17:27:51.053694 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05473a4-6291-40ab-a0fa-579dce1e8ed2 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:27:51.063810 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05473a4-6291-40ab-a0fa-579dce1e8ed2 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:27:51.068419 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4f2d1a-8389-42c3-91d6-3e5b6c3a2ea8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:27:51.069061 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4f2d1a-8389-42c3-91d6-3e5b6c3a2ea8 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:27:51.069376 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4f2d1a-8389-42c3-91d6-3e5b6c3a2ea8 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:27:51.069661 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4f2d1a-8389-42c3-91d6-3e5b6c3a2ea8 admin admin] PATH_INFO: `/v3/roles` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:27:51.070438 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4f2d1a-8389-42c3-91d6-3e5b6c3a2ea8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:27:51.072027 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4f2d1a-8389-42c3-91d6-3e5b6c3a2ea8 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:27:51.081505 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1387/2790] 10.222.0.58 () {58 vars in 1121 bytes} [Tue Oct 12 17:27:51 2021] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 17:27:51.085287 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3c9df1-9f25-4702-9c16-03980a9dfc6b admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:27:51.094959 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3c9df1-9f25-4702-9c16-03980a9dfc6b admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:27:51.099425 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ba973a-f9ec-4620-b293-6e2545365d71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:27:51.100273 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ba973a-f9ec-4620-b293-6e2545365d71 admin admin] REQUEST_METHOD: `PUT` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:27:51.100551 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ba973a-f9ec-4620-b293-6e2545365d71 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:27:51.101345 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ba973a-f9ec-4620-b293-6e2545365d71 admin admin] PATH_INFO: `/v3/projects/9c96da66bbdf485197e769620a0781d5/users/9c6fc4bbbe064d96be4370c22ff67f9f/roles/55ba49fe29884e64b57c3ad13188d554` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:27:51.115275 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ba973a-f9ec-4620-b293-6e2545365d71 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c96da66bbdf485197e769620a0781d5, user_id=9c6fc4bbbe064d96be4370c22ff67f9f, role_id=55ba49fe29884e64b57c3ad13188d554)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:27:51.118024 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ba973a-f9ec-4620-b293-6e2545365d71 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:27:51.130263 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1404/2791] 10.222.0.58 () {60 vars in 1482 bytes} [Tue Oct 12 17:27:51 2021] PUT /identity/v3/projects/9c96da66bbdf485197e769620a0781d5/users/9c6fc4bbbe064d96be4370c22ff67f9f/roles/55ba49fe29884e64b57c3ad13188d554 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 17:27:51.142104 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082961bc-b58c-4fd4-bde0-a608c668163f None None] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:27:51.142398 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082961bc-b58c-4fd4-bde0-a608c668163f None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:27:51.142674 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082961bc-b58c-4fd4-bde0-a608c668163f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:27:51.168322 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.auth.core [None req-082961bc-b58c-4fd4-bde0-a608c668163f None None] MFA Rules not processed for user `9c6fc4bbbe064d96be4370c22ff67f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=85205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 17:27:51.169518 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-082961bc-b58c-4fd4-bde0-a608c668163f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:27:51.230458 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1388/2792] 10.222.0.58 () {58 vars in 957 bytes} [Tue Oct 12 17:27:51 2021] POST /identity/v3/auth/tokens => generated 3403 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 17:27:51.240574 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ba973a-f9ec-4620-b293-6e2545365d71 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:27:51.242284 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-73ba973a-f9ec-4620-b293-6e2545365d71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:27:51.296632 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ba973a-f9ec-4620-b293-6e2545365d71 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:27:51.300300 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f8e1ee-85a0-484c-bf82-e148f96884b5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04704222b3d64a33a6c092fc641ccbb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:27:51.300934 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f8e1ee-85a0-484c-bf82-e148f96884b5 service cinder] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:27:51.301217 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f8e1ee-85a0-484c-bf82-e148f96884b5 service cinder] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:27:51.301492 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f8e1ee-85a0-484c-bf82-e148f96884b5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:27:51.309538 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f8e1ee-85a0-484c-bf82-e148f96884b5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:27:51.310977 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f8e1ee-85a0-484c-bf82-e148f96884b5 service cinder] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:27:51.319984 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1405/2793] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Oct 12 17:27:51 2021] GET /identity/v3/auth/tokens => generated 3403 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 17:27:51.338346 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082961bc-b58c-4fd4-bde0-a608c668163f None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:27:51.396607 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082961bc-b58c-4fd4-bde0-a608c668163f None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:27:51.401602 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0032a0-4869-4f42-a8ca-e79e1eb773a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:27:51.402492 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0032a0-4869-4f42-a8ca-e79e1eb773a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:27:51.402776 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0032a0-4869-4f42-a8ca-e79e1eb773a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:27:51.403054 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0032a0-4869-4f42-a8ca-e79e1eb773a6 admin admin] PATH_INFO: `/v3/users/9c6fc4bbbe064d96be4370c22ff67f9f` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:27:51.404268 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0032a0-4869-4f42-a8ca-e79e1eb773a6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c6fc4bbbe064d96be4370c22ff67f9f)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:27:51.406181 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0032a0-4869-4f42-a8ca-e79e1eb773a6 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:27:51.451627 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-3e0032a0-4869-4f42-a8ca-e79e1eb773a6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c6fc4bbbe064d96be4370c22ff67f9f'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:27:51.463572 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-3e0032a0-4869-4f42-a8ca-e79e1eb773a6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c6fc4bbbe064d96be4370c22ff67f9f'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:27:51.469974 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-3e0032a0-4869-4f42-a8ca-e79e1eb773a6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c6fc4bbbe064d96be4370c22ff67f9f'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:27:51.477068 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-3e0032a0-4869-4f42-a8ca-e79e1eb773a6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c6fc4bbbe064d96be4370c22ff67f9f'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:27:51.477704 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-3e0032a0-4869-4f42-a8ca-e79e1eb773a6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c6fc4bbbe064d96be4370c22ff67f9f'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:27:51.483345 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1389/2794] 10.222.0.58 () {58 vars in 1223 bytes} [Tue Oct 12 17:27:51 2021] DELETE /identity/v3/users/9c6fc4bbbe064d96be4370c22ff67f9f => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 17:27:51.487944 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baad927d-15e9-4781-887f-65f0372f4663 None None] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:27:51.488239 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baad927d-15e9-4781-887f-65f0372f4663 None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:27:51.488523 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baad927d-15e9-4781-887f-65f0372f4663 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:27:51.505926 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.auth.core [None req-baad927d-15e9-4781-887f-65f0372f4663 None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 17:27:51.507708 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-baad927d-15e9-4781-887f-65f0372f4663 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:27:51.564655 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1406/2795] 10.222.0.58 () {58 vars in 957 bytes} [Tue Oct 12 17:27:51 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 17:27:51.575039 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0032a0-4869-4f42-a8ca-e79e1eb773a6 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:27:51.576432 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-3e0032a0-4869-4f42-a8ca-e79e1eb773a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:27:51.630084 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0032a0-4869-4f42-a8ca-e79e1eb773a6 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:27:51.634344 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5edc4e-ca0e-428f-9a6b-968b0a842ac8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e65f6d0598e4c539134292b86fb43d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:27:51.634991 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5edc4e-ca0e-428f-9a6b-968b0a842ac8 service neutron] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:27:51.635525 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5edc4e-ca0e-428f-9a6b-968b0a842ac8 service neutron] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:27:51.635818 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5edc4e-ca0e-428f-9a6b-968b0a842ac8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:27:51.644541 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5edc4e-ca0e-428f-9a6b-968b0a842ac8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:27:51.646018 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5edc4e-ca0e-428f-9a6b-968b0a842ac8 service neutron] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:27:51.655754 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1390/2796] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Oct 12 17:27:51 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 17:27:51.917191 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baad927d-15e9-4781-887f-65f0372f4663 None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:27:51.918661 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-baad927d-15e9-4781-887f-65f0372f4663 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:27:51.934012 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baad927d-15e9-4781-887f-65f0372f4663 None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:27:51.938941 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9336abfa-6580-4302-a693-622b45a5c75a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:27:51.940137 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9336abfa-6580-4302-a693-622b45a5c75a admin admin] REQUEST_METHOD: `DELETE` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:27:51.940420 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9336abfa-6580-4302-a693-622b45a5c75a admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:27:51.940690 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9336abfa-6580-4302-a693-622b45a5c75a admin admin] PATH_INFO: `/v3/projects/9c96da66bbdf485197e769620a0781d5` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:27:51.941923 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9336abfa-6580-4302-a693-622b45a5c75a admin admin] RBAC: Authorizing `identity:delete_project(project_id=9c96da66bbdf485197e769620a0781d5)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:27:51.943775 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9336abfa-6580-4302-a693-622b45a5c75a admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:27:51.988091 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-9336abfa-6580-4302-a693-622b45a5c75a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c96da66bbdf485197e769620a0781d5', 'request_id': 'req-9336abfa-6580-4302-a693-622b45a5c75a'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:27:51.993261 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-9336abfa-6580-4302-a693-622b45a5c75a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c96da66bbdf485197e769620a0781d5', 'request_id': 'req-9336abfa-6580-4302-a693-622b45a5c75a'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:27:51.999078 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-9336abfa-6580-4302-a693-622b45a5c75a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c96da66bbdf485197e769620a0781d5', 'request_id': 'req-9336abfa-6580-4302-a693-622b45a5c75a'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:27:52.011250 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-9336abfa-6580-4302-a693-622b45a5c75a admin admin] The token cache is being invalidate because project 9c96da66bbdf485197e769620a0781d5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=85204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 17:27:52.011538 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-9336abfa-6580-4302-a693-622b45a5c75a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:27:52.012141 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-9336abfa-6580-4302-a693-622b45a5c75a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:27:52.013775 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1407/2797] 10.222.0.58 () {58 vars in 1232 bytes} [Tue Oct 12 17:27:51 2021] DELETE /identity/v3/projects/9c96da66bbdf485197e769620a0781d5 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 17:27:52.019576 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e7794d-7744-4182-80c5-3f86f071eb28 None None] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:27:52.020035 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e7794d-7744-4182-80c5-3f86f071eb28 None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:27:52.020147 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e7794d-7744-4182-80c5-3f86f071eb28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:27:52.037980 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.auth.core [None req-a3e7794d-7744-4182-80c5-3f86f071eb28 None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 17:27:52.039187 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-a3e7794d-7744-4182-80c5-3f86f071eb28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:27:52.094573 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1391/2798] 10.222.0.58 () {58 vars in 957 bytes} [Tue Oct 12 17:27:52 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 17:27:52.102297 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f85f460-19de-414f-a169-a3d7a38c3acd None None] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:27:52.102583 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f85f460-19de-414f-a169-a3d7a38c3acd None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:27:52.102852 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f85f460-19de-414f-a169-a3d7a38c3acd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:27:52.121102 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.auth.core [None req-2f85f460-19de-414f-a169-a3d7a38c3acd None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 17:27:52.122353 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-2f85f460-19de-414f-a169-a3d7a38c3acd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:27:52.131085 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1408/2799] 10.222.0.58 () {58 vars in 957 bytes} [Tue Oct 12 17:27:52 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 17:27:52.136027 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e7794d-7744-4182-80c5-3f86f071eb28 None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:27:52.145493 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e7794d-7744-4182-80c5-3f86f071eb28 None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:27:52.150142 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1499e15c-e1f3-47c8-8c01-2532a6957abe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:27:52.150793 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1499e15c-e1f3-47c8-8c01-2532a6957abe admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:27:52.151081 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1499e15c-e1f3-47c8-8c01-2532a6957abe admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:27:52.151361 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1499e15c-e1f3-47c8-8c01-2532a6957abe admin admin] PATH_INFO: `/v3/domains` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:27:52.152093 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1499e15c-e1f3-47c8-8c01-2532a6957abe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 17:27:52.152428 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1499e15c-e1f3-47c8-8c01-2532a6957abe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:27:52.154036 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1499e15c-e1f3-47c8-8c01-2532a6957abe admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:27:52.165324 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1392/2800] 10.222.0.58 () {58 vars in 1152 bytes} [Tue Oct 12 17:27:52 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 17:27:52.169230 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f85f460-19de-414f-a169-a3d7a38c3acd None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:27:52.178144 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f85f460-19de-414f-a169-a3d7a38c3acd None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:27:52.183246 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00e6f33-7302-414b-a7b1-7d87daadd657 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:27:52.183876 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00e6f33-7302-414b-a7b1-7d87daadd657 admin admin] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:27:52.184161 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00e6f33-7302-414b-a7b1-7d87daadd657 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:27:52.184431 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00e6f33-7302-414b-a7b1-7d87daadd657 admin admin] PATH_INFO: `/v3/projects` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:27:52.185130 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00e6f33-7302-414b-a7b1-7d87daadd657 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:27:52.187014 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00e6f33-7302-414b-a7b1-7d87daadd657 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:27:52.211838 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1409/2801] 10.222.0.58 () {60 vars in 1152 bytes} [Tue Oct 12 17:27:52 2021] POST /identity/v3/projects => generated 385 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 17:27:52.215715 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1499e15c-e1f3-47c8-8c01-2532a6957abe admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:27:52.225452 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1499e15c-e1f3-47c8-8c01-2532a6957abe admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:27:52.279445 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382cc018-7a41-4190-8bc8-98dbd2746b9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:27:52.280093 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382cc018-7a41-4190-8bc8-98dbd2746b9d admin admin] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:27:52.280375 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382cc018-7a41-4190-8bc8-98dbd2746b9d admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:27:52.280650 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382cc018-7a41-4190-8bc8-98dbd2746b9d admin admin] PATH_INFO: `/v3/users` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:27:52.281356 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382cc018-7a41-4190-8bc8-98dbd2746b9d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:27:52.283280 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382cc018-7a41-4190-8bc8-98dbd2746b9d admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:27:52.302791 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1393/2802] 10.222.0.58 () {60 vars in 1143 bytes} [Tue Oct 12 17:27:52 2021] POST /identity/v3/users => generated 293 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 17:27:52.307462 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00e6f33-7302-414b-a7b1-7d87daadd657 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:27:52.317399 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00e6f33-7302-414b-a7b1-7d87daadd657 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:27:52.322765 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bae8f4-6074-459d-9972-13584cd80471 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:27:52.323643 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bae8f4-6074-459d-9972-13584cd80471 admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:27:52.323922 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bae8f4-6074-459d-9972-13584cd80471 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:27:52.324193 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bae8f4-6074-459d-9972-13584cd80471 admin admin] PATH_INFO: `/v3/roles` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:27:52.324927 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bae8f4-6074-459d-9972-13584cd80471 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:27:52.326533 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bae8f4-6074-459d-9972-13584cd80471 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:27:52.337068 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1410/2803] 10.222.0.58 () {58 vars in 1121 bytes} [Tue Oct 12 17:27:52 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 17:27:52.340754 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382cc018-7a41-4190-8bc8-98dbd2746b9d admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:27:52.350494 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382cc018-7a41-4190-8bc8-98dbd2746b9d admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:27:52.355180 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382e5378-b346-4839-8cb5-a007ed261d84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:27:52.355827 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382e5378-b346-4839-8cb5-a007ed261d84 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:27:52.356117 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382e5378-b346-4839-8cb5-a007ed261d84 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:27:52.356398 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382e5378-b346-4839-8cb5-a007ed261d84 admin admin] PATH_INFO: `/v3/roles` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:27:52.357159 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382e5378-b346-4839-8cb5-a007ed261d84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:27:52.358748 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382e5378-b346-4839-8cb5-a007ed261d84 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:27:52.368872 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1394/2804] 10.222.0.58 () {58 vars in 1121 bytes} [Tue Oct 12 17:27:52 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 17:27:52.372639 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bae8f4-6074-459d-9972-13584cd80471 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:27:52.382759 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bae8f4-6074-459d-9972-13584cd80471 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:27:52.387634 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe30540-859d-4d3f-8fb8-054ba341df6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:27:52.388490 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe30540-859d-4d3f-8fb8-054ba341df6f admin admin] REQUEST_METHOD: `PUT` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:27:52.388769 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe30540-859d-4d3f-8fb8-054ba341df6f admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:27:52.389042 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe30540-859d-4d3f-8fb8-054ba341df6f admin admin] PATH_INFO: `/v3/projects/d1899d86c952451687a2ab7046d062ec/users/3e86858c237d4bce8ad497a6e3c18525/roles/55ba49fe29884e64b57c3ad13188d554` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:27:52.405059 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe30540-859d-4d3f-8fb8-054ba341df6f admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1899d86c952451687a2ab7046d062ec, user_id=3e86858c237d4bce8ad497a6e3c18525, role_id=55ba49fe29884e64b57c3ad13188d554)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:27:52.407686 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe30540-859d-4d3f-8fb8-054ba341df6f admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:27:52.420306 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1411/2805] 10.222.0.58 () {60 vars in 1482 bytes} [Tue Oct 12 17:27:52 2021] PUT /identity/v3/projects/d1899d86c952451687a2ab7046d062ec/users/3e86858c237d4bce8ad497a6e3c18525/roles/55ba49fe29884e64b57c3ad13188d554 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 17:27:52.430777 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150325b0-45bb-4bd0-b75c-81c653dafe2a None None] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:27:52.431074 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150325b0-45bb-4bd0-b75c-81c653dafe2a None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:27:52.431354 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150325b0-45bb-4bd0-b75c-81c653dafe2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:27:52.457346 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.auth.core [None req-150325b0-45bb-4bd0-b75c-81c653dafe2a None None] MFA Rules not processed for user `3e86858c237d4bce8ad497a6e3c18525`. Rule list: `[]` (Enabled: `True`). {{(pid=85205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 17:27:52.458583 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-150325b0-45bb-4bd0-b75c-81c653dafe2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:27:52.527937 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1395/2806] 10.222.0.58 () {58 vars in 957 bytes} [Tue Oct 12 17:27:52 2021] POST /identity/v3/auth/tokens => generated 3405 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 17:27:52.540241 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe30540-859d-4d3f-8fb8-054ba341df6f admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:27:52.542347 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-dbe30540-859d-4d3f-8fb8-054ba341df6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:27:52.599715 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe30540-859d-4d3f-8fb8-054ba341df6f admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:27:52.603388 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026c3ead-5cdf-4e3d-8ff0-c6a4533eb27a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04704222b3d64a33a6c092fc641ccbb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:27:52.604024 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026c3ead-5cdf-4e3d-8ff0-c6a4533eb27a service cinder] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:27:52.604309 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026c3ead-5cdf-4e3d-8ff0-c6a4533eb27a service cinder] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:27:52.604589 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026c3ead-5cdf-4e3d-8ff0-c6a4533eb27a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:27:52.612614 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026c3ead-5cdf-4e3d-8ff0-c6a4533eb27a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:27:52.614063 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026c3ead-5cdf-4e3d-8ff0-c6a4533eb27a service cinder] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:27:52.622557 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1412/2807] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Oct 12 17:27:52 2021] GET /identity/v3/auth/tokens => generated 3405 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 17:28:00.904097 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150325b0-45bb-4bd0-b75c-81c653dafe2a None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:28:00.962005 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150325b0-45bb-4bd0-b75c-81c653dafe2a None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:28:00.966486 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a47a10e-b0a1-4cda-a919-c38c012dc770 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:28:00.967342 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a47a10e-b0a1-4cda-a919-c38c012dc770 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:28:00.967655 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a47a10e-b0a1-4cda-a919-c38c012dc770 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:28:00.967931 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a47a10e-b0a1-4cda-a919-c38c012dc770 admin admin] PATH_INFO: `/v3/users/3e86858c237d4bce8ad497a6e3c18525` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:28:00.969117 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a47a10e-b0a1-4cda-a919-c38c012dc770 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e86858c237d4bce8ad497a6e3c18525)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:28:00.971025 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a47a10e-b0a1-4cda-a919-c38c012dc770 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:28:01.014234 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-2a47a10e-b0a1-4cda-a919-c38c012dc770 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e86858c237d4bce8ad497a6e3c18525'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:28:01.025270 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-2a47a10e-b0a1-4cda-a919-c38c012dc770 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e86858c237d4bce8ad497a6e3c18525'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:28:01.032314 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-2a47a10e-b0a1-4cda-a919-c38c012dc770 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e86858c237d4bce8ad497a6e3c18525'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:28:01.039879 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-2a47a10e-b0a1-4cda-a919-c38c012dc770 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e86858c237d4bce8ad497a6e3c18525'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:28:01.040503 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-2a47a10e-b0a1-4cda-a919-c38c012dc770 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e86858c237d4bce8ad497a6e3c18525'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:28:01.046143 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1396/2808] 10.222.0.58 () {58 vars in 1223 bytes} [Tue Oct 12 17:28:00 2021] DELETE /identity/v3/users/3e86858c237d4bce8ad497a6e3c18525 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 17:28:01.050736 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8710038b-ec16-4785-971d-6f48465d3ae0 None None] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:28:01.051240 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8710038b-ec16-4785-971d-6f48465d3ae0 None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:28:01.051344 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8710038b-ec16-4785-971d-6f48465d3ae0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:28:01.068269 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.auth.core [None req-8710038b-ec16-4785-971d-6f48465d3ae0 None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 17:28:01.069415 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-8710038b-ec16-4785-971d-6f48465d3ae0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:28:01.125482 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1413/2809] 10.222.0.58 () {58 vars in 957 bytes} [Tue Oct 12 17:28:01 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 17:28:01.135180 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a47a10e-b0a1-4cda-a919-c38c012dc770 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:28:01.136836 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-2a47a10e-b0a1-4cda-a919-c38c012dc770 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:28:01.192759 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a47a10e-b0a1-4cda-a919-c38c012dc770 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:28:01.196538 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f61bf80-3cbb-4790-9a00-26b34416bcbf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e65f6d0598e4c539134292b86fb43d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:28:01.197187 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f61bf80-3cbb-4790-9a00-26b34416bcbf service neutron] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:28:01.197473 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f61bf80-3cbb-4790-9a00-26b34416bcbf service neutron] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:28:01.197835 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f61bf80-3cbb-4790-9a00-26b34416bcbf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:28:01.206968 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f61bf80-3cbb-4790-9a00-26b34416bcbf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:28:01.208369 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f61bf80-3cbb-4790-9a00-26b34416bcbf service neutron] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:28:01.219078 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1397/2810] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Oct 12 17:28:01 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 17:28:01.472644 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8710038b-ec16-4785-971d-6f48465d3ae0 None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:28:01.474084 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-8710038b-ec16-4785-971d-6f48465d3ae0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:28:01.486113 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8710038b-ec16-4785-971d-6f48465d3ae0 None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:28:01.490689 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9da6006-435c-46fb-beaf-765fc45b5ac9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:28:01.492095 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9da6006-435c-46fb-beaf-765fc45b5ac9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:28:01.492375 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9da6006-435c-46fb-beaf-765fc45b5ac9 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:28:01.492652 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9da6006-435c-46fb-beaf-765fc45b5ac9 admin admin] PATH_INFO: `/v3/projects/d1899d86c952451687a2ab7046d062ec` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:28:01.493831 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9da6006-435c-46fb-beaf-765fc45b5ac9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d1899d86c952451687a2ab7046d062ec)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:28:01.495740 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9da6006-435c-46fb-beaf-765fc45b5ac9 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:28:01.542610 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-d9da6006-435c-46fb-beaf-765fc45b5ac9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd1899d86c952451687a2ab7046d062ec', 'request_id': 'req-d9da6006-435c-46fb-beaf-765fc45b5ac9'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:28:01.547908 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-d9da6006-435c-46fb-beaf-765fc45b5ac9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd1899d86c952451687a2ab7046d062ec', 'request_id': 'req-d9da6006-435c-46fb-beaf-765fc45b5ac9'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:28:01.553850 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-d9da6006-435c-46fb-beaf-765fc45b5ac9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd1899d86c952451687a2ab7046d062ec', 'request_id': 'req-d9da6006-435c-46fb-beaf-765fc45b5ac9'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:28:01.565356 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-d9da6006-435c-46fb-beaf-765fc45b5ac9 admin admin] The token cache is being invalidate because project d1899d86c952451687a2ab7046d062ec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=85204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 17:28:01.565638 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-d9da6006-435c-46fb-beaf-765fc45b5ac9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:28:01.566373 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-d9da6006-435c-46fb-beaf-765fc45b5ac9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:28:01.567889 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1414/2811] 10.222.0.58 () {58 vars in 1232 bytes} [Tue Oct 12 17:28:01 2021] DELETE /identity/v3/projects/d1899d86c952451687a2ab7046d062ec => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 17:28:01.574109 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ac6e15-bc0b-4e74-b1b1-01bf9a188e4f None None] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:28:01.574397 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ac6e15-bc0b-4e74-b1b1-01bf9a188e4f None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:28:01.574670 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ac6e15-bc0b-4e74-b1b1-01bf9a188e4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:28:01.592555 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.auth.core [None req-30ac6e15-bc0b-4e74-b1b1-01bf9a188e4f None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 17:28:01.593753 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-30ac6e15-bc0b-4e74-b1b1-01bf9a188e4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:28:01.649355 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1398/2812] 10.222.0.58 () {58 vars in 957 bytes} [Tue Oct 12 17:28:01 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 17:28:01.658220 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b71474-f09d-4f47-aadc-38aa2b301037 None None] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:28:01.658510 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b71474-f09d-4f47-aadc-38aa2b301037 None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:28:01.658792 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b71474-f09d-4f47-aadc-38aa2b301037 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:28:01.676500 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.auth.core [None req-98b71474-f09d-4f47-aadc-38aa2b301037 None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 17:28:01.677678 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-98b71474-f09d-4f47-aadc-38aa2b301037 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:28:01.685474 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1415/2813] 10.222.0.58 () {58 vars in 957 bytes} [Tue Oct 12 17:28:01 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 17:28:01.689441 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ac6e15-bc0b-4e74-b1b1-01bf9a188e4f None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:28:01.699319 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ac6e15-bc0b-4e74-b1b1-01bf9a188e4f None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:28:01.703916 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bfc1d6-98f6-4824-8ee9-cf7216019a32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:28:01.704585 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bfc1d6-98f6-4824-8ee9-cf7216019a32 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:28:01.704869 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bfc1d6-98f6-4824-8ee9-cf7216019a32 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:28:01.705145 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bfc1d6-98f6-4824-8ee9-cf7216019a32 admin admin] PATH_INFO: `/v3/domains` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:28:01.705895 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bfc1d6-98f6-4824-8ee9-cf7216019a32 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 17:28:01.706222 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bfc1d6-98f6-4824-8ee9-cf7216019a32 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:28:01.707801 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bfc1d6-98f6-4824-8ee9-cf7216019a32 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:28:01.719370 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1399/2814] 10.222.0.58 () {58 vars in 1152 bytes} [Tue Oct 12 17:28:01 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 17:28:01.723356 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b71474-f09d-4f47-aadc-38aa2b301037 None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:28:01.732182 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b71474-f09d-4f47-aadc-38aa2b301037 None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:28:01.736807 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803d946b-c1d0-4fdb-8983-ddcedfae4c78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:28:01.737445 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803d946b-c1d0-4fdb-8983-ddcedfae4c78 admin admin] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:28:01.737726 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803d946b-c1d0-4fdb-8983-ddcedfae4c78 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:28:01.738041 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803d946b-c1d0-4fdb-8983-ddcedfae4c78 admin admin] PATH_INFO: `/v3/projects` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:28:01.738736 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803d946b-c1d0-4fdb-8983-ddcedfae4c78 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:28:01.740598 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803d946b-c1d0-4fdb-8983-ddcedfae4c78 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:28:01.765369 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1416/2815] 10.222.0.58 () {60 vars in 1152 bytes} [Tue Oct 12 17:28:01 2021] POST /identity/v3/projects => generated 367 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 17:28:01.808264 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bfc1d6-98f6-4824-8ee9-cf7216019a32 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:28:01.820748 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bfc1d6-98f6-4824-8ee9-cf7216019a32 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:28:01.874881 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b790b399-ae97-4ae6-9dda-a8696ef705c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:28:01.875748 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b790b399-ae97-4ae6-9dda-a8696ef705c1 admin admin] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:28:01.876126 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b790b399-ae97-4ae6-9dda-a8696ef705c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:28:01.876562 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b790b399-ae97-4ae6-9dda-a8696ef705c1 admin admin] PATH_INFO: `/v3/users` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:28:01.877344 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b790b399-ae97-4ae6-9dda-a8696ef705c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:28:01.879610 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b790b399-ae97-4ae6-9dda-a8696ef705c1 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:28:01.900382 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1400/2816] 10.222.0.58 () {60 vars in 1143 bytes} [Tue Oct 12 17:28:01 2021] POST /identity/v3/users => generated 284 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 17:28:01.904485 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803d946b-c1d0-4fdb-8983-ddcedfae4c78 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:28:01.914463 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803d946b-c1d0-4fdb-8983-ddcedfae4c78 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:28:01.919022 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10404252-28c0-40bc-a9af-6d799adad5af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:28:01.919672 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10404252-28c0-40bc-a9af-6d799adad5af admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:28:01.919955 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10404252-28c0-40bc-a9af-6d799adad5af admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:28:01.920255 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10404252-28c0-40bc-a9af-6d799adad5af admin admin] PATH_INFO: `/v3/roles` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:28:01.920991 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10404252-28c0-40bc-a9af-6d799adad5af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:28:01.922607 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10404252-28c0-40bc-a9af-6d799adad5af admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:28:01.933083 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1417/2817] 10.222.0.58 () {58 vars in 1121 bytes} [Tue Oct 12 17:28:01 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 17:28:01.936828 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b790b399-ae97-4ae6-9dda-a8696ef705c1 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:28:01.947374 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b790b399-ae97-4ae6-9dda-a8696ef705c1 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:28:01.952184 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1959a8fb-50b8-431d-9dfc-4c7dadd9b3f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:28:01.952823 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1959a8fb-50b8-431d-9dfc-4c7dadd9b3f6 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:28:01.953105 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1959a8fb-50b8-431d-9dfc-4c7dadd9b3f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:28:01.953378 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1959a8fb-50b8-431d-9dfc-4c7dadd9b3f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:28:01.954135 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1959a8fb-50b8-431d-9dfc-4c7dadd9b3f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:28:01.955680 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1959a8fb-50b8-431d-9dfc-4c7dadd9b3f6 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:28:01.965628 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1401/2818] 10.222.0.58 () {58 vars in 1121 bytes} [Tue Oct 12 17:28:01 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 17:28:01.969586 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10404252-28c0-40bc-a9af-6d799adad5af admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:28:01.979242 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10404252-28c0-40bc-a9af-6d799adad5af admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:28:01.983844 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e05ca5-5c2e-46a7-813e-a70723fabfa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:28:01.984706 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e05ca5-5c2e-46a7-813e-a70723fabfa1 admin admin] REQUEST_METHOD: `PUT` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:28:01.984989 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e05ca5-5c2e-46a7-813e-a70723fabfa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:28:01.985264 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e05ca5-5c2e-46a7-813e-a70723fabfa1 admin admin] PATH_INFO: `/v3/projects/88f2df4b65664776b1d44c9921bd4969/users/340c27732fed4ce68601a0ec92db03a5/roles/55ba49fe29884e64b57c3ad13188d554` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:28:01.999545 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e05ca5-5c2e-46a7-813e-a70723fabfa1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=88f2df4b65664776b1d44c9921bd4969, user_id=340c27732fed4ce68601a0ec92db03a5, role_id=55ba49fe29884e64b57c3ad13188d554)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:28:02.002158 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e05ca5-5c2e-46a7-813e-a70723fabfa1 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:28:02.015066 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1418/2819] 10.222.0.58 () {60 vars in 1482 bytes} [Tue Oct 12 17:28:01 2021] PUT /identity/v3/projects/88f2df4b65664776b1d44c9921bd4969/users/340c27732fed4ce68601a0ec92db03a5/roles/55ba49fe29884e64b57c3ad13188d554 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 17:28:02.025342 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d57529-08c7-431c-b94c-b4b0c71c6b02 None None] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:28:02.025655 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d57529-08c7-431c-b94c-b4b0c71c6b02 None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:28:02.025960 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d57529-08c7-431c-b94c-b4b0c71c6b02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:28:02.052236 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.auth.core [None req-51d57529-08c7-431c-b94c-b4b0c71c6b02 None None] MFA Rules not processed for user `340c27732fed4ce68601a0ec92db03a5`. Rule list: `[]` (Enabled: `True`). {{(pid=85205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 17:28:02.053490 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-51d57529-08c7-431c-b94c-b4b0c71c6b02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:28:02.113861 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1402/2820] 10.222.0.58 () {58 vars in 957 bytes} [Tue Oct 12 17:28:02 2021] POST /identity/v3/auth/tokens => generated 3387 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 17:28:02.126173 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e05ca5-5c2e-46a7-813e-a70723fabfa1 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:28:02.127937 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-b5e05ca5-5c2e-46a7-813e-a70723fabfa1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:28:02.182335 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e05ca5-5c2e-46a7-813e-a70723fabfa1 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:28:02.185986 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88d8d7a-1734-441c-bb71-82cfe955ba36 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ff84015069041f2bf33e3fd55b92e44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:28:02.186616 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88d8d7a-1734-441c-bb71-82cfe955ba36 service glance] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:28:02.186900 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88d8d7a-1734-441c-bb71-82cfe955ba36 service glance] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:28:02.187176 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88d8d7a-1734-441c-bb71-82cfe955ba36 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:28:02.195228 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88d8d7a-1734-441c-bb71-82cfe955ba36 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:28:02.196639 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88d8d7a-1734-441c-bb71-82cfe955ba36 service glance] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:28:02.205138 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1419/2821] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Oct 12 17:28:02 2021] GET /identity/v3/auth/tokens => generated 3387 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 12 17:28:37.579853 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d57529-08c7-431c-b94c-b4b0c71c6b02 None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:28:37.638829 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d57529-08c7-431c-b94c-b4b0c71c6b02 None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:28:37.643509 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400dba0d-f0d9-4e66-9f02-3202fe396aff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:28:37.644381 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400dba0d-f0d9-4e66-9f02-3202fe396aff admin admin] REQUEST_METHOD: `DELETE` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:28:37.644666 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400dba0d-f0d9-4e66-9f02-3202fe396aff admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:28:37.644944 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400dba0d-f0d9-4e66-9f02-3202fe396aff admin admin] PATH_INFO: `/v3/users/340c27732fed4ce68601a0ec92db03a5` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:28:37.646176 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400dba0d-f0d9-4e66-9f02-3202fe396aff admin admin] RBAC: Authorizing `identity:delete_user(user_id=340c27732fed4ce68601a0ec92db03a5)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:28:37.648671 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400dba0d-f0d9-4e66-9f02-3202fe396aff admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:28:37.693742 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-400dba0d-f0d9-4e66-9f02-3202fe396aff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '340c27732fed4ce68601a0ec92db03a5'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:28:37.706103 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-400dba0d-f0d9-4e66-9f02-3202fe396aff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '340c27732fed4ce68601a0ec92db03a5'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:28:37.714544 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-400dba0d-f0d9-4e66-9f02-3202fe396aff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '340c27732fed4ce68601a0ec92db03a5'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:28:37.721318 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-400dba0d-f0d9-4e66-9f02-3202fe396aff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '340c27732fed4ce68601a0ec92db03a5'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:28:37.722003 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-400dba0d-f0d9-4e66-9f02-3202fe396aff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '340c27732fed4ce68601a0ec92db03a5'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:28:37.727832 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1403/2822] 10.222.0.58 () {58 vars in 1223 bytes} [Tue Oct 12 17:28:37 2021] DELETE /identity/v3/users/340c27732fed4ce68601a0ec92db03a5 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 17:28:37.732301 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50bb897-fdb8-4f10-bf9a-1a9922f58391 None None] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:28:37.732792 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50bb897-fdb8-4f10-bf9a-1a9922f58391 None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:28:37.732988 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50bb897-fdb8-4f10-bf9a-1a9922f58391 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:28:37.750743 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.auth.core [None req-f50bb897-fdb8-4f10-bf9a-1a9922f58391 None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 17:28:37.751946 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-f50bb897-fdb8-4f10-bf9a-1a9922f58391 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:28:37.811338 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1420/2823] 10.222.0.58 () {58 vars in 957 bytes} [Tue Oct 12 17:28:37 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 17:28:37.824735 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400dba0d-f0d9-4e66-9f02-3202fe396aff admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:28:37.826184 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-400dba0d-f0d9-4e66-9f02-3202fe396aff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:28:37.896144 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400dba0d-f0d9-4e66-9f02-3202fe396aff admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:28:37.899876 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215d1669-d301-40ba-9c88-dd2572bbec9e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e65f6d0598e4c539134292b86fb43d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:28:37.900531 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215d1669-d301-40ba-9c88-dd2572bbec9e service neutron] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:28:37.900813 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215d1669-d301-40ba-9c88-dd2572bbec9e service neutron] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:28:37.901084 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215d1669-d301-40ba-9c88-dd2572bbec9e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:28:37.911243 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215d1669-d301-40ba-9c88-dd2572bbec9e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:28:37.912725 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215d1669-d301-40ba-9c88-dd2572bbec9e service neutron] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:28:37.922754 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1404/2824] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Oct 12 17:28:37 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 17:28:38.457563 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50bb897-fdb8-4f10-bf9a-1a9922f58391 None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:28:38.459551 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-f50bb897-fdb8-4f10-bf9a-1a9922f58391 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:28:38.476166 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50bb897-fdb8-4f10-bf9a-1a9922f58391 None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:28:38.481649 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2431f9a9-d763-440f-86f0-f192c9746509 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:28:38.482564 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2431f9a9-d763-440f-86f0-f192c9746509 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:28:38.482877 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2431f9a9-d763-440f-86f0-f192c9746509 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:28:38.483117 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2431f9a9-d763-440f-86f0-f192c9746509 admin admin] PATH_INFO: `/v3/projects/88f2df4b65664776b1d44c9921bd4969` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:28:38.484343 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2431f9a9-d763-440f-86f0-f192c9746509 admin admin] RBAC: Authorizing `identity:delete_project(project_id=88f2df4b65664776b1d44c9921bd4969)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:28:38.486646 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2431f9a9-d763-440f-86f0-f192c9746509 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:28:38.544634 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-2431f9a9-d763-440f-86f0-f192c9746509 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '88f2df4b65664776b1d44c9921bd4969', 'request_id': 'req-2431f9a9-d763-440f-86f0-f192c9746509'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:28:38.550237 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-2431f9a9-d763-440f-86f0-f192c9746509 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '88f2df4b65664776b1d44c9921bd4969', 'request_id': 'req-2431f9a9-d763-440f-86f0-f192c9746509'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:28:38.556549 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-2431f9a9-d763-440f-86f0-f192c9746509 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '88f2df4b65664776b1d44c9921bd4969', 'request_id': 'req-2431f9a9-d763-440f-86f0-f192c9746509'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:28:38.570229 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-2431f9a9-d763-440f-86f0-f192c9746509 admin admin] The token cache is being invalidate because project 88f2df4b65664776b1d44c9921bd4969 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=85204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 17:28:38.570586 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-2431f9a9-d763-440f-86f0-f192c9746509 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:28:38.571156 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-2431f9a9-d763-440f-86f0-f192c9746509 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:28:38.572689 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1421/2825] 10.222.0.58 () {58 vars in 1232 bytes} [Tue Oct 12 17:28:38 2021] DELETE /identity/v3/projects/88f2df4b65664776b1d44c9921bd4969 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 17:28:38.579278 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46734ee3-eaba-4516-bdc8-e76d78bddb38 None None] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:28:38.579382 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46734ee3-eaba-4516-bdc8-e76d78bddb38 None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:28:38.579837 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46734ee3-eaba-4516-bdc8-e76d78bddb38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:28:38.601143 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.auth.core [None req-46734ee3-eaba-4516-bdc8-e76d78bddb38 None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 17:28:38.602532 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-46734ee3-eaba-4516-bdc8-e76d78bddb38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:28:38.667388 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1405/2826] 10.222.0.58 () {58 vars in 957 bytes} [Tue Oct 12 17:28:38 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 17:28:38.675710 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9f86b0-e691-40fa-b1ff-338a83ad84b7 None None] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:28:38.676026 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9f86b0-e691-40fa-b1ff-338a83ad84b7 None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:28:38.676385 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9f86b0-e691-40fa-b1ff-338a83ad84b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:28:38.699439 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.auth.core [None req-fc9f86b0-e691-40fa-b1ff-338a83ad84b7 None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 17:28:38.700712 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-fc9f86b0-e691-40fa-b1ff-338a83ad84b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:28:38.709035 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1422/2827] 10.222.0.58 () {58 vars in 957 bytes} [Tue Oct 12 17:28:38 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 17:28:38.713409 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46734ee3-eaba-4516-bdc8-e76d78bddb38 None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:28:38.723613 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46734ee3-eaba-4516-bdc8-e76d78bddb38 None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:28:38.728948 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8433c449-2209-4af7-85f5-f7199b4b4780 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:28:38.729683 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8433c449-2209-4af7-85f5-f7199b4b4780 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:28:38.730083 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8433c449-2209-4af7-85f5-f7199b4b4780 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:28:38.730429 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8433c449-2209-4af7-85f5-f7199b4b4780 admin admin] PATH_INFO: `/v3/domains` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:28:38.731232 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8433c449-2209-4af7-85f5-f7199b4b4780 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 17:28:38.731622 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8433c449-2209-4af7-85f5-f7199b4b4780 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:28:38.733259 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8433c449-2209-4af7-85f5-f7199b4b4780 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:28:38.746539 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1406/2828] 10.222.0.58 () {58 vars in 1152 bytes} [Tue Oct 12 17:28:38 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 17:28:38.750960 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9f86b0-e691-40fa-b1ff-338a83ad84b7 None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:28:38.760933 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9f86b0-e691-40fa-b1ff-338a83ad84b7 None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:28:38.766125 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f19ee0-99e7-432e-b701-11b5b397c2fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:28:38.766738 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f19ee0-99e7-432e-b701-11b5b397c2fc admin admin] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:28:38.767022 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f19ee0-99e7-432e-b701-11b5b397c2fc admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:28:38.767298 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f19ee0-99e7-432e-b701-11b5b397c2fc admin admin] PATH_INFO: `/v3/projects` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:28:38.768042 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f19ee0-99e7-432e-b701-11b5b397c2fc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:28:38.769982 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f19ee0-99e7-432e-b701-11b5b397c2fc admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:28:38.800310 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1423/2829] 10.222.0.58 () {60 vars in 1152 bytes} [Tue Oct 12 17:28:38 2021] POST /identity/v3/projects => generated 365 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 17:28:38.805182 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8433c449-2209-4af7-85f5-f7199b4b4780 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:28:38.817781 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8433c449-2209-4af7-85f5-f7199b4b4780 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:28:38.878095 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de59ea9-84ce-433c-87c8-c4abbda55a46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:28:38.878674 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de59ea9-84ce-433c-87c8-c4abbda55a46 admin admin] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:28:38.879037 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de59ea9-84ce-433c-87c8-c4abbda55a46 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:28:38.879247 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de59ea9-84ce-433c-87c8-c4abbda55a46 admin admin] PATH_INFO: `/v3/users` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:28:38.880069 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de59ea9-84ce-433c-87c8-c4abbda55a46 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:28:38.882617 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de59ea9-84ce-433c-87c8-c4abbda55a46 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:28:38.902120 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1407/2830] 10.222.0.58 () {60 vars in 1143 bytes} [Tue Oct 12 17:28:38 2021] POST /identity/v3/users => generated 283 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 17:28:38.906139 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f19ee0-99e7-432e-b701-11b5b397c2fc admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:28:38.916292 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f19ee0-99e7-432e-b701-11b5b397c2fc admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:28:38.921889 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4277c8e5-4a38-45fc-a71b-1f10ebb016ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:28:38.922569 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4277c8e5-4a38-45fc-a71b-1f10ebb016ac admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:28:38.922906 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4277c8e5-4a38-45fc-a71b-1f10ebb016ac admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:28:38.923120 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4277c8e5-4a38-45fc-a71b-1f10ebb016ac admin admin] PATH_INFO: `/v3/roles` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:28:38.923853 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4277c8e5-4a38-45fc-a71b-1f10ebb016ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:28:38.925704 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4277c8e5-4a38-45fc-a71b-1f10ebb016ac admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:28:38.939622 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1424/2831] 10.222.0.58 () {58 vars in 1121 bytes} [Tue Oct 12 17:28:38 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 17:28:38.940922 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de59ea9-84ce-433c-87c8-c4abbda55a46 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:28:38.954750 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de59ea9-84ce-433c-87c8-c4abbda55a46 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:28:38.959918 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1981dbc0-4be8-420c-b591-8383ee70bd66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:28:38.960604 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1981dbc0-4be8-420c-b591-8383ee70bd66 admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:28:38.961064 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1981dbc0-4be8-420c-b591-8383ee70bd66 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:28:38.961257 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1981dbc0-4be8-420c-b591-8383ee70bd66 admin admin] PATH_INFO: `/v3/roles` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:28:38.962513 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1981dbc0-4be8-420c-b591-8383ee70bd66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:28:38.964160 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1981dbc0-4be8-420c-b591-8383ee70bd66 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:28:38.978492 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1408/2832] 10.222.0.58 () {58 vars in 1121 bytes} [Tue Oct 12 17:28:38 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 17:28:38.980272 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4277c8e5-4a38-45fc-a71b-1f10ebb016ac admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:28:38.991910 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4277c8e5-4a38-45fc-a71b-1f10ebb016ac admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:28:38.996662 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d4044c-b58a-4129-b1bb-ccc8ff956af2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:28:38.997523 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d4044c-b58a-4129-b1bb-ccc8ff956af2 admin admin] REQUEST_METHOD: `PUT` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:28:38.998220 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d4044c-b58a-4129-b1bb-ccc8ff956af2 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:28:38.998220 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d4044c-b58a-4129-b1bb-ccc8ff956af2 admin admin] PATH_INFO: `/v3/projects/094f9b73e0da4cb39bfe22e695fa62a4/users/173de69eb8664051b53877b0c2accaba/roles/55ba49fe29884e64b57c3ad13188d554` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:28:39.012550 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d4044c-b58a-4129-b1bb-ccc8ff956af2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=094f9b73e0da4cb39bfe22e695fa62a4, user_id=173de69eb8664051b53877b0c2accaba, role_id=55ba49fe29884e64b57c3ad13188d554)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:28:39.015177 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d4044c-b58a-4129-b1bb-ccc8ff956af2 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:28:39.028193 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1425/2833] 10.222.0.58 () {60 vars in 1482 bytes} [Tue Oct 12 17:28:38 2021] PUT /identity/v3/projects/094f9b73e0da4cb39bfe22e695fa62a4/users/173de69eb8664051b53877b0c2accaba/roles/55ba49fe29884e64b57c3ad13188d554 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 17:28:39.039739 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a5cbfe-aca1-43cb-895c-da25ed8ed8fb None None] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:28:39.040032 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a5cbfe-aca1-43cb-895c-da25ed8ed8fb None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:28:39.040312 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a5cbfe-aca1-43cb-895c-da25ed8ed8fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:28:39.068281 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.auth.core [None req-07a5cbfe-aca1-43cb-895c-da25ed8ed8fb None None] MFA Rules not processed for user `173de69eb8664051b53877b0c2accaba`. Rule list: `[]` (Enabled: `True`). {{(pid=85205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 17:28:39.069530 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-07a5cbfe-aca1-43cb-895c-da25ed8ed8fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:28:39.137628 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1409/2834] 10.222.0.58 () {58 vars in 957 bytes} [Tue Oct 12 17:28:39 2021] POST /identity/v3/auth/tokens => generated 3385 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 17:28:39.148010 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d4044c-b58a-4129-b1bb-ccc8ff956af2 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:28:39.149708 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-a2d4044c-b58a-4129-b1bb-ccc8ff956af2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:28:39.215449 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d4044c-b58a-4129-b1bb-ccc8ff956af2 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:28:39.220218 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135fe06c-13cc-4ebc-88fb-e49662f62128 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04704222b3d64a33a6c092fc641ccbb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:28:39.221231 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135fe06c-13cc-4ebc-88fb-e49662f62128 service cinder] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:28:39.221477 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135fe06c-13cc-4ebc-88fb-e49662f62128 service cinder] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:28:39.222062 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135fe06c-13cc-4ebc-88fb-e49662f62128 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:28:39.232177 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135fe06c-13cc-4ebc-88fb-e49662f62128 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:28:39.233644 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135fe06c-13cc-4ebc-88fb-e49662f62128 service cinder] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:28:39.243690 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1426/2835] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Oct 12 17:28:39 2021] GET /identity/v3/auth/tokens => generated 3385 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 17:28:40.064856 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535ba647-d44e-4846-8400-a2b2f3705204 None None] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:28:40.065345 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535ba647-d44e-4846-8400-a2b2f3705204 None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:28:40.065432 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535ba647-d44e-4846-8400-a2b2f3705204 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:28:40.083464 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.auth.core [None req-535ba647-d44e-4846-8400-a2b2f3705204 None None] MFA Rules not processed for user `387a65d2bfb142499c9b3b0ac946f48b`. Rule list: `[]` (Enabled: `True`). {{(pid=85205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 17:28:40.084698 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-535ba647-d44e-4846-8400-a2b2f3705204 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:28:40.145860 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1410/2836] 10.222.0.58 () {58 vars in 967 bytes} [Tue Oct 12 17:28:40 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 17:28:40.186180 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135fe06c-13cc-4ebc-88fb-e49662f62128 service cinder] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:28:40.187557 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-135fe06c-13cc-4ebc-88fb-e49662f62128 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:28:40.255663 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135fe06c-13cc-4ebc-88fb-e49662f62128 service cinder] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:28:40.260623 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4c607e-f239-4ef3-8f45-0e3dc1d4ed18 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdeb0a451344c9987b4134b957ffa22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:28:40.261271 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4c607e-f239-4ef3-8f45-0e3dc1d4ed18 service swift] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:28:40.261556 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4c607e-f239-4ef3-8f45-0e3dc1d4ed18 service swift] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:28:40.262131 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4c607e-f239-4ef3-8f45-0e3dc1d4ed18 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:28:40.269953 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4c607e-f239-4ef3-8f45-0e3dc1d4ed18 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:28:40.271472 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4c607e-f239-4ef3-8f45-0e3dc1d4ed18 service swift] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:28:40.279751 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1427/2837] 10.222.0.58 () {60 vars in 1384 bytes} [Tue Oct 12 17:28:40 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 12 17:28:48.399698 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535ba647-d44e-4846-8400-a2b2f3705204 None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:28:48.401251 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-535ba647-d44e-4846-8400-a2b2f3705204 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:28:48.464853 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535ba647-d44e-4846-8400-a2b2f3705204 None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:28:48.469477 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0d61bb-802e-4314-95e2-a91be1218290 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:28:48.470374 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0d61bb-802e-4314-95e2-a91be1218290 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:28:48.470657 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0d61bb-802e-4314-95e2-a91be1218290 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:28:48.470931 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0d61bb-802e-4314-95e2-a91be1218290 admin admin] PATH_INFO: `/v3/users/6df5de308125437a91acabc3d7b4b387` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:28:48.472144 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0d61bb-802e-4314-95e2-a91be1218290 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6df5de308125437a91acabc3d7b4b387)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:28:48.474086 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0d61bb-802e-4314-95e2-a91be1218290 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:28:48.527150 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-fe0d61bb-802e-4314-95e2-a91be1218290 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6df5de308125437a91acabc3d7b4b387'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:28:48.538491 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-fe0d61bb-802e-4314-95e2-a91be1218290 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6df5de308125437a91acabc3d7b4b387'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:28:48.545765 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-fe0d61bb-802e-4314-95e2-a91be1218290 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6df5de308125437a91acabc3d7b4b387'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:28:48.552509 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-fe0d61bb-802e-4314-95e2-a91be1218290 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6df5de308125437a91acabc3d7b4b387'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:28:48.553146 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-fe0d61bb-802e-4314-95e2-a91be1218290 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6df5de308125437a91acabc3d7b4b387'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:28:48.559665 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1411/2838] 10.222.0.58 () {58 vars in 1223 bytes} [Tue Oct 12 17:28:48 2021] DELETE /identity/v3/users/6df5de308125437a91acabc3d7b4b387 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 17:28:48.759436 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4c607e-f239-4ef3-8f45-0e3dc1d4ed18 service swift] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:28:48.776202 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4c607e-f239-4ef3-8f45-0e3dc1d4ed18 service swift] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:28:48.836097 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41228f1a-bd83-4cf5-a79d-6b8a39606419 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:28:48.837161 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41228f1a-bd83-4cf5-a79d-6b8a39606419 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:28:48.837448 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41228f1a-bd83-4cf5-a79d-6b8a39606419 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:28:48.837721 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41228f1a-bd83-4cf5-a79d-6b8a39606419 admin admin] PATH_INFO: `/v3/projects/f77ac05b3c03484f88e6f24b224b6d13` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:28:48.839026 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41228f1a-bd83-4cf5-a79d-6b8a39606419 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f77ac05b3c03484f88e6f24b224b6d13)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:28:48.840948 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41228f1a-bd83-4cf5-a79d-6b8a39606419 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:28:48.888186 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-41228f1a-bd83-4cf5-a79d-6b8a39606419 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f77ac05b3c03484f88e6f24b224b6d13', 'request_id': 'req-41228f1a-bd83-4cf5-a79d-6b8a39606419'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:28:48.894002 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-41228f1a-bd83-4cf5-a79d-6b8a39606419 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f77ac05b3c03484f88e6f24b224b6d13', 'request_id': 'req-41228f1a-bd83-4cf5-a79d-6b8a39606419'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:28:48.900255 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-41228f1a-bd83-4cf5-a79d-6b8a39606419 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f77ac05b3c03484f88e6f24b224b6d13', 'request_id': 'req-41228f1a-bd83-4cf5-a79d-6b8a39606419'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:28:48.911793 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-41228f1a-bd83-4cf5-a79d-6b8a39606419 admin admin] The token cache is being invalidate because project f77ac05b3c03484f88e6f24b224b6d13 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=85204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 17:28:48.912011 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-41228f1a-bd83-4cf5-a79d-6b8a39606419 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:28:48.913432 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-41228f1a-bd83-4cf5-a79d-6b8a39606419 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:28:48.915211 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1428/2839] 10.222.0.58 () {58 vars in 1232 bytes} [Tue Oct 12 17:28:48 2021] DELETE /identity/v3/projects/f77ac05b3c03484f88e6f24b224b6d13 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 17:28:48.918966 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0d61bb-802e-4314-95e2-a91be1218290 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:28:48.920432 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-fe0d61bb-802e-4314-95e2-a91be1218290 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:28:48.941217 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0d61bb-802e-4314-95e2-a91be1218290 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:28:48.995709 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13660268-c970-4231-9346-46426eea1ddc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:28:48.996583 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13660268-c970-4231-9346-46426eea1ddc admin admin] REQUEST_METHOD: `DELETE` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:28:48.996865 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13660268-c970-4231-9346-46426eea1ddc admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:28:48.997141 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13660268-c970-4231-9346-46426eea1ddc admin admin] PATH_INFO: `/v3/users/bc72d7500ddb4854ac7ddc9b8965dfa3` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:28:48.998372 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13660268-c970-4231-9346-46426eea1ddc admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc72d7500ddb4854ac7ddc9b8965dfa3)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:28:49.000245 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13660268-c970-4231-9346-46426eea1ddc admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:28:49.045230 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-13660268-c970-4231-9346-46426eea1ddc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc72d7500ddb4854ac7ddc9b8965dfa3'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:28:49.058028 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-13660268-c970-4231-9346-46426eea1ddc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc72d7500ddb4854ac7ddc9b8965dfa3'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:28:49.065758 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-13660268-c970-4231-9346-46426eea1ddc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc72d7500ddb4854ac7ddc9b8965dfa3'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:28:49.072620 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-13660268-c970-4231-9346-46426eea1ddc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc72d7500ddb4854ac7ddc9b8965dfa3'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:28:49.073252 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-13660268-c970-4231-9346-46426eea1ddc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc72d7500ddb4854ac7ddc9b8965dfa3'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:28:49.078925 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1412/2840] 10.222.0.58 () {58 vars in 1223 bytes} [Tue Oct 12 17:28:48 2021] DELETE /identity/v3/users/bc72d7500ddb4854ac7ddc9b8965dfa3 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 17:28:49.268205 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41228f1a-bd83-4cf5-a79d-6b8a39606419 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:28:49.270195 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-41228f1a-bd83-4cf5-a79d-6b8a39606419 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:28:49.321760 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41228f1a-bd83-4cf5-a79d-6b8a39606419 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:28:49.393090 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60095ef-bc70-4055-be35-8c0a9132c4a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:28:49.394268 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60095ef-bc70-4055-be35-8c0a9132c4a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:28:49.394549 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60095ef-bc70-4055-be35-8c0a9132c4a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:28:49.394821 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60095ef-bc70-4055-be35-8c0a9132c4a1 admin admin] PATH_INFO: `/v3/projects/e52b0e0a8ded4261b3057d438631edd6` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:28:49.396789 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60095ef-bc70-4055-be35-8c0a9132c4a1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e52b0e0a8ded4261b3057d438631edd6)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:28:49.399345 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60095ef-bc70-4055-be35-8c0a9132c4a1 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:28:49.446530 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-d60095ef-bc70-4055-be35-8c0a9132c4a1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e52b0e0a8ded4261b3057d438631edd6', 'request_id': 'req-d60095ef-bc70-4055-be35-8c0a9132c4a1'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:28:49.452691 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-d60095ef-bc70-4055-be35-8c0a9132c4a1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e52b0e0a8ded4261b3057d438631edd6', 'request_id': 'req-d60095ef-bc70-4055-be35-8c0a9132c4a1'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:28:49.459134 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-d60095ef-bc70-4055-be35-8c0a9132c4a1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e52b0e0a8ded4261b3057d438631edd6', 'request_id': 'req-d60095ef-bc70-4055-be35-8c0a9132c4a1'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:28:49.473270 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-d60095ef-bc70-4055-be35-8c0a9132c4a1 admin admin] The token cache is being invalidate because project e52b0e0a8ded4261b3057d438631edd6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=85204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 17:28:49.473737 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-d60095ef-bc70-4055-be35-8c0a9132c4a1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:28:49.474511 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-d60095ef-bc70-4055-be35-8c0a9132c4a1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:28:49.476735 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1429/2841] 10.222.0.58 () {58 vars in 1232 bytes} [Tue Oct 12 17:28:49 2021] DELETE /identity/v3/projects/e52b0e0a8ded4261b3057d438631edd6 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 17:28:51.016726 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13660268-c970-4231-9346-46426eea1ddc admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:28:51.018540 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-13660268-c970-4231-9346-46426eea1ddc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:28:51.032755 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13660268-c970-4231-9346-46426eea1ddc admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:28:51.088848 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ebbc8d-7e5c-46fc-bd2c-8a7918b6a458 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:28:51.089735 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ebbc8d-7e5c-46fc-bd2c-8a7918b6a458 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:28:51.090124 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ebbc8d-7e5c-46fc-bd2c-8a7918b6a458 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:28:51.090482 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ebbc8d-7e5c-46fc-bd2c-8a7918b6a458 admin admin] PATH_INFO: `/v3/users/8f7ee28a4d884e40a5a1c5e427fba8de` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:28:51.091754 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ebbc8d-7e5c-46fc-bd2c-8a7918b6a458 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8f7ee28a4d884e40a5a1c5e427fba8de)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:28:51.093661 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ebbc8d-7e5c-46fc-bd2c-8a7918b6a458 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:28:51.140218 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-04ebbc8d-7e5c-46fc-bd2c-8a7918b6a458 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8f7ee28a4d884e40a5a1c5e427fba8de'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:28:51.151356 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-04ebbc8d-7e5c-46fc-bd2c-8a7918b6a458 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8f7ee28a4d884e40a5a1c5e427fba8de'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:28:51.158231 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-04ebbc8d-7e5c-46fc-bd2c-8a7918b6a458 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8f7ee28a4d884e40a5a1c5e427fba8de'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:28:51.165204 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-04ebbc8d-7e5c-46fc-bd2c-8a7918b6a458 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8f7ee28a4d884e40a5a1c5e427fba8de'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:28:51.165884 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-04ebbc8d-7e5c-46fc-bd2c-8a7918b6a458 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8f7ee28a4d884e40a5a1c5e427fba8de'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:28:51.171469 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1413/2842] 10.222.0.58 () {58 vars in 1223 bytes} [Tue Oct 12 17:28:51 2021] DELETE /identity/v3/users/8f7ee28a4d884e40a5a1c5e427fba8de => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 17:28:51.337823 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60095ef-bc70-4055-be35-8c0a9132c4a1 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:28:51.339330 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-d60095ef-bc70-4055-be35-8c0a9132c4a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:28:51.353075 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60095ef-bc70-4055-be35-8c0a9132c4a1 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:28:51.406807 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0475cd-c229-498b-8a90-308e28f81cc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:28:51.407654 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0475cd-c229-498b-8a90-308e28f81cc7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:28:51.407937 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0475cd-c229-498b-8a90-308e28f81cc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:28:51.408211 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0475cd-c229-498b-8a90-308e28f81cc7 admin admin] PATH_INFO: `/v3/projects/fa0d17f286a74417bb2ec8b31b9fdada` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:28:51.409405 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0475cd-c229-498b-8a90-308e28f81cc7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fa0d17f286a74417bb2ec8b31b9fdada)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:28:51.411351 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0475cd-c229-498b-8a90-308e28f81cc7 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:28:51.454086 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-8d0475cd-c229-498b-8a90-308e28f81cc7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa0d17f286a74417bb2ec8b31b9fdada', 'request_id': 'req-8d0475cd-c229-498b-8a90-308e28f81cc7'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:28:51.459308 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-8d0475cd-c229-498b-8a90-308e28f81cc7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa0d17f286a74417bb2ec8b31b9fdada', 'request_id': 'req-8d0475cd-c229-498b-8a90-308e28f81cc7'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:28:51.465708 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-8d0475cd-c229-498b-8a90-308e28f81cc7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa0d17f286a74417bb2ec8b31b9fdada', 'request_id': 'req-8d0475cd-c229-498b-8a90-308e28f81cc7'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:28:51.477862 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-8d0475cd-c229-498b-8a90-308e28f81cc7 admin admin] The token cache is being invalidate because project fa0d17f286a74417bb2ec8b31b9fdada was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=85204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 17:28:51.478181 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-8d0475cd-c229-498b-8a90-308e28f81cc7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:28:51.478820 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-8d0475cd-c229-498b-8a90-308e28f81cc7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:28:51.480305 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1430/2843] 10.222.0.58 () {58 vars in 1232 bytes} [Tue Oct 12 17:28:51 2021] DELETE /identity/v3/projects/fa0d17f286a74417bb2ec8b31b9fdada => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 17:28:51.484233 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ebbc8d-7e5c-46fc-bd2c-8a7918b6a458 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:28:51.485684 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-04ebbc8d-7e5c-46fc-bd2c-8a7918b6a458 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:28:51.498407 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ebbc8d-7e5c-46fc-bd2c-8a7918b6a458 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:28:51.553460 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b856b84-2aa4-4af5-b37b-09528faa4541 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:28:51.554332 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b856b84-2aa4-4af5-b37b-09528faa4541 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:28:51.554618 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b856b84-2aa4-4af5-b37b-09528faa4541 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:28:51.554893 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b856b84-2aa4-4af5-b37b-09528faa4541 admin admin] PATH_INFO: `/v3/users/13059d127f414ca08c63ac963b60a339` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:28:51.556114 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b856b84-2aa4-4af5-b37b-09528faa4541 admin admin] RBAC: Authorizing `identity:delete_user(user_id=13059d127f414ca08c63ac963b60a339)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:28:51.558029 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b856b84-2aa4-4af5-b37b-09528faa4541 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:28:51.599975 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-1b856b84-2aa4-4af5-b37b-09528faa4541 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '13059d127f414ca08c63ac963b60a339'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:28:51.611558 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-1b856b84-2aa4-4af5-b37b-09528faa4541 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '13059d127f414ca08c63ac963b60a339'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:28:51.618561 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-1b856b84-2aa4-4af5-b37b-09528faa4541 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '13059d127f414ca08c63ac963b60a339'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:28:51.625163 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-1b856b84-2aa4-4af5-b37b-09528faa4541 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '13059d127f414ca08c63ac963b60a339'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:28:51.625803 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-1b856b84-2aa4-4af5-b37b-09528faa4541 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '13059d127f414ca08c63ac963b60a339'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:28:51.631407 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1414/2844] 10.222.0.58 () {58 vars in 1223 bytes} [Tue Oct 12 17:28:51 2021] DELETE /identity/v3/users/13059d127f414ca08c63ac963b60a339 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 17:28:51.798570 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0475cd-c229-498b-8a90-308e28f81cc7 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:28:51.800177 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-8d0475cd-c229-498b-8a90-308e28f81cc7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:28:51.814177 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0475cd-c229-498b-8a90-308e28f81cc7 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:28:51.870632 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14c12c9-aea6-4289-a869-41abeeeaf81e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:28:51.871613 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14c12c9-aea6-4289-a869-41abeeeaf81e admin admin] REQUEST_METHOD: `DELETE` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:28:51.871964 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14c12c9-aea6-4289-a869-41abeeeaf81e admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:28:51.872318 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14c12c9-aea6-4289-a869-41abeeeaf81e admin admin] PATH_INFO: `/v3/projects/7a7b70a460984d07b022d9f7315dfaca` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:28:51.873581 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14c12c9-aea6-4289-a869-41abeeeaf81e admin admin] RBAC: Authorizing `identity:delete_project(project_id=7a7b70a460984d07b022d9f7315dfaca)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:28:51.875573 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14c12c9-aea6-4289-a869-41abeeeaf81e admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:28:51.919947 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-f14c12c9-aea6-4289-a869-41abeeeaf81e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a7b70a460984d07b022d9f7315dfaca', 'request_id': 'req-f14c12c9-aea6-4289-a869-41abeeeaf81e'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:28:51.925257 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-f14c12c9-aea6-4289-a869-41abeeeaf81e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a7b70a460984d07b022d9f7315dfaca', 'request_id': 'req-f14c12c9-aea6-4289-a869-41abeeeaf81e'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:28:51.931792 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-f14c12c9-aea6-4289-a869-41abeeeaf81e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a7b70a460984d07b022d9f7315dfaca', 'request_id': 'req-f14c12c9-aea6-4289-a869-41abeeeaf81e'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:28:51.945343 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-f14c12c9-aea6-4289-a869-41abeeeaf81e admin admin] The token cache is being invalidate because project 7a7b70a460984d07b022d9f7315dfaca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=85204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 17:28:51.945636 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-f14c12c9-aea6-4289-a869-41abeeeaf81e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:28:51.947755 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-f14c12c9-aea6-4289-a869-41abeeeaf81e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:28:51.948204 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1431/2845] 10.222.0.58 () {58 vars in 1232 bytes} [Tue Oct 12 17:28:51 2021] DELETE /identity/v3/projects/7a7b70a460984d07b022d9f7315dfaca => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 17:29:03.146792 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b856b84-2aa4-4af5-b37b-09528faa4541 admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:29:03.148219 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-1b856b84-2aa4-4af5-b37b-09528faa4541 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:29:03.222888 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b856b84-2aa4-4af5-b37b-09528faa4541 admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:29:03.283028 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078e4d79-bef4-4362-a28b-247643db4064 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4102412c40bc4745bba8c31f1caf9788', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:29:03.283685 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078e4d79-bef4-4362-a28b-247643db4064 service placement] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:29:03.283970 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078e4d79-bef4-4362-a28b-247643db4064 service placement] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:29:03.284250 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078e4d79-bef4-4362-a28b-247643db4064 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:29:03.286136 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-078e4d79-bef4-4362-a28b-247643db4064 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:29:03.298473 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078e4d79-bef4-4362-a28b-247643db4064 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:29:03.300029 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078e4d79-bef4-4362-a28b-247643db4064 service placement] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:29:03.310504 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1415/2846] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Oct 12 17:29:03 2021] GET /identity/v3/auth/tokens => generated 3451 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 17:29:16.273609 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14c12c9-aea6-4289-a869-41abeeeaf81e admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:29:16.275077 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-f14c12c9-aea6-4289-a869-41abeeeaf81e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:29:16.363941 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14c12c9-aea6-4289-a869-41abeeeaf81e admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:29:16.369041 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce13498d-08a9-4e26-b2ca-d9385702f9d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:29:16.369923 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce13498d-08a9-4e26-b2ca-d9385702f9d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:29:16.370213 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce13498d-08a9-4e26-b2ca-d9385702f9d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:29:16.370488 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce13498d-08a9-4e26-b2ca-d9385702f9d4 admin admin] PATH_INFO: `/v3/users/173de69eb8664051b53877b0c2accaba` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:29:16.371681 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce13498d-08a9-4e26-b2ca-d9385702f9d4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=173de69eb8664051b53877b0c2accaba)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:29:16.373580 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce13498d-08a9-4e26-b2ca-d9385702f9d4 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:29:16.418219 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-ce13498d-08a9-4e26-b2ca-d9385702f9d4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '173de69eb8664051b53877b0c2accaba'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:29:16.430350 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-ce13498d-08a9-4e26-b2ca-d9385702f9d4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '173de69eb8664051b53877b0c2accaba'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:29:16.436941 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-ce13498d-08a9-4e26-b2ca-d9385702f9d4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '173de69eb8664051b53877b0c2accaba'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:29:16.444628 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-ce13498d-08a9-4e26-b2ca-d9385702f9d4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '173de69eb8664051b53877b0c2accaba'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:29:16.445244 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-ce13498d-08a9-4e26-b2ca-d9385702f9d4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '173de69eb8664051b53877b0c2accaba'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:29:16.450876 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1432/2847] 10.222.0.58 () {58 vars in 1223 bytes} [Tue Oct 12 17:29:16 2021] DELETE /identity/v3/users/173de69eb8664051b53877b0c2accaba => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 17:29:16.458810 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d0a22e-7836-465d-beac-bace1fdaeee9 None None] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:29:16.459292 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d0a22e-7836-465d-beac-bace1fdaeee9 None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:29:16.459383 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d0a22e-7836-465d-beac-bace1fdaeee9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:29:16.484936 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.auth.core [None req-15d0a22e-7836-465d-beac-bace1fdaeee9 None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 17:29:16.486156 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-15d0a22e-7836-465d-beac-bace1fdaeee9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:29:16.542419 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1416/2848] 10.222.0.58 () {58 vars in 957 bytes} [Tue Oct 12 17:29:16 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 17:29:16.552660 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce13498d-08a9-4e26-b2ca-d9385702f9d4 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:29:16.554079 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-ce13498d-08a9-4e26-b2ca-d9385702f9d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:29:16.609752 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce13498d-08a9-4e26-b2ca-d9385702f9d4 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:29:16.613382 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1ed34c-c162-48a9-ae88-0b6e9c00b0f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e65f6d0598e4c539134292b86fb43d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:29:16.614077 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1ed34c-c162-48a9-ae88-0b6e9c00b0f8 service neutron] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:29:16.614356 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1ed34c-c162-48a9-ae88-0b6e9c00b0f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:29:16.615198 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1ed34c-c162-48a9-ae88-0b6e9c00b0f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:29:16.623924 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1ed34c-c162-48a9-ae88-0b6e9c00b0f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:29:16.625327 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1ed34c-c162-48a9-ae88-0b6e9c00b0f8 service neutron] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:29:16.634351 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1433/2849] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Oct 12 17:29:16 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 17:29:16.891944 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d0a22e-7836-465d-beac-bace1fdaeee9 None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:29:16.893433 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-15d0a22e-7836-465d-beac-bace1fdaeee9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:29:16.906048 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d0a22e-7836-465d-beac-bace1fdaeee9 None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:29:16.910672 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b63a70-290c-4480-abd2-5a7bedb3114a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:29:16.912104 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b63a70-290c-4480-abd2-5a7bedb3114a admin admin] REQUEST_METHOD: `DELETE` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:29:16.912393 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b63a70-290c-4480-abd2-5a7bedb3114a admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:29:16.912671 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b63a70-290c-4480-abd2-5a7bedb3114a admin admin] PATH_INFO: `/v3/projects/094f9b73e0da4cb39bfe22e695fa62a4` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:29:16.913905 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b63a70-290c-4480-abd2-5a7bedb3114a admin admin] RBAC: Authorizing `identity:delete_project(project_id=094f9b73e0da4cb39bfe22e695fa62a4)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:29:16.915792 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b63a70-290c-4480-abd2-5a7bedb3114a admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:29:16.960092 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-05b63a70-290c-4480-abd2-5a7bedb3114a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '094f9b73e0da4cb39bfe22e695fa62a4', 'request_id': 'req-05b63a70-290c-4480-abd2-5a7bedb3114a'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:29:16.967302 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-05b63a70-290c-4480-abd2-5a7bedb3114a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '094f9b73e0da4cb39bfe22e695fa62a4', 'request_id': 'req-05b63a70-290c-4480-abd2-5a7bedb3114a'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:29:16.973084 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-05b63a70-290c-4480-abd2-5a7bedb3114a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '094f9b73e0da4cb39bfe22e695fa62a4', 'request_id': 'req-05b63a70-290c-4480-abd2-5a7bedb3114a'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:29:16.987402 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-05b63a70-290c-4480-abd2-5a7bedb3114a admin admin] The token cache is being invalidate because project 094f9b73e0da4cb39bfe22e695fa62a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=85205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 17:29:16.987682 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-05b63a70-290c-4480-abd2-5a7bedb3114a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:29:16.988304 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-05b63a70-290c-4480-abd2-5a7bedb3114a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:29:16.989826 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1417/2850] 10.222.0.58 () {58 vars in 1232 bytes} [Tue Oct 12 17:29:16 2021] DELETE /identity/v3/projects/094f9b73e0da4cb39bfe22e695fa62a4 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 17:29:16.995519 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5f49b7-cd8e-4105-a1e2-0542c5b55a77 None None] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:29:16.995804 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5f49b7-cd8e-4105-a1e2-0542c5b55a77 None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:29:16.996072 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5f49b7-cd8e-4105-a1e2-0542c5b55a77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:29:17.041482 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.auth.core [None req-5a5f49b7-cd8e-4105-a1e2-0542c5b55a77 None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 17:29:17.042693 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-5a5f49b7-cd8e-4105-a1e2-0542c5b55a77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:29:17.096172 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1434/2851] 10.222.0.58 () {58 vars in 957 bytes} [Tue Oct 12 17:29:16 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 17:29:17.104635 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdea2b3c-ef3d-4b30-8977-ea72d02842f3 None None] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:29:17.104924 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdea2b3c-ef3d-4b30-8977-ea72d02842f3 None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:29:17.105203 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdea2b3c-ef3d-4b30-8977-ea72d02842f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:29:17.122813 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.auth.core [None req-bdea2b3c-ef3d-4b30-8977-ea72d02842f3 None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 17:29:17.124004 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-bdea2b3c-ef3d-4b30-8977-ea72d02842f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:29:17.131839 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1418/2852] 10.222.0.58 () {58 vars in 957 bytes} [Tue Oct 12 17:29:17 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 17:29:17.135912 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5f49b7-cd8e-4105-a1e2-0542c5b55a77 None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:29:17.145574 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5f49b7-cd8e-4105-a1e2-0542c5b55a77 None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:29:17.150667 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612ec5c7-688f-4577-b75e-2c994349777e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:29:17.151303 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612ec5c7-688f-4577-b75e-2c994349777e admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:29:17.151583 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612ec5c7-688f-4577-b75e-2c994349777e admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:29:17.151853 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612ec5c7-688f-4577-b75e-2c994349777e admin admin] PATH_INFO: `/v3/domains` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:29:17.152582 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612ec5c7-688f-4577-b75e-2c994349777e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 17:29:17.152885 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612ec5c7-688f-4577-b75e-2c994349777e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:29:17.154490 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612ec5c7-688f-4577-b75e-2c994349777e admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:29:17.165898 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1435/2853] 10.222.0.58 () {58 vars in 1152 bytes} [Tue Oct 12 17:29:17 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 17:29:17.169812 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdea2b3c-ef3d-4b30-8977-ea72d02842f3 None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:29:17.178780 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdea2b3c-ef3d-4b30-8977-ea72d02842f3 None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:29:17.183437 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1813b32-1c9d-4840-9ec0-d437092adf0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:29:17.184070 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1813b32-1c9d-4840-9ec0-d437092adf0e admin admin] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:29:17.184377 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1813b32-1c9d-4840-9ec0-d437092adf0e admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:29:17.184650 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1813b32-1c9d-4840-9ec0-d437092adf0e admin admin] PATH_INFO: `/v3/projects` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:29:17.185350 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1813b32-1c9d-4840-9ec0-d437092adf0e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:29:17.187232 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1813b32-1c9d-4840-9ec0-d437092adf0e admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:29:17.220992 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1419/2854] 10.222.0.58 () {60 vars in 1152 bytes} [Tue Oct 12 17:29:17 2021] POST /identity/v3/projects => generated 397 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 17:29:17.225623 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612ec5c7-688f-4577-b75e-2c994349777e admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:29:17.235416 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612ec5c7-688f-4577-b75e-2c994349777e admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:29:17.292656 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09aee1d6-aa0c-4343-9e0d-e8c832c3cc47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:29:17.293330 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09aee1d6-aa0c-4343-9e0d-e8c832c3cc47 admin admin] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:29:17.293586 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09aee1d6-aa0c-4343-9e0d-e8c832c3cc47 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:29:17.293855 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09aee1d6-aa0c-4343-9e0d-e8c832c3cc47 admin admin] PATH_INFO: `/v3/users` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:29:17.294695 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09aee1d6-aa0c-4343-9e0d-e8c832c3cc47 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:29:17.296575 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09aee1d6-aa0c-4343-9e0d-e8c832c3cc47 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:29:17.315493 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1436/2855] 10.222.0.58 () {60 vars in 1143 bytes} [Tue Oct 12 17:29:17 2021] POST /identity/v3/users => generated 299 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 17:29:17.320183 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1813b32-1c9d-4840-9ec0-d437092adf0e admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:29:17.330531 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1813b32-1c9d-4840-9ec0-d437092adf0e admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:29:17.335761 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2db5059-7ffc-4be9-9d1a-75f8c8097abd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:29:17.336414 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2db5059-7ffc-4be9-9d1a-75f8c8097abd admin admin] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:29:17.336699 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2db5059-7ffc-4be9-9d1a-75f8c8097abd admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:29:17.336977 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2db5059-7ffc-4be9-9d1a-75f8c8097abd admin admin] PATH_INFO: `/v3/roles` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:29:17.337713 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2db5059-7ffc-4be9-9d1a-75f8c8097abd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:29:17.339341 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2db5059-7ffc-4be9-9d1a-75f8c8097abd admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:29:17.348989 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1420/2856] 10.222.0.58 () {58 vars in 1121 bytes} [Tue Oct 12 17:29:17 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 17:29:17.352885 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09aee1d6-aa0c-4343-9e0d-e8c832c3cc47 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:29:17.362540 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09aee1d6-aa0c-4343-9e0d-e8c832c3cc47 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:29:17.367092 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd72e0f-5cb5-4163-9813-e37df94b96fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:29:17.367731 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd72e0f-5cb5-4163-9813-e37df94b96fb admin admin] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:29:17.368013 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd72e0f-5cb5-4163-9813-e37df94b96fb admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:29:17.368285 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd72e0f-5cb5-4163-9813-e37df94b96fb admin admin] PATH_INFO: `/v3/roles` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:29:17.369024 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd72e0f-5cb5-4163-9813-e37df94b96fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:29:17.370643 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd72e0f-5cb5-4163-9813-e37df94b96fb admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:29:17.380650 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1437/2857] 10.222.0.58 () {58 vars in 1121 bytes} [Tue Oct 12 17:29:17 2021] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 17:29:17.384322 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2db5059-7ffc-4be9-9d1a-75f8c8097abd admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:29:17.394166 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2db5059-7ffc-4be9-9d1a-75f8c8097abd admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:29:17.399439 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d9fafc-6fe2-4050-8b97-a0014ef9e04c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:29:17.400326 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d9fafc-6fe2-4050-8b97-a0014ef9e04c admin admin] REQUEST_METHOD: `PUT` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:29:17.400614 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d9fafc-6fe2-4050-8b97-a0014ef9e04c admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:29:17.400924 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d9fafc-6fe2-4050-8b97-a0014ef9e04c admin admin] PATH_INFO: `/v3/projects/33e04c4b961841c9ad2c2a207a8a1541/users/0fbeaa7eff5b4a62a1985c0b1f0185fd/roles/55ba49fe29884e64b57c3ad13188d554` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:29:17.414872 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d9fafc-6fe2-4050-8b97-a0014ef9e04c admin admin] RBAC: Authorizing `identity:create_grant(project_id=33e04c4b961841c9ad2c2a207a8a1541, user_id=0fbeaa7eff5b4a62a1985c0b1f0185fd, role_id=55ba49fe29884e64b57c3ad13188d554)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:29:17.417460 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d9fafc-6fe2-4050-8b97-a0014ef9e04c admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:29:17.430383 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1421/2858] 10.222.0.58 () {60 vars in 1482 bytes} [Tue Oct 12 17:29:17 2021] PUT /identity/v3/projects/33e04c4b961841c9ad2c2a207a8a1541/users/0fbeaa7eff5b4a62a1985c0b1f0185fd/roles/55ba49fe29884e64b57c3ad13188d554 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 17:29:17.441116 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba228c7-bd56-4f35-a3c1-e6b1d3947ab7 None None] REQUEST_METHOD: `POST` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:29:17.441409 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba228c7-bd56-4f35-a3c1-e6b1d3947ab7 None None] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:29:17.441688 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba228c7-bd56-4f35-a3c1-e6b1d3947ab7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:29:17.468591 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.auth.core [None req-aba228c7-bd56-4f35-a3c1-e6b1d3947ab7 None None] MFA Rules not processed for user `0fbeaa7eff5b4a62a1985c0b1f0185fd`. Rule list: `[]` (Enabled: `True`). {{(pid=85204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 17:29:17.469791 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-aba228c7-bd56-4f35-a3c1-e6b1d3947ab7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:29:17.531014 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1438/2859] 10.222.0.58 () {58 vars in 957 bytes} [Tue Oct 12 17:29:17 2021] POST /identity/v3/auth/tokens => generated 3417 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 17:29:17.541567 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d9fafc-6fe2-4050-8b97-a0014ef9e04c admin admin] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:29:17.543364 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-07d9fafc-6fe2-4050-8b97-a0014ef9e04c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:29:17.596697 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d9fafc-6fe2-4050-8b97-a0014ef9e04c admin admin] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:29:17.600552 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96385b5-0b1b-48fc-87f6-b69e7ba39b7f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04704222b3d64a33a6c092fc641ccbb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:29:17.601136 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96385b5-0b1b-48fc-87f6-b69e7ba39b7f service cinder] REQUEST_METHOD: `GET` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:29:17.601422 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96385b5-0b1b-48fc-87f6-b69e7ba39b7f service cinder] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:29:17.601700 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96385b5-0b1b-48fc-87f6-b69e7ba39b7f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:29:17.610264 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96385b5-0b1b-48fc-87f6-b69e7ba39b7f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:29:17.611671 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96385b5-0b1b-48fc-87f6-b69e7ba39b7f service cinder] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:29:17.620753 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1422/2860] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Oct 12 17:29:17 2021] GET /identity/v3/auth/tokens => generated 3417 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 17:29:25.576943 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba228c7-bd56-4f35-a3c1-e6b1d3947ab7 None None] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:29:25.636441 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba228c7-bd56-4f35-a3c1-e6b1d3947ab7 None None] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:29:25.640888 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147134f0-4fbc-487b-814c-2a3f58fea550 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:29:25.641736 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147134f0-4fbc-487b-814c-2a3f58fea550 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:29:25.642047 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147134f0-4fbc-487b-814c-2a3f58fea550 admin admin] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:29:25.642323 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147134f0-4fbc-487b-814c-2a3f58fea550 admin admin] PATH_INFO: `/v3/users/0fbeaa7eff5b4a62a1985c0b1f0185fd` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:29:25.643500 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147134f0-4fbc-487b-814c-2a3f58fea550 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0fbeaa7eff5b4a62a1985c0b1f0185fd)` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:29:25.645413 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147134f0-4fbc-487b-814c-2a3f58fea550 admin admin] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:29:25.688643 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-147134f0-4fbc-487b-814c-2a3f58fea550 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0fbeaa7eff5b4a62a1985c0b1f0185fd'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:29:25.699772 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-147134f0-4fbc-487b-814c-2a3f58fea550 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0fbeaa7eff5b4a62a1985c0b1f0185fd'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:29:25.706258 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-147134f0-4fbc-487b-814c-2a3f58fea550 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0fbeaa7eff5b4a62a1985c0b1f0185fd'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:29:25.712980 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-147134f0-4fbc-487b-814c-2a3f58fea550 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0fbeaa7eff5b4a62a1985c0b1f0185fd'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:29:25.713594 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.notifications [None req-147134f0-4fbc-487b-814c-2a3f58fea550 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0fbeaa7eff5b4a62a1985c0b1f0185fd'} {{(pid=85204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:29:25.719214 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1439/2861] 10.222.0.58 () {58 vars in 1223 bytes} [Tue Oct 12 17:29:25 2021] DELETE /identity/v3/users/0fbeaa7eff5b4a62a1985c0b1f0185fd => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 17:29:25.724257 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f38c35e-8ca9-42b0-8fb1-9e7e6eab33e7 None None] REQUEST_METHOD: `POST` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:29:25.724748 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f38c35e-8ca9-42b0-8fb1-9e7e6eab33e7 None None] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:29:25.724861 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f38c35e-8ca9-42b0-8fb1-9e7e6eab33e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:29:25.741855 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.auth.core [None req-7f38c35e-8ca9-42b0-8fb1-9e7e6eab33e7 None None] MFA Rules not processed for user `296f95d6453b448dad63081ef9a200d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 17:29:25.743156 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-7f38c35e-8ca9-42b0-8fb1-9e7e6eab33e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:29:25.799652 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1423/2862] 10.222.0.58 () {58 vars in 957 bytes} [Tue Oct 12 17:29:25 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 17:29:25.810339 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147134f0-4fbc-487b-814c-2a3f58fea550 admin admin] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:29:25.811791 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-147134f0-4fbc-487b-814c-2a3f58fea550 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:29:25.866956 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147134f0-4fbc-487b-814c-2a3f58fea550 admin admin] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:29:25.870614 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e88534a-e687-4ac9-aa7f-4d65cb228aa8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e65f6d0598e4c539134292b86fb43d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:29:25.871258 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e88534a-e687-4ac9-aa7f-4d65cb228aa8 service neutron] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:29:25.871542 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e88534a-e687-4ac9-aa7f-4d65cb228aa8 service neutron] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:29:25.871818 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e88534a-e687-4ac9-aa7f-4d65cb228aa8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:29:25.880629 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e88534a-e687-4ac9-aa7f-4d65cb228aa8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:29:25.882077 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e88534a-e687-4ac9-aa7f-4d65cb228aa8 service neutron] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:29:25.891558 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1440/2863] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Oct 12 17:29:25 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 17:29:26.143632 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f38c35e-8ca9-42b0-8fb1-9e7e6eab33e7 None None] Authenticating user token {{(pid=85205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:29:26.144992 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.fernet_utils [None req-7f38c35e-8ca9-42b0-8fb1-9e7e6eab33e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:29:26.161717 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f38c35e-8ca9-42b0-8fb1-9e7e6eab33e7 None None] Validating token access rules against request {{(pid=85205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:29:26.167583 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126ee422-c169-4fe6-8283-38d4ac56acb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296f95d6453b448dad63081ef9a200d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce3537317ae47bda54936a55a7d765e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:29:26.168377 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126ee422-c169-4fe6-8283-38d4ac56acb2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:29:26.168660 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126ee422-c169-4fe6-8283-38d4ac56acb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:29:26.168934 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126ee422-c169-4fe6-8283-38d4ac56acb2 admin admin] PATH_INFO: `/v3/projects/33e04c4b961841c9ad2c2a207a8a1541` {{(pid=85205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:29:26.170160 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126ee422-c169-4fe6-8283-38d4ac56acb2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=33e04c4b961841c9ad2c2a207a8a1541)` {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:29:26.172036 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126ee422-c169-4fe6-8283-38d4ac56acb2 admin admin] RBAC: Authorization granted {{(pid=85205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:29:26.216260 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-126ee422-c169-4fe6-8283-38d4ac56acb2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '33e04c4b961841c9ad2c2a207a8a1541', 'request_id': 'req-126ee422-c169-4fe6-8283-38d4ac56acb2'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:29:26.221352 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-126ee422-c169-4fe6-8283-38d4ac56acb2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '33e04c4b961841c9ad2c2a207a8a1541', 'request_id': 'req-126ee422-c169-4fe6-8283-38d4ac56acb2'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:29:26.227628 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-126ee422-c169-4fe6-8283-38d4ac56acb2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '33e04c4b961841c9ad2c2a207a8a1541', 'request_id': 'req-126ee422-c169-4fe6-8283-38d4ac56acb2'} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:29:26.238996 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-126ee422-c169-4fe6-8283-38d4ac56acb2 admin admin] The token cache is being invalidate because project 33e04c4b961841c9ad2c2a207a8a1541 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=85205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 17:29:26.239837 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-126ee422-c169-4fe6-8283-38d4ac56acb2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:29:26.240456 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: DEBUG keystone.notifications [None req-126ee422-c169-4fe6-8283-38d4ac56acb2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:29:26.241962 dv-cinder-813222-2-iscsi devstack@keystone.service[85205]: [pid: 85205|app: 0|req: 1424/2864] 10.222.0.58 () {58 vars in 1232 bytes} [Tue Oct 12 17:29:26 2021] DELETE /identity/v3/projects/33e04c4b961841c9ad2c2a207a8a1541 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 17:34:06.118564 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e88534a-e687-4ac9-aa7f-4d65cb228aa8 service neutron] Authenticating user token {{(pid=85204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:34:06.119949 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-2e88534a-e687-4ac9-aa7f-4d65cb228aa8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:34:06.267480 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e88534a-e687-4ac9-aa7f-4d65cb228aa8 service neutron] Validating token access rules against request {{(pid=85204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:34:06.323749 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a726ba3-c747-4d56-9db2-87932e1b2881 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4102412c40bc4745bba8c31f1caf9788', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3531f242eaa43b69562d70bca5ec5a8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:34:06.324387 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a726ba3-c747-4d56-9db2-87932e1b2881 service placement] REQUEST_METHOD: `GET` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:34:06.324668 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a726ba3-c747-4d56-9db2-87932e1b2881 service placement] SCRIPT_NAME: `/identity` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:34:06.324938 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a726ba3-c747-4d56-9db2-87932e1b2881 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=85204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:34:06.326734 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.fernet_utils [None req-3a726ba3-c747-4d56-9db2-87932e1b2881 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:34:06.337357 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a726ba3-c747-4d56-9db2-87932e1b2881 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:34:06.339028 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a726ba3-c747-4d56-9db2-87932e1b2881 service placement] RBAC: Authorization granted {{(pid=85204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:34:06.348476 dv-cinder-813222-2-iscsi devstack@keystone.service[85204]: [pid: 85204|app: 0|req: 1441/2865] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Oct 12 17:34:06 2021] GET /identity/v3/auth/tokens => generated 3451 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0)